-- Logs begin at Thu 2022-09-01 15:37:55 UTC, end at Thu 2022-09-01 16:50:13 UTC. -- Sep 01 16:15:15.918188 dv-cinder-836027-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 16:15:15.925654 dv-cinder-836027-9-smb devstack@keystone.service[81770]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:15:15 2022] *** Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: nodename: dv-cinder-836027-9-smb Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: machine: x86_64 Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: clock source: unix Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: pcre jit disabled Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: detected number of CPU cores: 4 Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: current working directory: / Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: your processes number limit is 47680 Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: your memory page size is 4096 bytes Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: detected max file descriptor number: 2048 Sep 01 16:15:15.927790 dv-cinder-836027-9-smb devstack@keystone.service[81770]: lock engine: pthread robust mutexes Sep 01 16:15:15.929464 dv-cinder-836027-9-smb devstack@keystone.service[81770]: thunder lock: enabled Sep 01 16:15:15.929464 dv-cinder-836027-9-smb devstack@keystone.service[81770]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 16:15:15.929464 dv-cinder-836027-9-smb devstack@keystone.service[81770]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:15:15.969520 dv-cinder-836027-9-smb devstack@keystone.service[81770]: Python main interpreter initialized at 0x5600f8e449c0 Sep 01 16:15:15.969520 dv-cinder-836027-9-smb devstack@keystone.service[81770]: python threads support enabled Sep 01 16:15:15.969520 dv-cinder-836027-9-smb devstack@keystone.service[81770]: your server socket listen backlog is limited to 100 connections Sep 01 16:15:15.969520 dv-cinder-836027-9-smb devstack@keystone.service[81770]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:15:15.969993 dv-cinder-836027-9-smb devstack@keystone.service[81770]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:15:15.970074 dv-cinder-836027-9-smb devstack@keystone.service[81770]: *** Operational MODE: preforking *** Sep 01 16:15:15.970297 dv-cinder-836027-9-smb devstack@keystone.service[81770]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:15:15.970297 dv-cinder-836027-9-smb devstack@keystone.service[81770]: spawned uWSGI master process (pid: 81770) Sep 01 16:15:15.970505 dv-cinder-836027-9-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 16:15:15.971631 dv-cinder-836027-9-smb devstack@keystone.service[81770]: spawned uWSGI worker 1 (pid: 81783, cores: 1) Sep 01 16:15:15.971631 dv-cinder-836027-9-smb devstack@keystone.service[81770]: spawned uWSGI worker 2 (pid: 81784, cores: 1) Sep 01 16:15:15.971631 dv-cinder-836027-9-smb devstack@keystone.service[81770]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:15:20.418848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:15:20.418848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: from cryptography.utils import int_from_bytes Sep 01 16:15:20.419624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:15:20.419624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: from cryptography.utils import int_from_bytes Sep 01 16:15:20.419738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:15:20.419738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: from cryptography.utils import int_from_bytes Sep 01 16:15:20.420161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:15:20.420161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: from cryptography.utils import int_from_bytes Sep 01 16:15:20.470419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:15:20.470614 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:15:20.470792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] command line args: [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:15:20.471061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:15:20.471238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ================================================================================ {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:15:20.471492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] admin_token = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.471738 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] config_dir = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.471926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.472012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:15:20.472093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] config_source = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.472204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:15:20.472292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] debug = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.472400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] command line args: [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:15:20.472484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.472716 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:15:20.472846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.472930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ================================================================================ {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:15:20.472999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.473101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] admin_token = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.473251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.473341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] config_dir = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.473500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.473606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.473702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] config_source = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.473809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.473931 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] debug = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.474051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_config_append = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.474149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.474282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.474282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_dir = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.474474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.474582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_file = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.474698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.474786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.474909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.474987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.475100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.475367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.476029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.476113 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.476189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_config_append = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.476311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.476388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.476515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.476599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_dir = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.476679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.476797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_file = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.476879 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.476952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.477075 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.477158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.477236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.477351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.477433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.477511 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.477640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.477722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.477722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.477917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.477980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.478109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.478187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.478259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.478337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.478514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.478597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.478739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] publish_errors = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.478823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.478976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.479053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.479206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.479323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.479398 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.479620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.479731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.479858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.480091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] standard_threads = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.480224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.480322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.480464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] publish_errors = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.480560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.480638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.480716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.480854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.480944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] use_journal = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.481017 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.481099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] use_json = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.481215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] use_stderr = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.481291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.481391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] use_syslog = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.481481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.481621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.481700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] standard_threads = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.481962 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.482056 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.482137 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.482215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.482355 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.482432 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.482533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] use_journal = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.482618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.482698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] use_json = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.482851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.482935 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] use_stderr = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.483038 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] use_syslog = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.483121 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.483274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:15:20.483432 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.483533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.483622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.483774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.483858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.484018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.484106 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.484264 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.484347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.484497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.484579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.484742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.484830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.484975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.485053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.485218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.485301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.485464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.485551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.485701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.485780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.485969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.486049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.486210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.486300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.486459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.486536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.486694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.486770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.486943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.487032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.487192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.487270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.487431 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.487518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.487678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.487763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.487909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.487993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.488140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.488225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.488370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.488463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.488603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.488681 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.488850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.488927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.489097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.489249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.489324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.489395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.489542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.489627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.489788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.489867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.490043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.490120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.490281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.490369 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.490527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.490615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.490854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.491321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.491321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.491477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.491561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.491634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.491634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.491760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.491838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.491915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.491995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.492067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.492185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.492301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.492420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.492513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.492669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.492749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.492904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.492982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.493135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.493271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.493354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.493421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.493587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.493656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.493818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.493952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.494085 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.494163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.494341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.494428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.494555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.494642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.494793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.494877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.495028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.495111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.495264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.495343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.495500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.495586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.495729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.495807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.495973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.496045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.496207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.496293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.496446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.496532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.496680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.496790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.496917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.497004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.497155 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.497241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.497387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.497463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.497624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.497709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.497862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.497961 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.498124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.498202 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.498358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.498454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.498623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.498704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.498864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.498943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.499099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.499177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.499336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.499415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.499571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.499649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.499820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.499898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.500060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.500140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.500298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.500377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.500542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.500694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.500770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.500841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.501005 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.501083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.501243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.501327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.501478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.501557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.501718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.501795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.501977 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.502072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.502217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.502308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.502456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.502535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.502708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.502792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.502952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.503040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.503225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.503311 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.503426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.503496 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.503664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.503746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.503901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.503986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.504135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.504212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.504370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.504461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.504604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.504685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.504835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.504914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.505068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.505156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.505303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.505418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.505536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.505615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.505772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.505860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.506035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.506116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.506826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.507431 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.507519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.507602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.507685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.507759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.507831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.507902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.507973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.508053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.508127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.external = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.508199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.508271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.508423 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.508503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.508675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.508825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.508909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.508989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.password = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.509165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.509246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] auth.token = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.509406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.509553 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.509641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.509801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.509912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.510065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.external = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.510145 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.512997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.password = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] auth.token = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.513986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514278 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514872 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.514945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.515121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.515243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.515321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.515403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.515477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.515557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.515631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.515704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.515776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.515856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.515931 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.516004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.516076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.516148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.516220 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.516414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.516502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.516623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.516701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.516774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.516846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.516927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517075 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.517946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.518024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.518096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.518168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.518241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.518326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.518401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.518474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.518587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.518669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.518846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.518935 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.519130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.519264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.519374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.519459 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.519619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.519699 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.519873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.519962 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.520101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.520180 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.520335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.520415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.520587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.520701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.520827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.520908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.521066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.521148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.521313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.521392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.521547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.521625 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.521790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.521931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.523036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.523214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.523391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.523628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.524036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.524285 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.524527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.524853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.525162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.525425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.525843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.526139 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.526400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.526670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.527079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.527351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.530268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.530268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.530268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.530510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.530510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.530510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.530510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.530774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.530847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.530919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.530991 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531063 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531608 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.531900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532409 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.532946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.533034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.533185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.533267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.533429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.533508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.533703 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.533783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.533981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.534100 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.534230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.534311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.534471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.534549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.534714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.534797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.534951 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.535031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.535194 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.535274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.535447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.535529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.535680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.535759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.535915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.535999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.536171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.536252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.536425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.536505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.536664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.536752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.536907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.536988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.537147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.537227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.537383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.537477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.537775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.538274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.538274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.538410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.538410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.538557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.538557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.538694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.538767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.538840 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.538912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.538993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.539153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.539226 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.539405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.539492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.539659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.539749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.539902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.539983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.540141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.540220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.540377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.540466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.540615 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.540694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.540863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.540943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.541110 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.541197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.541349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.541428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.541595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.541674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.541827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.541939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.542105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.542185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.542344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.542423 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.542582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.542670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.542822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.542903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.543063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.543201 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.543314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.543498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.543571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.543784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.543872 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.544031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.544112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.544279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.544361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.544533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.544614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.544785 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.544865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.545023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.545103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.545265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.545346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.545517 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.545597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.545756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.545838 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.546013 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.546094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.546256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.546336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.546499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.546580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.546743 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] role.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.546823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.546993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.547073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] role.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.547225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.547306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.547476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.547590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.547726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.547806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.547964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.548045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.548214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.548294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.548456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.548536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.548700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.548782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.548938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] role.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.549018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.549185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.549264 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] role.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.549419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.549499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.549664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.549742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.549935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.550032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.550187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.550267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.550435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.550514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.550682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.550869 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.550951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.551109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.551190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.551360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.551440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.551613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.551694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.551864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.551944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.552113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.552192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.552349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.552430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.552604 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.552683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.552856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.553030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.553145 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.553417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.553812 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.553953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.554032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.554106 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.554193 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.554270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.554344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.554417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.554490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.554656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.554746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.554895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.554976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.555133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.555212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.555368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.555458 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.555620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.555702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.555846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.555926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.556095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.556177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.556333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.556414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.556597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.556677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.556846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.556927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.557085 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.557165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.557325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.557405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.557562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.557645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.557802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.557903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.558067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.558147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.558310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.558393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.558548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.558627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.558795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.558873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.559054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.559135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.559297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.559385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.559543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.559625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.559789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.559868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.560043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.560125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.connection = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.560287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.560368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.560532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.560612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.560770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.560850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.561013 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.561093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.561250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.561330 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.561490 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.561571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.561727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.561817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.561991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.562075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.562243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.562336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.connection = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.562485 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.562566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.562732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.562813 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.562970 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.563123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.563200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.563273 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.563438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.563519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.563679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.563768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.563910 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.563990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.564148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.564227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.564384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.564472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.564547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81783) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:15:20.564620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.564860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.565100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.565352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.565593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.565843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.566103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.566348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.566588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:15:20.566761 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:15:20.595112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.595341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.595564 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.595806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.596044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.596273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.604383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.605172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.633202 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.633423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.633806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.634075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.690992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.691790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.741596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.741596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.741936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.742119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.899770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.900071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.900300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.900418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.900530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.900670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.900752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.900827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.900955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.901040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.901173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.901394 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.924493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.924726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.924957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.925097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.925187 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.925331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.925417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.925556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.925643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.925778 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.925924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.926027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.926246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.926463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.937555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.938215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.952279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.952452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.952643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.952860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.953078 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.953290 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.953505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81783) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.954641 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.954884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.955114 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.955337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.955555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.955770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.955984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 16:15:20.972561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.972773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:15:20.973218 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.973364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.973492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:15:20.973624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:15:20.973777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.973937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.974077 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 16:15:20.974215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.974341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.974466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.974591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.974717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.974856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.975944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.984920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.985206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.985482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.985740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.985907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.986038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.986315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.986601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.992987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:20.994044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:20.995927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:20.996219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.996506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.996800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.996947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:20.997081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.997212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.997342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.997473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.997714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.997858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.998012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.998139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.998289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.998416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.998563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.998696 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.998821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.998954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.999116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.999393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:20.999663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.021400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.023506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.023660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.023806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.024981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.025271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.028478 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.028771 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.029060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.029840 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.030153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.030440 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.035731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.036022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.036919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.037212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.041433 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.041827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.042145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.042437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.042576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.042712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.042844 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.043030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.043159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.043309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.043441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.043571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.043696 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.045645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.045965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.046261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.061113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.061398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.061930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.062218 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.065413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.066091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.068572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.069593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.069846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.070169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.074046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.074539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.077325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.077676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.080452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.080771 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.080900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.081063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.081192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.081358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.081486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.081642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.081770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.081934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.082074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.082317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.098248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.098507 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.098715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.098900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.099066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.099246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.099421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.099566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.106990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.107100 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.108554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.108722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.110147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.110298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.110433 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.110580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.113214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.113312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.113512 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.113597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.113810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.113923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.114126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.114223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.114423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.114506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.126425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.126561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.126722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.126808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.127012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.127098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.127299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.127382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.127590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.127672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.127870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.127958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.128163 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.128258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.143762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.144273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.146912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.147373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.149804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.150300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.151282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.151882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.152782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.153073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.153361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.153453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.153657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.153965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.160146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.160642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.161663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.162289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.165124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.165419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.165709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.165851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.166026 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.166148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.166355 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.166647 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.173977 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.174275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.174558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.174686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.174946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.175235 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.182161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81783) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.182450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.182737 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 16:15:21.182839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.183026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.183112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.183301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.183384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.183583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.183680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.183857 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.183942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.184133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.184216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.184412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.184499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.184698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.184783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.184960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.185082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.185223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.185370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.185489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.185649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.185764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81783) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.185942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.186216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.186492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 16:15:21.219857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5600f8e449c0 pid: 81783 (default app) Sep 01 16:15:21.220701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5600f8e449c0 pid: 81784 (default app) Sep 01 16:15:21.223531 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107ed3f-0bef-454a-88ad-5b1f6b596f44 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:21.223817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107ed3f-0bef-454a-88ad-5b1f6b596f44 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:21.224091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107ed3f-0bef-454a-88ad-5b1f6b596f44 None None] PATH_INFO: `/v3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:21.229216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Thu Sep 1 16:15:21 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:28.899590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e008f-5ab9-4476-8d08-e286e80f3aae None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:28.900153 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e008f-5ab9-4476-8d08-e286e80f3aae None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:28.900153 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e008f-5ab9-4476-8d08-e286e80f3aae None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:28.905775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:15:28.912320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e2782-279f-4d11-9d81-6f905a06d3b1 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:28.912861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e2782-279f-4d11-9d81-6f905a06d3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:28.913257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e2782-279f-4d11-9d81-6f905a06d3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:29.033424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: INFO dbcounter [None req-1c0e2782-279f-4d11-9d81-6f905a06d3b1 None None] Registered counter for database keystone Sep 01 16:15:29.062054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG oslo_db.sqlalchemy.engines [None req-1c0e2782-279f-4d11-9d81-6f905a06d3b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81783) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:15:29.068417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writer thread running {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:15:29.255057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG passlib.handlers.bcrypt [None req-1c0e2782-279f-4d11-9d81-6f905a06d3b1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81783) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 16:15:29.255449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG passlib.handlers.bcrypt [None req-1c0e2782-279f-4d11-9d81-6f905a06d3b1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81783) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 16:15:29.315019 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1c0e2782-279f-4d11-9d81-6f905a06d3b1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:29.316651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1c0e2782-279f-4d11-9d81-6f905a06d3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:29.453269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 543 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 16:15:29.925461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e008f-5ab9-4476-8d08-e286e80f3aae None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:30.000526 dv-cinder-836027-9-smb devstack@keystone.service[81784]: INFO dbcounter [None req-a85e008f-5ab9-4476-8d08-e286e80f3aae None None] Registered counter for database keystone Sep 01 16:15:30.023351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG oslo_db.sqlalchemy.engines [None req-a85e008f-5ab9-4476-8d08-e286e80f3aae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:15:30.029664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writer thread running {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:15:30.153145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e008f-5ab9-4476-8d08-e286e80f3aae None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:30.157435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5cc899-6a1b-418e-9634-6a617a2362f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:30.158118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cc899-6a1b-418e-9634-6a617a2362f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:30.158401 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cc899-6a1b-418e-9634-6a617a2362f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:30.158673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5cc899-6a1b-418e-9634-6a617a2362f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:30.169513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cc899-6a1b-418e-9634-6a617a2362f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:30.223525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eb5cc899-6a1b-418e-9634-6a617a2362f9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 16:15:30.223794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5cc899-6a1b-418e-9634-6a617a2362f9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:30.234418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Sep 1 16:15:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:15:30.240806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e2782-279f-4d11-9d81-6f905a06d3b1 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:30.255495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e2782-279f-4d11-9d81-6f905a06d3b1 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:30.260719 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518397ab-59b4-4225-a273-51654aabdd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:30.261832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518397ab-59b4-4225-a273-51654aabdd4f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:30.262147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518397ab-59b4-4225-a273-51654aabdd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:30.262420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518397ab-59b4-4225-a273-51654aabdd4f admin admin] PATH_INFO: `/v3/projects/f1932bfa4cf144bf9a1f6249a0b89aa8` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:30.264006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518397ab-59b4-4225-a273-51654aabdd4f admin admin] RBAC: Authorizing `identity:get_project(project_id=f1932bfa4cf144bf9a1f6249a0b89aa8)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:30.320248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: WARNING keystone.common.rbac_enforcer.enforcer [None req-518397ab-59b4-4225-a273-51654aabdd4f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 16:15:30.320595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518397ab-59b4-4225-a273-51654aabdd4f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:30.325348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Thu Sep 1 16:15:30 2022] GET /identity/v3/projects/f1932bfa4cf144bf9a1f6249a0b89aa8 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:32.241805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeece25-bc34-4911-bfde-44dcbed9f4b0 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:32.242404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeece25-bc34-4911-bfde-44dcbed9f4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:32.242404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeece25-bc34-4911-bfde-44dcbed9f4b0 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:32.246445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:15:32.252148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899bb84-27a9-4a20-8f91-b859d9aadde4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:32.252592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899bb84-27a9-4a20-8f91-b859d9aadde4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:32.252742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899bb84-27a9-4a20-8f91-b859d9aadde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:32.273620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1899bb84-27a9-4a20-8f91-b859d9aadde4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:32.275196 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1899bb84-27a9-4a20-8f91-b859d9aadde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:32.283049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 16:15:32.554657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeece25-bc34-4911-bfde-44dcbed9f4b0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:32.567170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeece25-bc34-4911-bfde-44dcbed9f4b0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:32.572029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39ad25-2a5f-4e0a-bb6f-882004cbe6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:32.572657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39ad25-2a5f-4e0a-bb6f-882004cbe6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:32.572935 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39ad25-2a5f-4e0a-bb6f-882004cbe6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:32.573204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39ad25-2a5f-4e0a-bb6f-882004cbe6cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:32.581920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39ad25-2a5f-4e0a-bb6f-882004cbe6cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:32.583686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39ad25-2a5f-4e0a-bb6f-882004cbe6cd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:32.593436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Sep 1 16:15:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:15:32.599132 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899bb84-27a9-4a20-8f91-b859d9aadde4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:32.609170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899bb84-27a9-4a20-8f91-b859d9aadde4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:32.613539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd58f6-d416-4765-a154-568c37d603e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:32.614205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd58f6-d416-4765-a154-568c37d603e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:32.614485 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd58f6-d416-4765-a154-568c37d603e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:32.614753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd58f6-d416-4765-a154-568c37d603e7 admin admin] PATH_INFO: `/v3/users/9919555c8b9f4d16b646e3f64ace74c5` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:32.616190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd58f6-d416-4765-a154-568c37d603e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=9919555c8b9f4d16b646e3f64ace74c5)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:32.618207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd58f6-d416-4765-a154-568c37d603e7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:32.619786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Thu Sep 1 16:15:32 2022] GET /identity/v3/users/9919555c8b9f4d16b646e3f64ace74c5 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:34.631186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920f66-4328-4488-b607-041172aa2cac None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:34.631869 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920f66-4328-4488-b607-041172aa2cac None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:34.631869 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47920f66-4328-4488-b607-041172aa2cac None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:34.633193 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:34.638541 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea613-6ee4-4639-a718-3733ef4986f5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:34.638953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea613-6ee4-4639-a718-3733ef4986f5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:34.639092 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ea613-6ee4-4639-a718-3733ef4986f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:34.658413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4b5ea613-6ee4-4639-a718-3733ef4986f5 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:34.659596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4b5ea613-6ee4-4639-a718-3733ef4986f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:34.726352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606a83-da31-46ef-a5be-c816f66d65a4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:34.727011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606a83-da31-46ef-a5be-c816f66d65a4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:34.727123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606a83-da31-46ef-a5be-c816f66d65a4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:34.728530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:15:34.734291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34ce3e-5aca-432e-b41b-5aabf96bf5cc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:34.734473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34ce3e-5aca-432e-b41b-5aabf96bf5cc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:34.734729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c34ce3e-5aca-432e-b41b-5aabf96bf5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:34.760580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:15:34.780840 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG passlib.handlers.bcrypt [None req-5c34ce3e-5aca-432e-b41b-5aabf96bf5cc None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81784) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 16:15:34.781227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG passlib.handlers.bcrypt [None req-5c34ce3e-5aca-432e-b41b-5aabf96bf5cc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81784) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 16:15:34.830525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5c34ce3e-5aca-432e-b41b-5aabf96bf5cc None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:34.832145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5c34ce3e-5aca-432e-b41b-5aabf96bf5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:34.937899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:15:35.032612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ea613-6ee4-4639-a718-3733ef4986f5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:35.057823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:35.147636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ea613-6ee4-4639-a718-3733ef4986f5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:35.181797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9ef18-9bdd-46ed-aa1b-64c3bfbf4c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:35.182468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9ef18-9bdd-46ed-aa1b-64c3bfbf4c1f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:35.182747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9ef18-9bdd-46ed-aa1b-64c3bfbf4c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:35.183020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9ef18-9bdd-46ed-aa1b-64c3bfbf4c1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:35.194965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9ef18-9bdd-46ed-aa1b-64c3bfbf4c1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-90f9ef18-9bdd-46ed-aa1b-64c3bfbf4c1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:35.203456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:35.204413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:15:35.205193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:35.211383 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34ce3e-5aca-432e-b41b-5aabf96bf5cc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:35.213661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9ef18-9bdd-46ed-aa1b-64c3bfbf4c1f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:35.308597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:35.328727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9ef18-9bdd-46ed-aa1b-64c3bfbf4c1f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:35.330076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c34ce3e-5aca-432e-b41b-5aabf96bf5cc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:35.333299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:35.368183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34234c5f-bae7-4dcc-b647-932a0b89028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:35.368810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34234c5f-bae7-4dcc-b647-932a0b89028f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:35.369095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34234c5f-bae7-4dcc-b647-932a0b89028f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:35.369370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34234c5f-bae7-4dcc-b647-932a0b89028f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:35.373223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0364fa-031c-49d0-aa41-72c11fa00480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:35.374118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0364fa-031c-49d0-aa41-72c11fa00480 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:35.374398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0364fa-031c-49d0-aa41-72c11fa00480 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:35.374665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0364fa-031c-49d0-aa41-72c11fa00480 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:35.375505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0364fa-031c-49d0-aa41-72c11fa00480 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:35.375808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0364fa-031c-49d0-aa41-72c11fa00480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:35.377246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0364fa-031c-49d0-aa41-72c11fa00480 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:35.393262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:15:35.399658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0364fa-031c-49d0-aa41-72c11fa00480 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:35.448603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34234c5f-bae7-4dcc-b647-932a0b89028f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:35.450146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34234c5f-bae7-4dcc-b647-932a0b89028f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:35.512164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0364fa-031c-49d0-aa41-72c11fa00480 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:35.540815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:35.549255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b723a-2b6a-4d4d-a3ad-0ac30d2eb856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:35.553797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b723a-2b6a-4d4d-a3ad-0ac30d2eb856 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:35.553797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b723a-2b6a-4d4d-a3ad-0ac30d2eb856 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:35.553797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b723a-2b6a-4d4d-a3ad-0ac30d2eb856 None admin] PATH_INFO: `/v3/users/9919555c8b9f4d16b646e3f64ace74c5` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:35.553797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b723a-2b6a-4d4d-a3ad-0ac30d2eb856 None admin] RBAC: Authorizing `identity:get_user(user_id=9919555c8b9f4d16b646e3f64ace74c5)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:35.554938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b723a-2b6a-4d4d-a3ad-0ac30d2eb856 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:35.556610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 9/16] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:35 2022] GET /identity/v3/users/9919555c8b9f4d16b646e3f64ace74c5 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:15:35.560594 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:15:35.566161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b723a-2b6a-4d4d-a3ad-0ac30d2eb856 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:35.566311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34234c5f-bae7-4dcc-b647-932a0b89028f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:35.602866 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:35.674801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34234c5f-bae7-4dcc-b647-932a0b89028f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:35.680677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b723a-2b6a-4d4d-a3ad-0ac30d2eb856 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:35.711925 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cf34d-f869-4dad-84d8-5232add367ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:35.712482 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cf34d-f869-4dad-84d8-5232add367ba None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:35.713802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cf34d-f869-4dad-84d8-5232add367ba None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:35.713802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cf34d-f869-4dad-84d8-5232add367ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:35.720503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4777397-c862-4920-9886-c455569f0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:35.721146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4777397-c862-4920-9886-c455569f0110 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:35.721429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4777397-c862-4920-9886-c455569f0110 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:35.721704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4777397-c862-4920-9886-c455569f0110 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:35.722887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4777397-c862-4920-9886-c455569f0110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:35.723687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cf34d-f869-4dad-84d8-5232add367ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:35.724342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4777397-c862-4920-9886-c455569f0110 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:35.725755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cf34d-f869-4dad-84d8-5232add367ba None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:35.727344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:35.733251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4777397-c862-4920-9886-c455569f0110 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2d2cf34d-f869-4dad-84d8-5232add367ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:15:35.742280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:35.743184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:15:35.744141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:15:35.744141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:15:35.744141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:15:35.744141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:15:35.749219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cf34d-f869-4dad-84d8-5232add367ba None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:35.789441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:35.846398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4777397-c862-4920-9886-c455569f0110 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:35.847987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:35.865691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cf34d-f869-4dad-84d8-5232add367ba None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:35.883967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d38fc-eb51-42f1-891c-b501db8aa105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:35.884592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d38fc-eb51-42f1-891c-b501db8aa105 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:35.884872 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d38fc-eb51-42f1-891c-b501db8aa105 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:35.885149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d38fc-eb51-42f1-891c-b501db8aa105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:35.885911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d38fc-eb51-42f1-891c-b501db8aa105 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.domain.id=default, user.id=9919555c8b9f4d16b646e3f64ace74c5) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:35.886244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d38fc-eb51-42f1-891c-b501db8aa105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:35.887712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d38fc-eb51-42f1-891c-b501db8aa105 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:35.896462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Sep 1 16:15:35 2022] GET /identity/v3/role_assignments?user.id=9919555c8b9f4d16b646e3f64ace74c5&scope.domain.id=default&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:15:35.905649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a8ab9-e4b6-4954-a7da-f36cbc1c9f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:35.906329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a8ab9-e4b6-4954-a7da-f36cbc1c9f63 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:35.906612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a8ab9-e4b6-4954-a7da-f36cbc1c9f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:35.906888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a8ab9-e4b6-4954-a7da-f36cbc1c9f63 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:35.907568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a8ab9-e4b6-4954-a7da-f36cbc1c9f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:35.907860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a8ab9-e4b6-4954-a7da-f36cbc1c9f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:35.909290 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3a8ab9-e4b6-4954-a7da-f36cbc1c9f63 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:35.935965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:15:38.551430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761bc53-e9ae-4d10-8235-5d84c96294f5 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:38.551997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761bc53-e9ae-4d10-8235-5d84c96294f5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:38.551997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761bc53-e9ae-4d10-8235-5d84c96294f5 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:38.553795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:38.555571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a4996-0811-4da6-a63d-b551191a5ae9 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:38.555985 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a4996-0811-4da6-a63d-b551191a5ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:38.556153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a4996-0811-4da6-a63d-b551191a5ae9 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:38.557446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 11/23] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:15:38.562971 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4d2a8-bfa7-4b0b-9a8f-83ad5f3a3d65 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:38.563254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4d2a8-bfa7-4b0b-9a8f-83ad5f3a3d65 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:38.563529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4d2a8-bfa7-4b0b-9a8f-83ad5f3a3d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:38.569195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbc6f8-174a-4e01-826a-0c7d477a94da None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:38.569503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbc6f8-174a-4e01-826a-0c7d477a94da None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:38.569807 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbc6f8-174a-4e01-826a-0c7d477a94da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:38.615230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d2dbc6f8-174a-4e01-826a-0c7d477a94da None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:38.616604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d2dbc6f8-174a-4e01-826a-0c7d477a94da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:38.639055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-abd4d2a8-bfa7-4b0b-9a8f-83ad5f3a3d65 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:38.640290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-abd4d2a8-bfa7-4b0b-9a8f-83ad5f3a3d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:38.765928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 12/24] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 16:15:38.767211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7624-8e5b-4646-9d20-2bfac94c69a5 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:38.767496 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7624-8e5b-4646-9d20-2bfac94c69a5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:38.767771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7624-8e5b-4646-9d20-2bfac94c69a5 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:38.769006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 13/25] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:38.778231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac4f81-3355-4fb8-8eab-16f7257f1edb None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:38.778579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac4f81-3355-4fb8-8eab-16f7257f1edb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:38.778862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac4f81-3355-4fb8-8eab-16f7257f1edb None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:38.780544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 14/26] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:38 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:38.781479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23cf7d-fc83-4be8-b64c-c7fe53292023 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:38.781755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23cf7d-fc83-4be8-b64c-c7fe53292023 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:38.788095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 13/27] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:15:38.788328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23cf7d-fc83-4be8-b64c-c7fe53292023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:38.792847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb372e-d4a5-4a85-ae3e-e23b547c4600 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:38.793131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb372e-d4a5-4a85-ae3e-e23b547c4600 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:38.793402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb372e-d4a5-4a85-ae3e-e23b547c4600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:38.827841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-53fb372e-d4a5-4a85-ae3e-e23b547c4600 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:38.828955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-53fb372e-d4a5-4a85-ae3e-e23b547c4600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:38.832014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6c23cf7d-fc83-4be8-b64c-c7fe53292023 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:38.833182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6c23cf7d-fc83-4be8-b64c-c7fe53292023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:38.869159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:38.924908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 15/28] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:38.997572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 14/29] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:39.136794 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23cf7d-fc83-4be8-b64c-c7fe53292023 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:39.281712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23cf7d-fc83-4be8-b64c-c7fe53292023 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:39.329063 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b93f-1066-46f8-b459-917617cdc40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:39.330530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b93f-1066-46f8-b459-917617cdc40d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:39.331210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b93f-1066-46f8-b459-917617cdc40d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:39.331846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b93f-1066-46f8-b459-917617cdc40d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:39.362824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0b93f-1066-46f8-b459-917617cdc40d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1bf0b93f-1066-46f8-b459-917617cdc40d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:39.369002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:39.369988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:15:39.370873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:15:39.373740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 16/30] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:39.379859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb372e-d4a5-4a85-ae3e-e23b547c4600 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:39.421856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:39.451665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b93f-1066-46f8-b459-917617cdc40d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:39.471340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:39.542504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb372e-d4a5-4a85-ae3e-e23b547c4600 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:39.579799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b93f-1066-46f8-b459-917617cdc40d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:39.580608 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5f300-8050-4378-9f7e-8de4f17e31ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:39.581196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5f300-8050-4378-9f7e-8de4f17e31ab None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:39.581196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5f300-8050-4378-9f7e-8de4f17e31ab None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:39.581450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5f300-8050-4378-9f7e-8de4f17e31ab None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:39.582102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5f300-8050-4378-9f7e-8de4f17e31ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:39.582404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5f300-8050-4378-9f7e-8de4f17e31ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:39.583804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5f300-8050-4378-9f7e-8de4f17e31ab None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:39.593213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 15/31] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:39.594124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5f300-8050-4378-9f7e-8de4f17e31ab None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:39.633393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e0c37-2a8a-4b0d-81c1-fced5abe36b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:39.633962 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0c37-2a8a-4b0d-81c1-fced5abe36b2 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:39.634249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0c37-2a8a-4b0d-81c1-fced5abe36b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:39.634523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0c37-2a8a-4b0d-81c1-fced5abe36b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:39.635212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e0c37-2a8a-4b0d-81c1-fced5abe36b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:39.636612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e0c37-2a8a-4b0d-81c1-fced5abe36b2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:39.691120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:39.704166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5f300-8050-4378-9f7e-8de4f17e31ab None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:39.744780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9f1fd-0ff0-4bdf-875f-da4f0b520c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:39.745439 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9f1fd-0ff0-4bdf-875f-da4f0b520c9f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:39.745718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9f1fd-0ff0-4bdf-875f-da4f0b520c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:39.746014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9f1fd-0ff0-4bdf-875f-da4f0b520c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:39.766881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9f1fd-0ff0-4bdf-875f-da4f0b520c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:39.768452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9f1fd-0ff0-4bdf-875f-da4f0b520c9f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f1d9f1fd-0ff0-4bdf-875f-da4f0b520c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:15:39.792210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:39.793158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:15:39.794032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:15:39.794032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:15:39.794032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:15:39.796183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 16/32] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:39.801898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9f1fd-0ff0-4bdf-875f-da4f0b520c9f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:39.844516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 17/33] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Sep 1 16:15:39 2022] POST /identity/v3/roles => generated 225 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:15:39.845769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3701d07-5ef0-4543-b5c6-d489f72df96b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:39.846098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3701d07-5ef0-4543-b5c6-d489f72df96b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:39.846388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3701d07-5ef0-4543-b5c6-d489f72df96b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:39.854192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 18/34] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:39.854192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3701d07-5ef0-4543-b5c6-d489f72df96b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:39.959711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9f1fd-0ff0-4bdf-875f-da4f0b520c9f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:39.969649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:40.009292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3701d07-5ef0-4543-b5c6-d489f72df96b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:40.013394 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef42ef8-bb8b-4cbc-b87c-bb37050858bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:40.014059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef42ef8-bb8b-4cbc-b87c-bb37050858bf None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:40.014344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef42ef8-bb8b-4cbc-b87c-bb37050858bf None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:40.014618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef42ef8-bb8b-4cbc-b87c-bb37050858bf None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:40.015290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef42ef8-bb8b-4cbc-b87c-bb37050858bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:40.016829 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef42ef8-bb8b-4cbc-b87c-bb37050858bf None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:40.053860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c774d-7be3-481d-bb58-80406d0f3eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:40.054542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c774d-7be3-481d-bb58-80406d0f3eaf None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:40.054823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c774d-7be3-481d-bb58-80406d0f3eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:40.055104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c774d-7be3-481d-bb58-80406d0f3eaf None admin] PATH_INFO: `/v3/users/9919555c8b9f4d16b646e3f64ace74c5` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:40.056368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c774d-7be3-481d-bb58-80406d0f3eaf None admin] RBAC: Authorizing `identity:get_user(user_id=9919555c8b9f4d16b646e3f64ace74c5)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:40.057995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c774d-7be3-481d-bb58-80406d0f3eaf None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:40.059673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 19/35] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:39 2022] GET /identity/v3/users/9919555c8b9f4d16b646e3f64ace74c5 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:40.060446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c774d-7be3-481d-bb58-80406d0f3eaf None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:40.108784 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:40.198414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c774d-7be3-481d-bb58-80406d0f3eaf None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:40.234065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 17/36] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Sep 1 16:15:39 2022] POST /identity/v3/roles => generated 219 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:15:40.234065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ebbe-7db1-4845-8b7c-71531ea164e2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:40.234065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ebbe-7db1-4845-8b7c-71531ea164e2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:40.234065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563ebbe-7db1-4845-8b7c-71531ea164e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:40.252556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778290c-7974-4068-ae86-db4d8f9b03ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:40.253197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778290c-7974-4068-ae86-db4d8f9b03ec None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:40.253480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778290c-7974-4068-ae86-db4d8f9b03ec None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:40.253751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778290c-7974-4068-ae86-db4d8f9b03ec None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:40.254462 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778290c-7974-4068-ae86-db4d8f9b03ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:40.254770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778290c-7974-4068-ae86-db4d8f9b03ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:40.256870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778290c-7974-4068-ae86-db4d8f9b03ec None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:40.264496 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f563ebbe-7db1-4845-8b7c-71531ea164e2 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:40.267308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f563ebbe-7db1-4845-8b7c-71531ea164e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:40.273724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 20/37] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:40.278576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778290c-7974-4068-ae86-db4d8f9b03ec None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:40.281696 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:40.365920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 18/38] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:40.365920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563ebbe-7db1-4845-8b7c-71531ea164e2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:40.436166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778290c-7974-4068-ae86-db4d8f9b03ec None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:40.486855 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39deafbe-00bb-4ff3-a130-5ffe9680c569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:40.487446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deafbe-00bb-4ff3-a130-5ffe9680c569 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:40.487737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deafbe-00bb-4ff3-a130-5ffe9680c569 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:40.488017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deafbe-00bb-4ff3-a130-5ffe9680c569 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:40.489330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39deafbe-00bb-4ff3-a130-5ffe9680c569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:40.491618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39deafbe-00bb-4ff3-a130-5ffe9680c569 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:40.493528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 21/39] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:15:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:40.494549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46950c07-47dd-4732-8fe8-348cec200737 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:40.494925 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46950c07-47dd-4732-8fe8-348cec200737 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:40.495180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46950c07-47dd-4732-8fe8-348cec200737 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:40.496599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 22/40] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:40.500994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46950c07-47dd-4732-8fe8-348cec200737 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:40.503269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563ebbe-7db1-4845-8b7c-71531ea164e2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:40.540145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:40.546636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a22af2-ad86-425d-8c85-aa8b44373a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:40.547266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22af2-ad86-425d-8c85-aa8b44373a45 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:40.547547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22af2-ad86-425d-8c85-aa8b44373a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:40.547914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a22af2-ad86-425d-8c85-aa8b44373a45 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:40.548525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a22af2-ad86-425d-8c85-aa8b44373a45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:40.550158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a22af2-ad86-425d-8c85-aa8b44373a45 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:40.597763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:40.633138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46950c07-47dd-4732-8fe8-348cec200737 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:40.648639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 19/41] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:15:40 2022] POST /identity/v3/projects => generated 301 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:15:40.650020 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71858e-9d8f-4a4b-81cf-081823322408 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:40.650317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71858e-9d8f-4a4b-81cf-081823322408 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:40.650581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71858e-9d8f-4a4b-81cf-081823322408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:40.685603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4e71858e-9d8f-4a4b-81cf-081823322408 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:40.687083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4e71858e-9d8f-4a4b-81cf-081823322408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:40.700079 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a6f1a-26b1-41fb-b0cd-7f64e844da59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:40.700849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a6f1a-26b1-41fb-b0cd-7f64e844da59 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:40.701143 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a6f1a-26b1-41fb-b0cd-7f64e844da59 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:40.701429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a6f1a-26b1-41fb-b0cd-7f64e844da59 None admin] PATH_INFO: `/v3/domains/default/users/9919555c8b9f4d16b646e3f64ace74c5/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:40.703654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a6f1a-26b1-41fb-b0cd-7f64e844da59 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9919555c8b9f4d16b646e3f64ace74c5, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:40.705243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a6f1a-26b1-41fb-b0cd-7f64e844da59 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:40.768801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 23/42] 10.222.0.15 () {58 vars in 1361 bytes} [Thu Sep 1 16:15:40 2022] PUT /identity/v3/domains/default/users/9919555c8b9f4d16b646e3f64ace74c5/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:15:40.769553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a6f1a-26b1-41fb-b0cd-7f64e844da59 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:40.810488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 20/43] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:41.013099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a6f1a-26b1-41fb-b0cd-7f64e844da59 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:41.046651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:41.053455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a012c-6291-4f0f-85a7-aefc85a9c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:41.054594 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a012c-6291-4f0f-85a7-aefc85a9c615 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:41.054892 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a012c-6291-4f0f-85a7-aefc85a9c615 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:41.058148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a012c-6291-4f0f-85a7-aefc85a9c615 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:41.058148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a012c-6291-4f0f-85a7-aefc85a9c615 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:41.058148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a012c-6291-4f0f-85a7-aefc85a9c615 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:41.121952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71858e-9d8f-4a4b-81cf-081823322408 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:41.139000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 24/44] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Sep 1 16:15:40 2022] POST /identity/v3/roles => generated 223 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:15:41.259028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71858e-9d8f-4a4b-81cf-081823322408 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:41.281984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:41.307170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7aaa8a-709f-4a1a-bc44-7515d6815072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:41.307753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aaa8a-709f-4a1a-bc44-7515d6815072 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:41.308042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aaa8a-709f-4a1a-bc44-7515d6815072 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:41.308315 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7aaa8a-709f-4a1a-bc44-7515d6815072 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:41.309464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7aaa8a-709f-4a1a-bc44-7515d6815072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:41.311020 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7aaa8a-709f-4a1a-bc44-7515d6815072 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:41.312850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 21/45] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:15:41.319250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a012c-6291-4f0f-85a7-aefc85a9c615 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:41.434265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a012c-6291-4f0f-85a7-aefc85a9c615 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:41.471697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb24651-b32a-47f2-9b26-7aa6f73d6788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:41.472315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24651-b32a-47f2-9b26-7aa6f73d6788 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:41.472599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24651-b32a-47f2-9b26-7aa6f73d6788 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:41.472870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb24651-b32a-47f2-9b26-7aa6f73d6788 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:41.473773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb24651-b32a-47f2-9b26-7aa6f73d6788 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:41.475800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb24651-b32a-47f2-9b26-7aa6f73d6788 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:41.576743 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 25/46] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:15:41 2022] POST /identity/v3/projects => generated 312 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:15:42.855793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74bc3-d9ce-4cfd-93cf-1373892abab4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:42.856358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74bc3-d9ce-4cfd-93cf-1373892abab4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:42.856358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd74bc3-d9ce-4cfd-93cf-1373892abab4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:42.857683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 22/47] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:42.863016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bae61-d001-41d5-b470-5de598c30cbe None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:42.863486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bae61-d001-41d5-b470-5de598c30cbe None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:42.863586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bae61-d001-41d5-b470-5de598c30cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:42.886360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e02bae61-d001-41d5-b470-5de598c30cbe None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:42.887912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e02bae61-d001-41d5-b470-5de598c30cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:42.929533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:42.963972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 26/48] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:43.236935 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd74bc3-d9ce-4cfd-93cf-1373892abab4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:43.345657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd74bc3-d9ce-4cfd-93cf-1373892abab4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:43.384748 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8d43b-1b09-4a7d-a33a-312d4869bd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:43.385392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8d43b-1b09-4a7d-a33a-312d4869bd92 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:43.385668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8d43b-1b09-4a7d-a33a-312d4869bd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:43.385969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8d43b-1b09-4a7d-a33a-312d4869bd92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:43.398017 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8d43b-1b09-4a7d-a33a-312d4869bd92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-83e8d43b-1b09-4a7d-a33a-312d4869bd92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:43.404484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:43.406400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:15:43.407150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 23/49] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:15:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:43.411722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bae61-d001-41d5-b470-5de598c30cbe None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:43.518817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bae61-d001-41d5-b470-5de598c30cbe None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:43.558540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba7af4-93c0-4a03-a8cc-e40b5745ca36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:43.559151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba7af4-93c0-4a03-a8cc-e40b5745ca36 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:43.559430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba7af4-93c0-4a03-a8cc-e40b5745ca36 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:43.559697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba7af4-93c0-4a03-a8cc-e40b5745ca36 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:43.560358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba7af4-93c0-4a03-a8cc-e40b5745ca36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:43.560657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba7af4-93c0-4a03-a8cc-e40b5745ca36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:43.562067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba7af4-93c0-4a03-a8cc-e40b5745ca36 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:43.571201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3157a-7dc9-4379-8602-2b6a0ced7d67 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:43.571429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3157a-7dc9-4379-8602-2b6a0ced7d67 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:43.571703 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3157a-7dc9-4379-8602-2b6a0ced7d67 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:43.573071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 24/50] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:15:43.575512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 27/51] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:15:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:43.578180 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6c589-b8de-47b1-a039-6a8daae2ea6f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:43.578472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6c589-b8de-47b1-a039-6a8daae2ea6f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:43.578751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6c589-b8de-47b1-a039-6a8daae2ea6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:43.581225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba7af4-93c0-4a03-a8cc-e40b5745ca36 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:43.597321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-15e6c589-b8de-47b1-a039-6a8daae2ea6f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:43.598656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-15e6c589-b8de-47b1-a039-6a8daae2ea6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:43.619478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:43.640485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:43.682221 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 25/52] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:43.696215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba7af4-93c0-4a03-a8cc-e40b5745ca36 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:43.731377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4096c-3d36-4d85-8de2-21837b968cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:43.732017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4096c-3d36-4d85-8de2-21837b968cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:43.732300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4096c-3d36-4d85-8de2-21837b968cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:43.732570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4096c-3d36-4d85-8de2-21837b968cc4 None admin] PATH_INFO: `/v3/users/9919555c8b9f4d16b646e3f64ace74c5` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:43.733717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4096c-3d36-4d85-8de2-21837b968cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=9919555c8b9f4d16b646e3f64ace74c5)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:43.735192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc4096c-3d36-4d85-8de2-21837b968cc4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:43.736774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 28/53] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:43 2022] GET /identity/v3/users/9919555c8b9f4d16b646e3f64ace74c5 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:15:43.743200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6c589-b8de-47b1-a039-6a8daae2ea6f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:43.855719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6c589-b8de-47b1-a039-6a8daae2ea6f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:43.895243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578caf9e-56ed-417c-b8c5-9da1d76ba202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:43.895976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578caf9e-56ed-417c-b8c5-9da1d76ba202 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:43.896261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578caf9e-56ed-417c-b8c5-9da1d76ba202 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:43.896539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578caf9e-56ed-417c-b8c5-9da1d76ba202 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:43.902612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578caf9e-56ed-417c-b8c5-9da1d76ba202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:43.904221 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578caf9e-56ed-417c-b8c5-9da1d76ba202 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:43.905936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 26/54] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:15:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:43.911779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4096c-3d36-4d85-8de2-21837b968cc4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:43.963314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578caf9e-56ed-417c-b8c5-9da1d76ba202 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:44.009428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:44.032723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4096c-3d36-4d85-8de2-21837b968cc4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:44.034517 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:44.074107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b111e1-fa60-4cb4-a6ab-cb35841c1881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:44.074577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578caf9e-56ed-417c-b8c5-9da1d76ba202 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:44.074735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b111e1-fa60-4cb4-a6ab-cb35841c1881 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:44.075081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b111e1-fa60-4cb4-a6ab-cb35841c1881 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:44.075359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b111e1-fa60-4cb4-a6ab-cb35841c1881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:44.076198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b111e1-fa60-4cb4-a6ab-cb35841c1881 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.domain.id=default, user.id=9919555c8b9f4d16b646e3f64ace74c5) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:44.076394 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b111e1-fa60-4cb4-a6ab-cb35841c1881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:44.077845 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b111e1-fa60-4cb4-a6ab-cb35841c1881 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:44.086887 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 29/55] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Sep 1 16:15:43 2022] GET /identity/v3/role_assignments?user.id=9919555c8b9f4d16b646e3f64ace74c5&scope.domain.id=default&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 530 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:44.115701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84b1ed-cf6d-4e37-bb14-c0b6dd7ae816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:44.116267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84b1ed-cf6d-4e37-bb14-c0b6dd7ae816 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:44.116544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84b1ed-cf6d-4e37-bb14-c0b6dd7ae816 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:44.116821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84b1ed-cf6d-4e37-bb14-c0b6dd7ae816 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:44.118092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84b1ed-cf6d-4e37-bb14-c0b6dd7ae816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:44.119586 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84b1ed-cf6d-4e37-bb14-c0b6dd7ae816 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:44.121520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 27/56] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:15:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:15:44.127393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b111e1-fa60-4cb4-a6ab-cb35841c1881 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:44.256699 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b111e1-fa60-4cb4-a6ab-cb35841c1881 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:44.301571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc1a95-81e6-47e1-87f2-695ee4ed80c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:44.302254 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc1a95-81e6-47e1-87f2-695ee4ed80c8 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:44.302536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc1a95-81e6-47e1-87f2-695ee4ed80c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:44.302848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc1a95-81e6-47e1-87f2-695ee4ed80c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:44.303668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc1a95-81e6-47e1-87f2-695ee4ed80c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:44.305205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc1a95-81e6-47e1-87f2-695ee4ed80c8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:44.399738 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 30/57] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Sep 1 16:15:44 2022] POST /identity/v3/projects => generated 298 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:15:46.343986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50586fd-f43a-47fb-8f84-44d895bf04fa None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:46.344503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50586fd-f43a-47fb-8f84-44d895bf04fa None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:46.344589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50586fd-f43a-47fb-8f84-44d895bf04fa None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:46.346052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 28/58] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:46.352578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3318-8c1a-488e-9bcc-019d14ece971 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:46.353027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3318-8c1a-488e-9bcc-019d14ece971 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:46.353112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea3318-8c1a-488e-9bcc-019d14ece971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:46.372294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2aea3318-8c1a-488e-9bcc-019d14ece971 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:46.373514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2aea3318-8c1a-488e-9bcc-019d14ece971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:46.388510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:46.447197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 31/59] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:46.720677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50586fd-f43a-47fb-8f84-44d895bf04fa None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:46.829667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50586fd-f43a-47fb-8f84-44d895bf04fa None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:46.839089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:46.865855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccc1b9-361d-44b7-983e-9aefd83e38ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:46.866528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccc1b9-361d-44b7-983e-9aefd83e38ca None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:46.866814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccc1b9-361d-44b7-983e-9aefd83e38ca None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:46.867089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccc1b9-361d-44b7-983e-9aefd83e38ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:46.868233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccc1b9-361d-44b7-983e-9aefd83e38ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:46.869680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccc1b9-361d-44b7-983e-9aefd83e38ca None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:46.871388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 29/60] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:15:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:46.877135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea3318-8c1a-488e-9bcc-019d14ece971 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:46.986102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea3318-8c1a-488e-9bcc-019d14ece971 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:47.021260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332bc390-3003-49cb-b9d2-7a0d2d743cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:47.021913 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bc390-3003-49cb-b9d2-7a0d2d743cf4 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:47.022197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bc390-3003-49cb-b9d2-7a0d2d743cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:47.022468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332bc390-3003-49cb-b9d2-7a0d2d743cf4 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:47.023117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bc390-3003-49cb-b9d2-7a0d2d743cf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:47.024559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332bc390-3003-49cb-b9d2-7a0d2d743cf4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:47.100457 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 32/61] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:15:46 2022] POST /identity/v3/users => generated 275 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:15:50.128959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0a43-40aa-434a-8994-fbc25f45382b None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:50.129509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0a43-40aa-434a-8994-fbc25f45382b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:50.129509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a0a43-40aa-434a-8994-fbc25f45382b None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:50.130863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 30/62] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:50.136954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be4722-668c-43f1-9a8c-1c7c7b9cea61 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:50.137845 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be4722-668c-43f1-9a8c-1c7c7b9cea61 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:50.138301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be4722-668c-43f1-9a8c-1c7c7b9cea61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:50.150379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:50.166217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-34be4722-668c-43f1-9a8c-1c7c7b9cea61 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:50.167686 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-34be4722-668c-43f1-9a8c-1c7c7b9cea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:50.264022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 33/63] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:50.284976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b475e-866d-4366-9db1-1d11de130367 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:50.285265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b475e-866d-4366-9db1-1d11de130367 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:50.285545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b475e-866d-4366-9db1-1d11de130367 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:50.286930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 31/64] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:50.293263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c6fb-b9f0-415e-8127-e389a49ec09d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:50.293607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c6fb-b9f0-415e-8127-e389a49ec09d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:50.293919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07c6fb-b9f0-415e-8127-e389a49ec09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:50.318408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ea07c6fb-b9f0-415e-8127-e389a49ec09d None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:50.320971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ea07c6fb-b9f0-415e-8127-e389a49ec09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:50.338005 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b141f9-1d26-4beb-9d85-c1e98dfb93e4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:50.338636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b141f9-1d26-4beb-9d85-c1e98dfb93e4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:50.339181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b141f9-1d26-4beb-9d85-c1e98dfb93e4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:50.342206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 32/65] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:50.348112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d56cb-db99-4db9-a001-6bd960f9c496 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:50.348978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d56cb-db99-4db9-a001-6bd960f9c496 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:50.349779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d56cb-db99-4db9-a001-6bd960f9c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:50.406334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 34/66] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:50.533161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-243d56cb-db99-4db9-a001-6bd960f9c496 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:50.534404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-243d56cb-db99-4db9-a001-6bd960f9c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:50.633113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 33/67] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:15:50.646385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07c6fb-b9f0-415e-8127-e389a49ec09d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:50.724844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d56cb-db99-4db9-a001-6bd960f9c496 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:50.726714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:50.810191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07c6fb-b9f0-415e-8127-e389a49ec09d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:50.892227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cccce5-b0d4-4eef-a558-e0a647bb2e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:50.892975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccce5-b0d4-4eef-a558-e0a647bb2e82 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:50.893261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccce5-b0d4-4eef-a558-e0a647bb2e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:50.893540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccce5-b0d4-4eef-a558-e0a647bb2e82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:50.915313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cccce5-b0d4-4eef-a558-e0a647bb2e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-a7cccce5-b0d4-4eef-a558-e0a647bb2e82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:50.920740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:50.921702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:15:50.922555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 35/68] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:15:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:50.931859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cccce5-b0d4-4eef-a558-e0a647bb2e82 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:50.948634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d56cb-db99-4db9-a001-6bd960f9c496 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:50.953040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:50.995945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781fc4c-63e7-4600-8d17-5a44dae80959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:50.996931 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781fc4c-63e7-4600-8d17-5a44dae80959 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:50.997412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781fc4c-63e7-4600-8d17-5a44dae80959 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:50.998037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781fc4c-63e7-4600-8d17-5a44dae80959 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.011199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781fc4c-63e7-4600-8d17-5a44dae80959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d781fc4c-63e7-4600-8d17-5a44dae80959 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:51.016627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:51.017493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:15:51.018623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:15:51.020779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:15:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:51.021917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781fc4c-63e7-4600-8d17-5a44dae80959 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:51.098687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cccce5-b0d4-4eef-a558-e0a647bb2e82 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:51.128592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:51.144291 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69d6e-e5e2-40b3-aea1-73d95ccf7db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:51.145094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69d6e-e5e2-40b3-aea1-73d95ccf7db3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.145370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69d6e-e5e2-40b3-aea1-73d95ccf7db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.145649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69d6e-e5e2-40b3-aea1-73d95ccf7db3 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.146621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69d6e-e5e2-40b3-aea1-73d95ccf7db3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:51.147439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69d6e-e5e2-40b3-aea1-73d95ccf7db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:51.149413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69d6e-e5e2-40b3-aea1-73d95ccf7db3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:51.161165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 36/70] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:15:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:51.162588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69d6e-e5e2-40b3-aea1-73d95ccf7db3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:51.174254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781fc4c-63e7-4600-8d17-5a44dae80959 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:51.213252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690646cd-f275-4643-bbe5-9960b28e4c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:51.213928 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690646cd-f275-4643-bbe5-9960b28e4c08 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.214211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690646cd-f275-4643-bbe5-9960b28e4c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.214481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690646cd-f275-4643-bbe5-9960b28e4c08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.225004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690646cd-f275-4643-bbe5-9960b28e4c08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-690646cd-f275-4643-bbe5-9960b28e4c08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:51.231200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:51.232179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:15:51.232968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:15:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:51.237952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690646cd-f275-4643-bbe5-9960b28e4c08 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:51.269748 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:51.279649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69d6e-e5e2-40b3-aea1-73d95ccf7db3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:51.317887 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebe4db-e114-4d60-9340-bc7534d83ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:51.318531 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebe4db-e114-4d60-9340-bc7534d83ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.318814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebe4db-e114-4d60-9340-bc7534d83ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.319098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebe4db-e114-4d60-9340-bc7534d83ac4 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.319848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebe4db-e114-4d60-9340-bc7534d83ac4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:51.320302 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebe4db-e114-4d60-9340-bc7534d83ac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:51.321706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebe4db-e114-4d60-9340-bc7534d83ac4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:51.331445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 37/72] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:15:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:51.332785 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44107844-375c-4c44-b966-e6f970cc877c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.333072 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44107844-375c-4c44-b966-e6f970cc877c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.333358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44107844-375c-4c44-b966-e6f970cc877c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.334650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 38/73] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:51.339282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f37c3e-c2b6-4466-9527-9771bde20f42 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.339572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f37c3e-c2b6-4466-9527-9771bde20f42 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.339850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f37c3e-c2b6-4466-9527-9771bde20f42 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.341146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 39/74] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:51.345233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f37c3e-c2b6-4466-9527-9771bde20f42 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:51.352620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690646cd-f275-4643-bbe5-9960b28e4c08 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:51.388528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e586-988f-4c5e-b226-b9f54e6452b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:51.389170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e586-988f-4c5e-b226-b9f54e6452b8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.389450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e586-988f-4c5e-b226-b9f54e6452b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.389718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978e586-988f-4c5e-b226-b9f54e6452b8 None admin] PATH_INFO: `/v3/users/9611bb4995f64db69f45fd939815f531` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.400465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:51.405944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978e586-988f-4c5e-b226-b9f54e6452b8 None admin] RBAC: Authorizing `identity:get_user(user_id=9611bb4995f64db69f45fd939815f531)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:51.407423 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978e586-988f-4c5e-b226-b9f54e6452b8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:51.409119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 36/75] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:51 2022] GET /identity/v3/users/9611bb4995f64db69f45fd939815f531 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:51.409913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e586-988f-4c5e-b226-b9f54e6452b8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:51.459580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f37c3e-c2b6-4466-9527-9771bde20f42 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:51.499002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e7ab2-049c-49c0-91e1-491f3ecfe308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:51.499987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e7ab2-049c-49c0-91e1-491f3ecfe308 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.500461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e7ab2-049c-49c0-91e1-491f3ecfe308 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.500911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e7ab2-049c-49c0-91e1-491f3ecfe308 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.501692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:51.502040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e7ab2-049c-49c0-91e1-491f3ecfe308 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:51.502559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e7ab2-049c-49c0-91e1-491f3ecfe308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:51.504996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e7ab2-049c-49c0-91e1-491f3ecfe308 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:51.515020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 40/76] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:15:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:51.516422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950039b-bfdb-4691-ae9f-4249ee3e750f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.516717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950039b-bfdb-4691-ae9f-4249ee3e750f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.516996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950039b-bfdb-4691-ae9f-4249ee3e750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.543672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978e586-988f-4c5e-b226-b9f54e6452b8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:51.543857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7950039b-bfdb-4691-ae9f-4249ee3e750f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:51.543857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7950039b-bfdb-4691-ae9f-4249ee3e750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:51.562688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee2677-0d10-4179-b676-bcbb28979108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:51.563697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee2677-0d10-4179-b676-bcbb28979108 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.564194 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee2677-0d10-4179-b676-bcbb28979108 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.564487 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee2677-0d10-4179-b676-bcbb28979108 None admin] PATH_INFO: `/v3/users/9919555c8b9f4d16b646e3f64ace74c5` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.566113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee2677-0d10-4179-b676-bcbb28979108 None admin] RBAC: Authorizing `identity:get_user(user_id=9919555c8b9f4d16b646e3f64ace74c5)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:51.567568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee2677-0d10-4179-b676-bcbb28979108 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:51.569353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 37/77] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:51 2022] GET /identity/v3/users/9919555c8b9f4d16b646e3f64ace74c5 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:51.570767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201fc77-d07e-4fba-8b05-0bffee4beb9c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.571061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201fc77-d07e-4fba-8b05-0bffee4beb9c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.571344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201fc77-d07e-4fba-8b05-0bffee4beb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.590681 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f201fc77-d07e-4fba-8b05-0bffee4beb9c None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:51.591895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f201fc77-d07e-4fba-8b05-0bffee4beb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:51.616033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 41/78] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:51.617582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950039b-bfdb-4691-ae9f-4249ee3e750f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:51.680162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:51.686284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 38/79] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:51.686284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201fc77-d07e-4fba-8b05-0bffee4beb9c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:51.759174 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950039b-bfdb-4691-ae9f-4249ee3e750f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:51.804961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df8e4a-9d6a-4c75-9883-718e486f3614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:51.805931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df8e4a-9d6a-4c75-9883-718e486f3614 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.806452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df8e4a-9d6a-4c75-9883-718e486f3614 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.807150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df8e4a-9d6a-4c75-9883-718e486f3614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.816560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:51.844397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f201fc77-d07e-4fba-8b05-0bffee4beb9c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:51.892032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34e63f-df5c-4e3a-9d10-fb40d0923e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:51.892686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34e63f-df5c-4e3a-9d10-fb40d0923e47 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:51.892971 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34e63f-df5c-4e3a-9d10-fb40d0923e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:51.893248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34e63f-df5c-4e3a-9d10-fb40d0923e47 None admin] PATH_INFO: `/v3/users/9611bb4995f64db69f45fd939815f531` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:51.894612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34e63f-df5c-4e3a-9d10-fb40d0923e47 None admin] RBAC: Authorizing `identity:get_user(user_id=9611bb4995f64db69f45fd939815f531)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:51.894736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df8e4a-9d6a-4c75-9883-718e486f3614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:51.896204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df8e4a-9d6a-4c75-9883-718e486f3614 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:51.896582 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34e63f-df5c-4e3a-9d10-fb40d0923e47 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:51.899103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 39/80] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:51 2022] GET /identity/v3/users/9611bb4995f64db69f45fd939815f531 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:51.900257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34e63f-df5c-4e3a-9d10-fb40d0923e47 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:51.942936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:52.008239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 42/81] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:15:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:15:52.009094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df8e4a-9d6a-4c75-9883-718e486f3614 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:52.012180 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34e63f-df5c-4e3a-9d10-fb40d0923e47 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:52.052827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c8518-90b0-4c72-b512-3f0a76a4c14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:52.052827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c8518-90b0-4c72-b512-3f0a76a4c14a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:52.052827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c8518-90b0-4c72-b512-3f0a76a4c14a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:52.052827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c8518-90b0-4c72-b512-3f0a76a4c14a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:52.067432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:52.122278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df8e4a-9d6a-4c75-9883-718e486f3614 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:52.123352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c8518-90b0-4c72-b512-3f0a76a4c14a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:52.124885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c8518-90b0-4c72-b512-3f0a76a4c14a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:52.161420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2a0c4-b8c3-47fd-8e0d-0f2ed0729643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:52.162144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2a0c4-b8c3-47fd-8e0d-0f2ed0729643 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:52.162373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2a0c4-b8c3-47fd-8e0d-0f2ed0729643 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:52.162645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2a0c4-b8c3-47fd-8e0d-0f2ed0729643 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:52.171852 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:52.174901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2a0c4-b8c3-47fd-8e0d-0f2ed0729643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f6e2a0c4-b8c3-47fd-8e0d-0f2ed0729643 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:52.180537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:52.181579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 43/82] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:52.182591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2a0c4-b8c3-47fd-8e0d-0f2ed0729643 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:52.241136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 40/83] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:15:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:15:52.242452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c8518-90b0-4c72-b512-3f0a76a4c14a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:52.291564 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2a0c4-b8c3-47fd-8e0d-0f2ed0729643 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:52.300791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:52.331393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614547f8-4e13-4647-81f1-3d44815ca6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:52.331932 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614547f8-4e13-4647-81f1-3d44815ca6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:52.332214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614547f8-4e13-4647-81f1-3d44815ca6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:52.332486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614547f8-4e13-4647-81f1-3d44815ca6d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:52.358447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c8518-90b0-4c72-b512-3f0a76a4c14a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:52.404417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201bfca-d75c-42a2-8756-dcd50fe879c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:52.405226 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bfca-d75c-42a2-8756-dcd50fe879c0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:52.405520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bfca-d75c-42a2-8756-dcd50fe879c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:52.405788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bfca-d75c-42a2-8756-dcd50fe879c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:52.407007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201bfca-d75c-42a2-8756-dcd50fe879c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:52.407821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:52.408462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201bfca-d75c-42a2-8756-dcd50fe879c0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:52.410109 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 41/84] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:15:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:52.410649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614547f8-4e13-4647-81f1-3d44815ca6d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:52.410883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201bfca-d75c-42a2-8756-dcd50fe879c0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:52.412359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614547f8-4e13-4647-81f1-3d44815ca6d1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:52.519986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201bfca-d75c-42a2-8756-dcd50fe879c0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:52.525468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 44/85] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:15:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:15:52.526498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614547f8-4e13-4647-81f1-3d44815ca6d1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:52.541775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:52.562447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287c211-292b-493d-a479-74581f9967f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:52.563090 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c211-292b-493d-a479-74581f9967f0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:52.563368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c211-292b-493d-a479-74581f9967f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:52.563644 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c211-292b-493d-a479-74581f9967f0 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:52.564818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287c211-292b-493d-a479-74581f9967f0 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:52.566276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287c211-292b-493d-a479-74581f9967f0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:52.567944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 42/86] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:15:52 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:52.568717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287c211-292b-493d-a479-74581f9967f0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:52.637957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:52.641399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614547f8-4e13-4647-81f1-3d44815ca6d1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:52.680405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d5357-df05-4a99-bd63-6bd90f7427cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:52.681063 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d5357-df05-4a99-bd63-6bd90f7427cc None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:52.681341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d5357-df05-4a99-bd63-6bd90f7427cc None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:52.681618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d5357-df05-4a99-bd63-6bd90f7427cc None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:52.682320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d5357-df05-4a99-bd63-6bd90f7427cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:52.682623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d5357-df05-4a99-bd63-6bd90f7427cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:52.684020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d5357-df05-4a99-bd63-6bd90f7427cc None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:52.690669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287c211-292b-493d-a479-74581f9967f0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:52.692775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 45/87] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:52.693601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d5357-df05-4a99-bd63-6bd90f7427cc None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:52.728746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1f796-e82f-4c9f-9bb6-ed0051c7be53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:52.729387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1f796-e82f-4c9f-9bb6-ed0051c7be53 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:52.729673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1f796-e82f-4c9f-9bb6-ed0051c7be53 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:52.729991 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1f796-e82f-4c9f-9bb6-ed0051c7be53 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:52.731169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1f796-e82f-4c9f-9bb6-ed0051c7be53 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:52.732605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1f796-e82f-4c9f-9bb6-ed0051c7be53 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:52.734289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 43/88] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:15:52 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:52.735067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1f796-e82f-4c9f-9bb6-ed0051c7be53 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:52.790116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:52.803703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d5357-df05-4a99-bd63-6bd90f7427cc None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:52.839533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1f796-e82f-4c9f-9bb6-ed0051c7be53 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:52.843955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab5a0f-4cdf-4f62-b2f9-13941205b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:52.844580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5a0f-4cdf-4f62-b2f9-13941205b6b5 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:52.844867 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5a0f-4cdf-4f62-b2f9-13941205b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:52.845146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab5a0f-4cdf-4f62-b2f9-13941205b6b5 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:52.845806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab5a0f-4cdf-4f62-b2f9-13941205b6b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:52.847318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab5a0f-4cdf-4f62-b2f9-13941205b6b5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:52.881482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a3756-ee5b-49d5-be5c-5c3d130cebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:52.882768 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a3756-ee5b-49d5-be5c-5c3d130cebd0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:52.883053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a3756-ee5b-49d5-be5c-5c3d130cebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:52.883333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a3756-ee5b-49d5-be5c-5c3d130cebd0 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:52.884496 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a3756-ee5b-49d5-be5c-5c3d130cebd0 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:52.885971 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a3756-ee5b-49d5-be5c-5c3d130cebd0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:52.887643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 44/89] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:15:52 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:52.888509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a3756-ee5b-49d5-be5c-5c3d130cebd0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:52.994007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a3756-ee5b-49d5-be5c-5c3d130cebd0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:53.016611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:53.032648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cead33a-a86d-4b57-84c4-4b31a9604b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:53.033263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cead33a-a86d-4b57-84c4-4b31a9604b03 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:53.033548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cead33a-a86d-4b57-84c4-4b31a9604b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:53.033825 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cead33a-a86d-4b57-84c4-4b31a9604b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:53.034578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cead33a-a86d-4b57-84c4-4b31a9604b03 None admin] RBAC: Adding query filter params (role.id=eb63c7589f0c472b9e1abd79cbdd7528, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user.id=9611bb4995f64db69f45fd939815f531) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:53.041350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cead33a-a86d-4b57-84c4-4b31a9604b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:53.041350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cead33a-a86d-4b57-84c4-4b31a9604b03 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:53.042325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 45/90] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:15:52 2022] GET /identity/v3/role_assignments?user.id=9611bb4995f64db69f45fd939815f531&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:53.043146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cead33a-a86d-4b57-84c4-4b31a9604b03 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:53.073663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 46/91] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:15:52 2022] POST /identity/v3/users => generated 289 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:15:53.087533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab5a0f-4cdf-4f62-b2f9-13941205b6b5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:53.122988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:53.193174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cead33a-a86d-4b57-84c4-4b31a9604b03 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:53.249969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51285832-5728-44b9-aebc-0cbca7e46e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:53.250738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51285832-5728-44b9-aebc-0cbca7e46e24 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:53.250959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51285832-5728-44b9-aebc-0cbca7e46e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:53.251239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51285832-5728-44b9-aebc-0cbca7e46e24 None admin] PATH_INFO: `/v3/users/9611bb4995f64db69f45fd939815f531` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:53.252493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51285832-5728-44b9-aebc-0cbca7e46e24 None admin] RBAC: Authorizing `identity:get_user(user_id=9611bb4995f64db69f45fd939815f531)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:53.254252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51285832-5728-44b9-aebc-0cbca7e46e24 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:53.257053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 46/92] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:53 2022] GET /identity/v3/users/9611bb4995f64db69f45fd939815f531 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:53.257776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51285832-5728-44b9-aebc-0cbca7e46e24 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:53.258722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab5a0f-4cdf-4f62-b2f9-13941205b6b5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:53.306156 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9feae-fd8b-4521-8828-ad88b275eb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:53.306790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9feae-fd8b-4521-8828-ad88b275eb6e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:53.307502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9feae-fd8b-4521-8828-ad88b275eb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:53.307502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9feae-fd8b-4521-8828-ad88b275eb6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:53.308432 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9feae-fd8b-4521-8828-ad88b275eb6e None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user.id=9919555c8b9f4d16b646e3f64ace74c5) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:53.308541 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9feae-fd8b-4521-8828-ad88b275eb6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:53.310177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9feae-fd8b-4521-8828-ad88b275eb6e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:53.316805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 47/93] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:15:53 2022] GET /identity/v3/role_assignments?user.id=9919555c8b9f4d16b646e3f64ace74c5&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:53.317747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9feae-fd8b-4521-8828-ad88b275eb6e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:53.338467 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:53.434208 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51285832-5728-44b9-aebc-0cbca7e46e24 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:53.441313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:53.469054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9feae-fd8b-4521-8828-ad88b275eb6e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:53.485653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c3efe-8121-4229-930e-24bb02b6bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:53.490607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3efe-8121-4229-930e-24bb02b6bc58 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:53.490607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3efe-8121-4229-930e-24bb02b6bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:53.490607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3efe-8121-4229-930e-24bb02b6bc58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:53.490607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3efe-8121-4229-930e-24bb02b6bc58 None admin] RBAC: Adding query filter params (role.id=57a8970530a24c16b8d86a333768e765, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user.id=9611bb4995f64db69f45fd939815f531) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:53.490607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3efe-8121-4229-930e-24bb02b6bc58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:53.490607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3efe-8121-4229-930e-24bb02b6bc58 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:53.500674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 47/94] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:15:53 2022] GET /identity/v3/role_assignments?user.id=9611bb4995f64db69f45fd939815f531&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=57a8970530a24c16b8d86a333768e765 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:53.530737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94cd03-3222-4537-bc20-3ebe66d1f663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:53.531894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94cd03-3222-4537-bc20-3ebe66d1f663 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:53.532396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94cd03-3222-4537-bc20-3ebe66d1f663 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:53.532942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94cd03-3222-4537-bc20-3ebe66d1f663 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:53.639343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94cd03-3222-4537-bc20-3ebe66d1f663 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:53.640853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94cd03-3222-4537-bc20-3ebe66d1f663 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:53.746878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:53.769819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 48/95] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:15:53.776916 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c3efe-8121-4229-930e-24bb02b6bc58 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:53.907050 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c3efe-8121-4229-930e-24bb02b6bc58 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:53.933864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:53.956559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddaf53-3313-40d4-90a2-20aef8690944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:53.957608 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddaf53-3313-40d4-90a2-20aef8690944 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:53.957906 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddaf53-3313-40d4-90a2-20aef8690944 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:53.958200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddaf53-3313-40d4-90a2-20aef8690944 None admin] PATH_INFO: `/v3/projects/273d251bbda14947bd6f2b4c1b04e959` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:53.959492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddaf53-3313-40d4-90a2-20aef8690944 None admin] RBAC: Authorizing `identity:get_project(project_id=273d251bbda14947bd6f2b4c1b04e959)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:53.961735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddaf53-3313-40d4-90a2-20aef8690944 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:53.964486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 48/96] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:15:53 2022] GET /identity/v3/projects/273d251bbda14947bd6f2b4c1b04e959 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:53.971012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94cd03-3222-4537-bc20-3ebe66d1f663 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:54.118231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94cd03-3222-4537-bc20-3ebe66d1f663 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:54.160585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0f3ad-68c4-4000-9f72-a863bd3136c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:54.161547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f3ad-68c4-4000-9f72-a863bd3136c1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:54.162079 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f3ad-68c4-4000-9f72-a863bd3136c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:54.162554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f3ad-68c4-4000-9f72-a863bd3136c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:54.163565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0f3ad-68c4-4000-9f72-a863bd3136c1 None admin] RBAC: Adding query filter params (role.id=eb63c7589f0c472b9e1abd79cbdd7528, scope.project.id=273d251bbda14947bd6f2b4c1b04e959, user.id=9611bb4995f64db69f45fd939815f531) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:54.164132 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0f3ad-68c4-4000-9f72-a863bd3136c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:54.165861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0f3ad-68c4-4000-9f72-a863bd3136c1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:54.178901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 49/97] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:15:53 2022] GET /identity/v3/role_assignments?user.id=9611bb4995f64db69f45fd939815f531&scope.project.id=273d251bbda14947bd6f2b4c1b04e959&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:55.617803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31c7f7-b7ba-4e60-91ec-bffc5c8d8d7d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:55.618380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31c7f7-b7ba-4e60-91ec-bffc5c8d8d7d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:55.618380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31c7f7-b7ba-4e60-91ec-bffc5c8d8d7d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:55.619867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 49/98] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:55.625568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad2a0d-fe1d-46a2-85eb-03b6eb12465f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:55.626588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad2a0d-fe1d-46a2-85eb-03b6eb12465f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:55.627069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad2a0d-fe1d-46a2-85eb-03b6eb12465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:55.654912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a3ad2a0d-fe1d-46a2-85eb-03b6eb12465f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:55.656484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a3ad2a0d-fe1d-46a2-85eb-03b6eb12465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:55.722397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:55.752246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 50/99] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:55.897887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd367-70bd-41fe-bf3e-19b6784380c2 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:55.898179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd367-70bd-41fe-bf3e-19b6784380c2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:55.898532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fd367-70bd-41fe-bf3e-19b6784380c2 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:55.900221 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 50/100] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:55.905580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e7b4-d2cf-4563-9cb1-57f04311b046 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:55.905870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e7b4-d2cf-4563-9cb1-57f04311b046 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:55.906169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0e7b4-d2cf-4563-9cb1-57f04311b046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:55.931061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2ea0e7b4-d2cf-4563-9cb1-57f04311b046 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:55.932288 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2ea0e7b4-d2cf-4563-9cb1-57f04311b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:56.022260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 51/101] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:56.283086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fd367-70bd-41fe-bf3e-19b6784380c2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:56.482556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2584af6-289d-49f8-8b3d-894a43d4729b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:56.482926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2584af6-289d-49f8-8b3d-894a43d4729b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:56.483124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2584af6-289d-49f8-8b3d-894a43d4729b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:56.484646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 52/102] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:15:56.499602 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f25f8-1548-459b-9ecc-4c3307d4a245 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:56.499972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f25f8-1548-459b-9ecc-4c3307d4a245 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:56.500191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f25f8-1548-459b-9ecc-4c3307d4a245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:56.518423 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fd367-70bd-41fe-bf3e-19b6784380c2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:56.523289 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f55f25f8-1548-459b-9ecc-4c3307d4a245 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:56.524523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f55f25f8-1548-459b-9ecc-4c3307d4a245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:56.565981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91584ac6-9ccd-4ad5-b97d-0f080224caf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:56.566559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91584ac6-9ccd-4ad5-b97d-0f080224caf3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:56.566843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91584ac6-9ccd-4ad5-b97d-0f080224caf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:56.567117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91584ac6-9ccd-4ad5-b97d-0f080224caf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:56.589002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91584ac6-9ccd-4ad5-b97d-0f080224caf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-91584ac6-9ccd-4ad5-b97d-0f080224caf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:56.596024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:56.596939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:15:56.597705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 51/103] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:15:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:56.601913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91584ac6-9ccd-4ad5-b97d-0f080224caf3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:56.658465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 53/104] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:15:56.660290 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f25f8-1548-459b-9ecc-4c3307d4a245 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:56.713462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:56.735995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:56.828845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91584ac6-9ccd-4ad5-b97d-0f080224caf3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:56.876205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f25f8-1548-459b-9ecc-4c3307d4a245 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:56.897072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6b8c3-22b9-4fa0-986b-eccc306d5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:56.899498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6b8c3-22b9-4fa0-986b-eccc306d5e55 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:56.900430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6b8c3-22b9-4fa0-986b-eccc306d5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:56.900719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6b8c3-22b9-4fa0-986b-eccc306d5e55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:56.907204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6b8c3-22b9-4fa0-986b-eccc306d5e55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:56.909618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6b8c3-22b9-4fa0-986b-eccc306d5e55 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:56.911369 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 52/105] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:15:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:56.915839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0891d-f45d-4099-aaad-e3325c1bdb5e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:56.915839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0891d-f45d-4099-aaad-e3325c1bdb5e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:56.915839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0891d-f45d-4099-aaad-e3325c1bdb5e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:56.915839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 53/106] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:56.919917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0891d-f45d-4099-aaad-e3325c1bdb5e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:56.951903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c9cb3-2b0e-465f-888b-372f83e12259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:56.952579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c9cb3-2b0e-465f-888b-372f83e12259 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:56.952863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c9cb3-2b0e-465f-888b-372f83e12259 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:56.953187 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c9cb3-2b0e-465f-888b-372f83e12259 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:56.953946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c9cb3-2b0e-465f-888b-372f83e12259 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:56.954259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c9cb3-2b0e-465f-888b-372f83e12259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:56.955854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c9cb3-2b0e-465f-888b-372f83e12259 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:56.975016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 54/107] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:15:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:56.978318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d80d54-1518-4f7a-abff-3ec6e8bbc6c7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:56.978606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d80d54-1518-4f7a-abff-3ec6e8bbc6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:56.978876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d80d54-1518-4f7a-abff-3ec6e8bbc6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.001576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-05d80d54-1518-4f7a-abff-3ec6e8bbc6c7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:57.003166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-05d80d54-1518-4f7a-abff-3ec6e8bbc6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:57.075469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0891d-f45d-4099-aaad-e3325c1bdb5e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:57.091516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:57.102125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 55/108] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:57.102125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d80d54-1518-4f7a-abff-3ec6e8bbc6c7 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:57.127819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fa644-356b-4624-82d2-b9f9e26d01f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:57.128787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fa644-356b-4624-82d2-b9f9e26d01f8 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:57.129633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fa644-356b-4624-82d2-b9f9e26d01f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:57.130121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fa644-356b-4624-82d2-b9f9e26d01f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.131798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fa644-356b-4624-82d2-b9f9e26d01f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:57.134464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fa644-356b-4624-82d2-b9f9e26d01f8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:57.162258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:57.240854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 54/109] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:15:56 2022] POST /identity/v3/projects => generated 302 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:15:57.243321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154a1df-cdeb-4e78-861f-643aa6632559 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:57.243890 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154a1df-cdeb-4e78-861f-643aa6632559 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:57.244437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154a1df-cdeb-4e78-861f-643aa6632559 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.250011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d80d54-1518-4f7a-abff-3ec6e8bbc6c7 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:57.250384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 55/110] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:57.251743 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154a1df-cdeb-4e78-861f-643aa6632559 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:57.304479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47409b-9543-4bf9-a800-cfde2b042b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:57.305252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47409b-9543-4bf9-a800-cfde2b042b0e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:57.305537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47409b-9543-4bf9-a800-cfde2b042b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:57.305846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47409b-9543-4bf9-a800-cfde2b042b0e None admin] PATH_INFO: `/v3/users/9611bb4995f64db69f45fd939815f531` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.307287 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47409b-9543-4bf9-a800-cfde2b042b0e None admin] RBAC: Authorizing `identity:get_user(user_id=9611bb4995f64db69f45fd939815f531)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:57.309049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47409b-9543-4bf9-a800-cfde2b042b0e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:57.310975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 56/111] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:57 2022] GET /identity/v3/users/9611bb4995f64db69f45fd939815f531 => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:57.317601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458de0e5-f332-4c4e-9ffb-6f493baf7898 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:57.318172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458de0e5-f332-4c4e-9ffb-6f493baf7898 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:57.318172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458de0e5-f332-4c4e-9ffb-6f493baf7898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.339033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-458de0e5-f332-4c4e-9ffb-6f493baf7898 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:57.340375 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-458de0e5-f332-4c4e-9ffb-6f493baf7898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:57.402171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154a1df-cdeb-4e78-861f-643aa6632559 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:57.434233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 57/112] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:57.435651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5bd1d-f25b-4531-8e84-5dc31e88b558 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:57.435917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5bd1d-f25b-4531-8e84-5dc31e88b558 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:57.436191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5bd1d-f25b-4531-8e84-5dc31e88b558 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.437723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 58/113] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:57.438470 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5bd1d-f25b-4531-8e84-5dc31e88b558 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:57.457260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0d19-2f9d-4a22-a17e-7a135eebaa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:57.457980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0d19-2f9d-4a22-a17e-7a135eebaa5d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:57.458317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0d19-2f9d-4a22-a17e-7a135eebaa5d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:57.458598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef0d19-2f9d-4a22-a17e-7a135eebaa5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.471941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:57.472761 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef0d19-2f9d-4a22-a17e-7a135eebaa5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-a4ef0d19-2f9d-4a22-a17e-7a135eebaa5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:57.479470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:57.480529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 56/114] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:15:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:57.481426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0d19-2f9d-4a22-a17e-7a135eebaa5d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:57.519658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:57.579008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5bd1d-f25b-4531-8e84-5dc31e88b558 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:57.596950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef0d19-2f9d-4a22-a17e-7a135eebaa5d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:57.626318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9d4d3-7b36-4243-a938-01af6c4c02e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:57.627646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9d4d3-7b36-4243-a938-01af6c4c02e4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:57.628197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9d4d3-7b36-4243-a938-01af6c4c02e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:57.628740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9d4d3-7b36-4243-a938-01af6c4c02e4 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.630337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9d4d3-7b36-4243-a938-01af6c4c02e4 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:57.632921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9d4d3-7b36-4243-a938-01af6c4c02e4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:57.634936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 59/115] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:15:57 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:57.636381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a97ce1-5268-4680-bfcb-50de6b26ea4b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:57.636795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a97ce1-5268-4680-bfcb-50de6b26ea4b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:57.637240 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a97ce1-5268-4680-bfcb-50de6b26ea4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.641293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954a683-e27c-45de-a294-0648a392388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:57.642103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954a683-e27c-45de-a294-0648a392388a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:57.642486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954a683-e27c-45de-a294-0648a392388a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:57.642860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954a683-e27c-45de-a294-0648a392388a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.655509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954a683-e27c-45de-a294-0648a392388a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:57.660464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-32a97ce1-5268-4680-bfcb-50de6b26ea4b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-c954a683-e27c-45de-a294-0648a392388a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:57.660960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:57.661981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:15:57.663033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:15:57.665156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 57/116] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:15:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:57.670031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954a683-e27c-45de-a294-0648a392388a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:57.670620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-32a97ce1-5268-4680-bfcb-50de6b26ea4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:57.774851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 60/117] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:15:57.775440 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a97ce1-5268-4680-bfcb-50de6b26ea4b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:57.793640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:57.811737 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954a683-e27c-45de-a294-0648a392388a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:57.815236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:57.852704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71d54-dc85-4073-a7e5-685418c5b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:57.853509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71d54-dc85-4073-a7e5-685418c5b856 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:57.853972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71d54-dc85-4073-a7e5-685418c5b856 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:57.854395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be71d54-dc85-4073-a7e5-685418c5b856 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.855082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be71d54-dc85-4073-a7e5-685418c5b856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:57.855387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be71d54-dc85-4073-a7e5-685418c5b856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:57.856785 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be71d54-dc85-4073-a7e5-685418c5b856 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:57.866399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 58/118] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:15:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:57.867625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71d54-dc85-4073-a7e5-685418c5b856 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:57.930528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a97ce1-5268-4680-bfcb-50de6b26ea4b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:57.977092 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58aa2-4b2e-41b7-83d1-c90f06934f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:57.978165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58aa2-4b2e-41b7-83d1-c90f06934f5c None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:57.978637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58aa2-4b2e-41b7-83d1-c90f06934f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:57.978915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58aa2-4b2e-41b7-83d1-c90f06934f5c None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/users/9611bb4995f64db69f45fd939815f531/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:57.981484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c58aa2-4b2e-41b7-83d1-c90f06934f5c None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user_id=9611bb4995f64db69f45fd939815f531, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:57.983663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c58aa2-4b2e-41b7-83d1-c90f06934f5c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:58.009042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be71d54-dc85-4073-a7e5-685418c5b856 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:58.048132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca049acc-845b-4c8a-a0f4-1b43c2c42705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:58.048788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca049acc-845b-4c8a-a0f4-1b43c2c42705 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:58.049129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca049acc-845b-4c8a-a0f4-1b43c2c42705 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:58.049412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca049acc-845b-4c8a-a0f4-1b43c2c42705 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:58.050176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca049acc-845b-4c8a-a0f4-1b43c2c42705 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:58.050550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca049acc-845b-4c8a-a0f4-1b43c2c42705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:58.050750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 61/119] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:15:57 2022] PUT /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/users/9611bb4995f64db69f45fd939815f531/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:15:58.051804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58aa2-4b2e-41b7-83d1-c90f06934f5c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:58.056305 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca049acc-845b-4c8a-a0f4-1b43c2c42705 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:58.082228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 59/120] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:15:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:58.083816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca049acc-845b-4c8a-a0f4-1b43c2c42705 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:58.105199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:58.191352 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:58.205525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58aa2-4b2e-41b7-83d1-c90f06934f5c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:58.235755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca049acc-845b-4c8a-a0f4-1b43c2c42705 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:58.250684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3baeec-5504-4608-94aa-68a91b6af61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:58.251940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3baeec-5504-4608-94aa-68a91b6af61a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:58.252157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3baeec-5504-4608-94aa-68a91b6af61a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:58.252641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3baeec-5504-4608-94aa-68a91b6af61a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:58.267726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3baeec-5504-4608-94aa-68a91b6af61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9f3baeec-5504-4608-94aa-68a91b6af61a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:58.273154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:58.274225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:15:58.275006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 62/121] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:15:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:58.276560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3baeec-5504-4608-94aa-68a91b6af61a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:58.291263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b6c74-ea5a-404c-9cac-ef5715e5b84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:58.291922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b6c74-ea5a-404c-9cac-ef5715e5b84e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:58.292204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b6c74-ea5a-404c-9cac-ef5715e5b84e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:58.292480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b6c74-ea5a-404c-9cac-ef5715e5b84e None admin] PATH_INFO: `/v3/users/9919555c8b9f4d16b646e3f64ace74c5` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:58.293710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b6c74-ea5a-404c-9cac-ef5715e5b84e None admin] RBAC: Authorizing `identity:get_user(user_id=9919555c8b9f4d16b646e3f64ace74c5)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:58.301424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b6c74-ea5a-404c-9cac-ef5715e5b84e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:58.301424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 60/122] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:58 2022] GET /identity/v3/users/9919555c8b9f4d16b646e3f64ace74c5 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:58.301424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b6c74-ea5a-404c-9cac-ef5715e5b84e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:58.396290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:58.429852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b6c74-ea5a-404c-9cac-ef5715e5b84e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:58.434598 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3baeec-5504-4608-94aa-68a91b6af61a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:58.478590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af467b17-45f2-41a2-a373-f7a75e8e9b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:58.479950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467b17-45f2-41a2-a373-f7a75e8e9b5c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:58.480241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467b17-45f2-41a2-a373-f7a75e8e9b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:58.480520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af467b17-45f2-41a2-a373-f7a75e8e9b5c None admin] PATH_INFO: `/v3/users/b62fac2ca2014826b13dfafe6b2b0570` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:58.485643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759e3fb-f712-4648-a05b-c388af73aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:58.486634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e3fb-f712-4648-a05b-c388af73aa21 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:58.487146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e3fb-f712-4648-a05b-c388af73aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:58.487615 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759e3fb-f712-4648-a05b-c388af73aa21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:58.497449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af467b17-45f2-41a2-a373-f7a75e8e9b5c None admin] RBAC: Authorizing `identity:get_user(user_id=b62fac2ca2014826b13dfafe6b2b0570)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:58.499132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af467b17-45f2-41a2-a373-f7a75e8e9b5c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:58.501211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 61/123] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:58 2022] GET /identity/v3/users/b62fac2ca2014826b13dfafe6b2b0570 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:58.502261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af467b17-45f2-41a2-a373-f7a75e8e9b5c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:58.503096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f759e3fb-f712-4648-a05b-c388af73aa21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f759e3fb-f712-4648-a05b-c388af73aa21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:15:58.510446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:15:58.511366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:15:58.512139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:15:58.515521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 63/124] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:15:58.517146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759e3fb-f712-4648-a05b-c388af73aa21 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:58.524022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:58.633264 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af467b17-45f2-41a2-a373-f7a75e8e9b5c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:58.671695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997d62e-fc55-4140-9c7c-35618cf120eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:58.672279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997d62e-fc55-4140-9c7c-35618cf120eb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:58.672557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997d62e-fc55-4140-9c7c-35618cf120eb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:58.672825 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997d62e-fc55-4140-9c7c-35618cf120eb None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:58.673488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997d62e-fc55-4140-9c7c-35618cf120eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:58.673861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997d62e-fc55-4140-9c7c-35618cf120eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:58.675296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997d62e-fc55-4140-9c7c-35618cf120eb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:58.676977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:58.686664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 62/125] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:15:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:58.687318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997d62e-fc55-4140-9c7c-35618cf120eb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:58.689901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759e3fb-f712-4648-a05b-c388af73aa21 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:58.736349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb76eb9-acbf-477d-880a-3fb9f1ba4f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:58.737003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb76eb9-acbf-477d-880a-3fb9f1ba4f74 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:58.737359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb76eb9-acbf-477d-880a-3fb9f1ba4f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:58.737906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb76eb9-acbf-477d-880a-3fb9f1ba4f74 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:58.739052 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb76eb9-acbf-477d-880a-3fb9f1ba4f74 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:58.740744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb76eb9-acbf-477d-880a-3fb9f1ba4f74 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:58.742703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 64/126] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:15:58 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:58.743588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb76eb9-acbf-477d-880a-3fb9f1ba4f74 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:58.823161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997d62e-fc55-4140-9c7c-35618cf120eb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:58.858064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb76eb9-acbf-477d-880a-3fb9f1ba4f74 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:58.862376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:58.874936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04997ebd-ddc3-48bb-bff6-f7ff15069f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:58.885578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04997ebd-ddc3-48bb-bff6-f7ff15069f48 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:58.885578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04997ebd-ddc3-48bb-bff6-f7ff15069f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:58.885578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04997ebd-ddc3-48bb-bff6-f7ff15069f48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:58.907496 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86115f7-c9ab-4aa5-9ba8-3795749e25bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:58.909020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86115f7-c9ab-4aa5-9ba8-3795749e25bd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:58.909555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86115f7-c9ab-4aa5-9ba8-3795749e25bd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:58.910032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86115f7-c9ab-4aa5-9ba8-3795749e25bd None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:58.911109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86115f7-c9ab-4aa5-9ba8-3795749e25bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:58.911975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86115f7-c9ab-4aa5-9ba8-3795749e25bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:58.915322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86115f7-c9ab-4aa5-9ba8-3795749e25bd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:58.928557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 65/127] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:58.929939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86115f7-c9ab-4aa5-9ba8-3795749e25bd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:58.958402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:58.966069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04997ebd-ddc3-48bb-bff6-f7ff15069f48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:58.967725 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04997ebd-ddc3-48bb-bff6-f7ff15069f48 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:59.047388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86115f7-c9ab-4aa5-9ba8-3795749e25bd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:59.089457 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d426e8-6005-4df7-9e40-a81f0bbdf3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:59.090398 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d426e8-6005-4df7-9e40-a81f0bbdf3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:59.090828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d426e8-6005-4df7-9e40-a81f0bbdf3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:59.091244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d426e8-6005-4df7-9e40-a81f0bbdf3d0 None admin] PATH_INFO: `/v3/users/9611bb4995f64db69f45fd939815f531` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:59.091375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 63/128] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:15:59.092247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04997ebd-ddc3-48bb-bff6-f7ff15069f48 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:59.092924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d426e8-6005-4df7-9e40-a81f0bbdf3d0 None admin] RBAC: Authorizing `identity:get_user(user_id=9611bb4995f64db69f45fd939815f531)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:59.094605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d426e8-6005-4df7-9e40-a81f0bbdf3d0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:59.096912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 66/129] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:58 2022] GET /identity/v3/users/9611bb4995f64db69f45fd939815f531 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:59.097979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d426e8-6005-4df7-9e40-a81f0bbdf3d0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:59.118274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:59.210526 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:59.216728 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04997ebd-ddc3-48bb-bff6-f7ff15069f48 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:59.217557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d426e8-6005-4df7-9e40-a81f0bbdf3d0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:59.254507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e99da-44ae-4c96-845d-f9893542a65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:59.255349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e99da-44ae-4c96-845d-f9893542a65a None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:59.255778 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e99da-44ae-4c96-845d-f9893542a65a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:59.256141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e99da-44ae-4c96-845d-f9893542a65a None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/users/9919555c8b9f4d16b646e3f64ace74c5/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:59.257903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eba056-cefe-4b5b-b466-09c2d2de52b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:59.259088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eba056-cefe-4b5b-b466-09c2d2de52b8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:59.259393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e99da-44ae-4c96-845d-f9893542a65a None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user_id=9919555c8b9f4d16b646e3f64ace74c5, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:59.260032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eba056-cefe-4b5b-b466-09c2d2de52b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:59.260683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eba056-cefe-4b5b-b466-09c2d2de52b8 None admin] PATH_INFO: `/v3/users/9611bb4995f64db69f45fd939815f531` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:59.261144 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e99da-44ae-4c96-845d-f9893542a65a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:59.262928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eba056-cefe-4b5b-b466-09c2d2de52b8 None admin] RBAC: Authorizing `identity:get_user(user_id=9611bb4995f64db69f45fd939815f531)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:59.265948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eba056-cefe-4b5b-b466-09c2d2de52b8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:59.269227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 67/130] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:15:59 2022] GET /identity/v3/users/9611bb4995f64db69f45fd939815f531 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:59.270976 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eba056-cefe-4b5b-b466-09c2d2de52b8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:59.355577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:59.364605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 64/131] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:15:59 2022] PUT /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/users/9919555c8b9f4d16b646e3f64ace74c5/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:15:59.365923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e99da-44ae-4c96-845d-f9893542a65a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:59.392415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eba056-cefe-4b5b-b466-09c2d2de52b8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:59.433255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2040f-fd90-43d4-b374-25f5a2af03b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:59.433923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2040f-fd90-43d4-b374-25f5a2af03b8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:59.434211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2040f-fd90-43d4-b374-25f5a2af03b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:59.434489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2040f-fd90-43d4-b374-25f5a2af03b8 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:59.435775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2040f-fd90-43d4-b374-25f5a2af03b8 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:59.437406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2040f-fd90-43d4-b374-25f5a2af03b8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:59.439329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 68/132] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:15:59 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:59.439936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2040f-fd90-43d4-b374-25f5a2af03b8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:59.518744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e99da-44ae-4c96-845d-f9893542a65a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:59.562851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0afab-fb92-4484-bae7-6282a4bb0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:59.563937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0afab-fb92-4484-bae7-6282a4bb0b19 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:59.564446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0afab-fb92-4484-bae7-6282a4bb0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:59.564945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0afab-fb92-4484-bae7-6282a4bb0b19 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:59.566463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0afab-fb92-4484-bae7-6282a4bb0b19 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:59.568175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0afab-fb92-4484-bae7-6282a4bb0b19 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:59.570382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 65/133] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:15:59 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:59.570506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2040f-fd90-43d4-b374-25f5a2af03b8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:59.576199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0afab-fb92-4484-bae7-6282a4bb0b19 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:59.611187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:59.619989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e22c31-8846-456b-99d6-26f200cdab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:59.621222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e22c31-8846-456b-99d6-26f200cdab0f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:59.621665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e22c31-8846-456b-99d6-26f200cdab0f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:59.624554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e22c31-8846-456b-99d6-26f200cdab0f None admin] PATH_INFO: `/v3/projects/273d251bbda14947bd6f2b4c1b04e959` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:59.624554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e22c31-8846-456b-99d6-26f200cdab0f None admin] RBAC: Authorizing `identity:get_project(project_id=273d251bbda14947bd6f2b4c1b04e959)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:59.625233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e22c31-8846-456b-99d6-26f200cdab0f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:59.627104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 69/134] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:15:59 2022] GET /identity/v3/projects/273d251bbda14947bd6f2b4c1b04e959 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:59.628491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69250a-23a8-49dd-82e4-7c26700c6fe9 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:59.628782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69250a-23a8-49dd-82e4-7c26700c6fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:59.629057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69250a-23a8-49dd-82e4-7c26700c6fe9 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:59.630336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 70/135] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:15:59.631173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69250a-23a8-49dd-82e4-7c26700c6fe9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:59.643760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:59.712913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0afab-fb92-4484-bae7-6282a4bb0b19 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:59.756050 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1681f8-19bc-4f64-8e51-f1a53aacdd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:59.756697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1681f8-19bc-4f64-8e51-f1a53aacdd42 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:59.757273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1681f8-19bc-4f64-8e51-f1a53aacdd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:59.757749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1681f8-19bc-4f64-8e51-f1a53aacdd42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:59.759255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1681f8-19bc-4f64-8e51-f1a53aacdd42 None admin] RBAC: Adding query filter params (role.id=7bc837d3251a4691ac770e5a176c2218, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user.id=b62fac2ca2014826b13dfafe6b2b0570) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:15:59.759582 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1681f8-19bc-4f64-8e51-f1a53aacdd42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:59.761054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1681f8-19bc-4f64-8e51-f1a53aacdd42 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:59.768556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 66/136] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:15:59 2022] GET /identity/v3/role_assignments?user.id=b62fac2ca2014826b13dfafe6b2b0570&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=7bc837d3251a4691ac770e5a176c2218 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:15:59.775085 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1681f8-19bc-4f64-8e51-f1a53aacdd42 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:15:59.776682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69250a-23a8-49dd-82e4-7c26700c6fe9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:15:59.828770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8b111-26ac-4852-8afe-3f8443a8bd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:15:59.834151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8b111-26ac-4852-8afe-3f8443a8bd45 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:59.836966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8b111-26ac-4852-8afe-3f8443a8bd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:59.837562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8b111-26ac-4852-8afe-3f8443a8bd45 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/users/9611bb4995f64db69f45fd939815f531/roles/57a8970530a24c16b8d86a333768e765` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:59.842785 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8b111-26ac-4852-8afe-3f8443a8bd45 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user_id=9611bb4995f64db69f45fd939815f531, role_id=57a8970530a24c16b8d86a333768e765)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:15:59.845763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8b111-26ac-4852-8afe-3f8443a8bd45 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:15:59.931519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 71/137] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:15:59 2022] PUT /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/users/9611bb4995f64db69f45fd939815f531/roles/57a8970530a24c16b8d86a333768e765 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:15:59.933077 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312dff0-1bd9-42e4-a812-0c63316918c0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:15:59.933555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312dff0-1bd9-42e4-a812-0c63316918c0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:15:59.934063 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312dff0-1bd9-42e4-a812-0c63316918c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:15:59.958395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:15:59.974679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5312dff0-1bd9-42e4-a812-0c63316918c0 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:15:59.977065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5312dff0-1bd9-42e4-a812-0c63316918c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:15:59.978346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1681f8-19bc-4f64-8e51-f1a53aacdd42 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:00.043457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37070e-9711-424d-a219-652dcca9215b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:00.044157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37070e-9711-424d-a219-652dcca9215b None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:00.044447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37070e-9711-424d-a219-652dcca9215b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:00.044732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37070e-9711-424d-a219-652dcca9215b None admin] PATH_INFO: `/v3/projects/273d251bbda14947bd6f2b4c1b04e959/users/9611bb4995f64db69f45fd939815f531/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:00.048504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37070e-9711-424d-a219-652dcca9215b None admin] RBAC: Authorizing `identity:create_grant(project_id=273d251bbda14947bd6f2b4c1b04e959, user_id=9611bb4995f64db69f45fd939815f531, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:00.050244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37070e-9711-424d-a219-652dcca9215b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:00.118639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 72/138] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:00.122334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:00.176500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 67/139] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:15:59 2022] PUT /identity/v3/projects/273d251bbda14947bd6f2b4c1b04e959/users/9611bb4995f64db69f45fd939815f531/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:16:00.310337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35281ea-e18e-4511-98b4-f04a7bf31a68 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:00.310720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35281ea-e18e-4511-98b4-f04a7bf31a68 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:00.310894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35281ea-e18e-4511-98b4-f04a7bf31a68 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:00.312416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 73/140] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:00.327926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7112-d9d4-439e-a2e5-61aa58b3d607 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:00.328222 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7112-d9d4-439e-a2e5-61aa58b3d607 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:00.328499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7112-d9d4-439e-a2e5-61aa58b3d607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:00.352652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-22df7112-d9d4-439e-a2e5-61aa58b3d607 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:00.354127 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-22df7112-d9d4-439e-a2e5-61aa58b3d607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:00.448584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 68/141] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:00.503045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35281ea-e18e-4511-98b4-f04a7bf31a68 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:00.621065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35281ea-e18e-4511-98b4-f04a7bf31a68 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:00.657911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f77df-9a5e-45f2-a663-c58071a0430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:00.658553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f77df-9a5e-45f2-a663-c58071a0430a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:00.658831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f77df-9a5e-45f2-a663-c58071a0430a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:00.659105 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f77df-9a5e-45f2-a663-c58071a0430a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:00.660266 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f77df-9a5e-45f2-a663-c58071a0430a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:00.661754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f77df-9a5e-45f2-a663-c58071a0430a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:00.663891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 74/142] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:00.674216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7112-d9d4-439e-a2e5-61aa58b3d607 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:00.798475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:00.822365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7112-d9d4-439e-a2e5-61aa58b3d607 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:00.876365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad2039-5f85-40e1-bdc7-3dec977d9d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:00.876847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f77df-9a5e-45f2-a663-c58071a0430a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:00.877353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2039-5f85-40e1-bdc7-3dec977d9d82 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:00.877747 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2039-5f85-40e1-bdc7-3dec977d9d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:00.878220 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2039-5f85-40e1-bdc7-3dec977d9d82 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:00.879455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad2039-5f85-40e1-bdc7-3dec977d9d82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:00.881434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad2039-5f85-40e1-bdc7-3dec977d9d82 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:00.983231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:01.007145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 69/143] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:16:00 2022] POST /identity/v3/users => generated 283 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:16:01.035831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f77df-9a5e-45f2-a663-c58071a0430a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:01.096268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926ec89-2cdf-4a6f-a7cc-e614611715b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:01.096938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926ec89-2cdf-4a6f-a7cc-e614611715b1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:01.097280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926ec89-2cdf-4a6f-a7cc-e614611715b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:01.097558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926ec89-2cdf-4a6f-a7cc-e614611715b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:01.114786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926ec89-2cdf-4a6f-a7cc-e614611715b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-5926ec89-2cdf-4a6f-a7cc-e614611715b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:01.120671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:01.121608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:01.122429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:01.123026 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 75/144] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:01.130845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad2039-5f85-40e1-bdc7-3dec977d9d82 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:01.270880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad2039-5f85-40e1-bdc7-3dec977d9d82 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:01.316061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0242fcb-53d3-42ff-89dd-9f5f295b8589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:01.316751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0242fcb-53d3-42ff-89dd-9f5f295b8589 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:01.317036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0242fcb-53d3-42ff-89dd-9f5f295b8589 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:01.317316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0242fcb-53d3-42ff-89dd-9f5f295b8589 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:01.318080 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0242fcb-53d3-42ff-89dd-9f5f295b8589 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:01.318438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0242fcb-53d3-42ff-89dd-9f5f295b8589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:01.319979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0242fcb-53d3-42ff-89dd-9f5f295b8589 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:01.321612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:01.332656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 70/145] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:01.339549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926ec89-2cdf-4a6f-a7cc-e614611715b1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:01.468670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926ec89-2cdf-4a6f-a7cc-e614611715b1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:01.500690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:01.515414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e873d9b-8108-4bfb-b9b7-78b5ce1191dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:01.516119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e873d9b-8108-4bfb-b9b7-78b5ce1191dd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:01.516400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e873d9b-8108-4bfb-b9b7-78b5ce1191dd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:01.516671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e873d9b-8108-4bfb-b9b7-78b5ce1191dd None admin] PATH_INFO: `/v3/users/9611bb4995f64db69f45fd939815f531` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:01.517957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e873d9b-8108-4bfb-b9b7-78b5ce1191dd None admin] RBAC: Authorizing `identity:get_user(user_id=9611bb4995f64db69f45fd939815f531)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:01.519391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e873d9b-8108-4bfb-b9b7-78b5ce1191dd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:01.521973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 76/146] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:01 2022] GET /identity/v3/users/9611bb4995f64db69f45fd939815f531 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:01.528008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0242fcb-53d3-42ff-89dd-9f5f295b8589 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:01.672403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0242fcb-53d3-42ff-89dd-9f5f295b8589 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:01.715594 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7db32-f220-434f-bbba-61669b6d5874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:01.716230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7db32-f220-434f-bbba-61669b6d5874 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:01.716510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7db32-f220-434f-bbba-61669b6d5874 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:01.716787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7db32-f220-434f-bbba-61669b6d5874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:01.805929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:01.814124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7db32-f220-434f-bbba-61669b6d5874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:01.815666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7db32-f220-434f-bbba-61669b6d5874 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:01.945255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 71/147] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:01.951559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e873d9b-8108-4bfb-b9b7-78b5ce1191dd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:01.963136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d042cd7-f208-44ef-b662-b2662eecc8e9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:01.963454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d042cd7-f208-44ef-b662-b2662eecc8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:01.963682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d042cd7-f208-44ef-b662-b2662eecc8e9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:01.967174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 72/148] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:01.974119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651ce5-6ed4-4743-b320-b007d58a48d9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:01.975432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651ce5-6ed4-4743-b320-b007d58a48d9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:01.975432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651ce5-6ed4-4743-b320-b007d58a48d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:01.998564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e5651ce5-6ed4-4743-b320-b007d58a48d9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:02.000595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e5651ce5-6ed4-4743-b320-b007d58a48d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:02.123704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 73/149] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:02.155095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e873d9b-8108-4bfb-b9b7-78b5ce1191dd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:02.211235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2148-d29d-4817-855b-2fdb34f8b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:02.211891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2148-d29d-4817-855b-2fdb34f8b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:02.212165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2148-d29d-4817-855b-2fdb34f8b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:02.212427 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd2148-d29d-4817-855b-2fdb34f8b9f4 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:02.214382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2148-d29d-4817-855b-2fdb34f8b9f4 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:02.215973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fd2148-d29d-4817-855b-2fdb34f8b9f4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:02.219425 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 77/150] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:01 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:02.224679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651ce5-6ed4-4743-b320-b007d58a48d9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:02.267025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:02.375285 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651ce5-6ed4-4743-b320-b007d58a48d9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:02.420942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd95fd-7d69-44da-8718-50861ffcbc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:02.421563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd95fd-7d69-44da-8718-50861ffcbc68 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:02.421839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd95fd-7d69-44da-8718-50861ffcbc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:02.422133 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd95fd-7d69-44da-8718-50861ffcbc68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:02.422861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd95fd-7d69-44da-8718-50861ffcbc68 None admin] RBAC: Adding query filter params (role.id=eb63c7589f0c472b9e1abd79cbdd7528, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user.id=9611bb4995f64db69f45fd939815f531) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:02.423162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd95fd-7d69-44da-8718-50861ffcbc68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:02.424601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd95fd-7d69-44da-8718-50861ffcbc68 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:02.433816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 74/151] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:02 2022] GET /identity/v3/role_assignments?user.id=9611bb4995f64db69f45fd939815f531&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:02.536667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2148-d29d-4817-855b-2fdb34f8b9f4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:02.625537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:02.675689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd2148-d29d-4817-855b-2fdb34f8b9f4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:02.722265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53cda0-effa-437e-894c-2059ee929a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:02.722917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53cda0-effa-437e-894c-2059ee929a47 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:02.723193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53cda0-effa-437e-894c-2059ee929a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:02.723459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53cda0-effa-437e-894c-2059ee929a47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:02.736419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53cda0-effa-437e-894c-2059ee929a47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1a53cda0-effa-437e-894c-2059ee929a47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:02.742600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:02.743548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:02.744339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 78/152] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:16:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:02.751742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd95fd-7d69-44da-8718-50861ffcbc68 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:02.880423 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:02.896037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd95fd-7d69-44da-8718-50861ffcbc68 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:02.939504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a373c5f-f4c1-4b15-8341-1a22ba7aa2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:02.940604 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373c5f-f4c1-4b15-8341-1a22ba7aa2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:02.941098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373c5f-f4c1-4b15-8341-1a22ba7aa2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:02.941639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a373c5f-f4c1-4b15-8341-1a22ba7aa2c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:02.942511 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a373c5f-f4c1-4b15-8341-1a22ba7aa2c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:02.943057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a373c5f-f4c1-4b15-8341-1a22ba7aa2c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:02.949082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a373c5f-f4c1-4b15-8341-1a22ba7aa2c1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:02.962379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 75/153] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:02.969688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53cda0-effa-437e-894c-2059ee929a47 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:03.102937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53cda0-effa-437e-894c-2059ee929a47 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:03.134474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:03.143540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152e40b-1b9c-4fdb-8d2f-8d44259e2950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:03.144198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e40b-1b9c-4fdb-8d2f-8d44259e2950 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:03.144478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e40b-1b9c-4fdb-8d2f-8d44259e2950 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:03.148536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e40b-1b9c-4fdb-8d2f-8d44259e2950 None admin] PATH_INFO: `/v3/users/9919555c8b9f4d16b646e3f64ace74c5` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:03.148536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152e40b-1b9c-4fdb-8d2f-8d44259e2950 None admin] RBAC: Authorizing `identity:get_user(user_id=9919555c8b9f4d16b646e3f64ace74c5)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:03.148536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152e40b-1b9c-4fdb-8d2f-8d44259e2950 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:03.150162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 79/154] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:02 2022] GET /identity/v3/users/9919555c8b9f4d16b646e3f64ace74c5 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:03.155924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a373c5f-f4c1-4b15-8341-1a22ba7aa2c1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:03.274371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b3ceb-918b-4831-b4ea-d4bac59b61ed None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:03.274682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b3ceb-918b-4831-b4ea-d4bac59b61ed None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:03.274924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b3ceb-918b-4831-b4ea-d4bac59b61ed None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:03.276293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 80/155] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:03.277165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a373c5f-f4c1-4b15-8341-1a22ba7aa2c1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:03.282290 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ae8db-4841-4cc0-a6f9-f09c70f3f933 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:03.282575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ae8db-4841-4cc0-a6f9-f09c70f3f933 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:03.285839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ae8db-4841-4cc0-a6f9-f09c70f3f933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:03.309143 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6c9ae8db-4841-4cc0-a6f9-f09c70f3f933 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:03.310765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6c9ae8db-4841-4cc0-a6f9-f09c70f3f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:03.332943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53833f9c-7ca2-4a89-92d8-f95d3ad406ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:03.334226 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53833f9c-7ca2-4a89-92d8-f95d3ad406ec None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:03.334695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53833f9c-7ca2-4a89-92d8-f95d3ad406ec None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:03.335245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53833f9c-7ca2-4a89-92d8-f95d3ad406ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:03.377398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:03.399008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 81/156] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:03.481661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53833f9c-7ca2-4a89-92d8-f95d3ad406ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:03.483193 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53833f9c-7ca2-4a89-92d8-f95d3ad406ec None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:03.631240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 76/157] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:03.637179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ae8db-4841-4cc0-a6f9-f09c70f3f933 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:03.775386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53833f9c-7ca2-4a89-92d8-f95d3ad406ec None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:03.836851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ae8db-4841-4cc0-a6f9-f09c70f3f933 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:03.842297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:03.887339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:03.905398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53833f9c-7ca2-4a89-92d8-f95d3ad406ec None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:03.947156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d81fb-979b-48fe-82a2-791e530d449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:03.947905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d81fb-979b-48fe-82a2-791e530d449e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:03.948254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d81fb-979b-48fe-82a2-791e530d449e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:03.948595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d81fb-979b-48fe-82a2-791e530d449e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:03.949236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897ddad-196b-4246-a2be-741d0eb6ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:03.950105 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897ddad-196b-4246-a2be-741d0eb6ebcf None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:03.950566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897ddad-196b-4246-a2be-741d0eb6ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:03.951012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897ddad-196b-4246-a2be-741d0eb6ebcf None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:03.958708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897ddad-196b-4246-a2be-741d0eb6ebcf None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:03.961247 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897ddad-196b-4246-a2be-741d0eb6ebcf None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:03.962327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d81fb-979b-48fe-82a2-791e530d449e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:03.963817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 82/158] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:03 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-140d81fb-979b-48fe-82a2-791e530d449e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:03.971712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:03.972669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:03.973543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:03.979764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 77/159] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:03.983005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897ddad-196b-4246-a2be-741d0eb6ebcf None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:03.986889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d81fb-979b-48fe-82a2-791e530d449e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:04.097988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d81fb-979b-48fe-82a2-791e530d449e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:04.118764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:04.133710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbfabb-f87d-4acb-8438-f56b5b171581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:04.138010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbfabb-f87d-4acb-8438-f56b5b171581 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:04.138010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbfabb-f87d-4acb-8438-f56b5b171581 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:04.138010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbfabb-f87d-4acb-8438-f56b5b171581 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:04.138010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbfabb-f87d-4acb-8438-f56b5b171581 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:04.138010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbfabb-f87d-4acb-8438-f56b5b171581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:04.138010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbfabb-f87d-4acb-8438-f56b5b171581 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:04.147026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 78/160] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:04.148360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d1eca-122f-4578-a7f5-159689efdb28 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:04.157834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d1eca-122f-4578-a7f5-159689efdb28 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:04.157834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d1eca-122f-4578-a7f5-159689efdb28 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:04.157834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 79/161] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:04.157834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d081-8225-4804-b7b5-e9f2adbd52b0 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:04.157834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d081-8225-4804-b7b5-e9f2adbd52b0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:04.157834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041d081-8225-4804-b7b5-e9f2adbd52b0 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:04.158755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 80/162] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:04.158755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d081-8225-4804-b7b5-e9f2adbd52b0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:04.181452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897ddad-196b-4246-a2be-741d0eb6ebcf None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:04.223631 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440d3f3-8b12-4a55-b36a-e70118b23edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:04.224556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d3f3-8b12-4a55-b36a-e70118b23edb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:04.227292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d3f3-8b12-4a55-b36a-e70118b23edb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:04.227765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440d3f3-8b12-4a55-b36a-e70118b23edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:04.228702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d3f3-8b12-4a55-b36a-e70118b23edb None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user.id=9919555c8b9f4d16b646e3f64ace74c5) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:04.230917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d3f3-8b12-4a55-b36a-e70118b23edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:04.232589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440d3f3-8b12-4a55-b36a-e70118b23edb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:04.248059 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 83/163] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:03 2022] GET /identity/v3/role_assignments?user.id=9919555c8b9f4d16b646e3f64ace74c5&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:04.249605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df08bb0-0232-47da-8584-8955820ff6e1 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:04.252164 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df08bb0-0232-47da-8584-8955820ff6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:04.252921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df08bb0-0232-47da-8584-8955820ff6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:04.295085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2df08bb0-0232-47da-8584-8955820ff6e1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:04.296371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2df08bb0-0232-47da-8584-8955820ff6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:04.338099 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041d081-8225-4804-b7b5-e9f2adbd52b0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:04.412480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa66c6d-5f56-4810-a401-2a74e07cce85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:04.415092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa66c6d-5f56-4810-a401-2a74e07cce85 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:04.415565 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa66c6d-5f56-4810-a401-2a74e07cce85 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:04.416112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa66c6d-5f56-4810-a401-2a74e07cce85 None admin] PATH_INFO: `/v3/users/9611bb4995f64db69f45fd939815f531` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:04.416556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:04.419704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa66c6d-5f56-4810-a401-2a74e07cce85 None admin] RBAC: Authorizing `identity:get_user(user_id=9611bb4995f64db69f45fd939815f531)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:04.422194 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa66c6d-5f56-4810-a401-2a74e07cce85 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:04.424233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 81/164] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:04 2022] GET /identity/v3/users/9611bb4995f64db69f45fd939815f531 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:04.427212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1941d-8efb-4a60-bc1a-c8ab8dbe2ba4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:04.431120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1941d-8efb-4a60-bc1a-c8ab8dbe2ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:04.431120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d1941d-8efb-4a60-bc1a-c8ab8dbe2ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:04.464049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 84/165] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:04.464945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df08bb0-0232-47da-8584-8955820ff6e1 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:04.471707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-95d1941d-8efb-4a60-bc1a-c8ab8dbe2ba4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:04.472936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-95d1941d-8efb-4a60-bc1a-c8ab8dbe2ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:04.586913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:04.669671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 82/166] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:04.675417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df08bb0-0232-47da-8584-8955820ff6e1 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:04.712667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d5ab-84f1-4921-92c7-5c842806f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:04.713677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d5ab-84f1-4921-92c7-5c842806f27f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:04.714183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d5ab-84f1-4921-92c7-5c842806f27f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:04.714656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8d5ab-84f1-4921-92c7-5c842806f27f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:04.785349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:04.822404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8d5ab-84f1-4921-92c7-5c842806f27f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:04.823917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8d5ab-84f1-4921-92c7-5c842806f27f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:04.954272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 85/167] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:04.961000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1941d-8efb-4a60-bc1a-c8ab8dbe2ba4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:05.099815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d1941d-8efb-4a60-bc1a-c8ab8dbe2ba4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:05.108237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d5ab-84f1-4921-92c7-5c842806f27f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:05.168401 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5babe0-cf6c-4551-b774-6956fc7d6334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:05.169693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5babe0-cf6c-4551-b774-6956fc7d6334 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:05.170173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5babe0-cf6c-4551-b774-6956fc7d6334 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:05.170622 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5babe0-cf6c-4551-b774-6956fc7d6334 None admin] PATH_INFO: `/v3/projects/273d251bbda14947bd6f2b4c1b04e959` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:05.174629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5babe0-cf6c-4551-b774-6956fc7d6334 None admin] RBAC: Authorizing `identity:get_project(project_id=273d251bbda14947bd6f2b4c1b04e959)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:05.176342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5babe0-cf6c-4551-b774-6956fc7d6334 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:05.178341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 83/168] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:04 2022] GET /identity/v3/projects/273d251bbda14947bd6f2b4c1b04e959 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:05.189706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5babe0-cf6c-4551-b774-6956fc7d6334 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:05.283247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:05.305430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:05.327188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8d5ab-84f1-4921-92c7-5c842806f27f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:05.363477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5babe0-cf6c-4551-b774-6956fc7d6334 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:05.376316 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6a061-de83-46a6-9aef-ef0aff907315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:05.377391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6a061-de83-46a6-9aef-ef0aff907315 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:05.377679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6a061-de83-46a6-9aef-ef0aff907315 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:05.377981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6a061-de83-46a6-9aef-ef0aff907315 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:05.393583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6a061-de83-46a6-9aef-ef0aff907315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d2b6a061-de83-46a6-9aef-ef0aff907315 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:05.400806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:05.401769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:05.402609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 86/169] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:16:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:05.403275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6a061-de83-46a6-9aef-ef0aff907315 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:05.417483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea388d-663e-4fc7-8dce-7b90765bb637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:05.418228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea388d-663e-4fc7-8dce-7b90765bb637 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:05.418509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea388d-663e-4fc7-8dce-7b90765bb637 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:05.418847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea388d-663e-4fc7-8dce-7b90765bb637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:05.419650 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea388d-663e-4fc7-8dce-7b90765bb637 None admin] RBAC: Adding query filter params (role.id=eb63c7589f0c472b9e1abd79cbdd7528, scope.project.id=273d251bbda14947bd6f2b4c1b04e959, user.id=9611bb4995f64db69f45fd939815f531) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:05.419960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea388d-663e-4fc7-8dce-7b90765bb637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:05.421574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea388d-663e-4fc7-8dce-7b90765bb637 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:05.434257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 84/170] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:05 2022] GET /identity/v3/role_assignments?user.id=9611bb4995f64db69f45fd939815f531&scope.project.id=273d251bbda14947bd6f2b4c1b04e959&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:05.435879 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772ea4c-a066-4add-bb9d-95a49705a742 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:05.436164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772ea4c-a066-4add-bb9d-95a49705a742 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:05.436438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772ea4c-a066-4add-bb9d-95a49705a742 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:05.437788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 85/171] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:05.438803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772ea4c-a066-4add-bb9d-95a49705a742 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:05.565250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6a061-de83-46a6-9aef-ef0aff907315 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:05.632470 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ca547-fdbb-4f81-b842-700458cf00ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:05.633424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ca547-fdbb-4f81-b842-700458cf00ee None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:05.633849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ca547-fdbb-4f81-b842-700458cf00ee None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:05.634306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ca547-fdbb-4f81-b842-700458cf00ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:05.651386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:05.657645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ca547-fdbb-4f81-b842-700458cf00ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:05.664710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772ea4c-a066-4add-bb9d-95a49705a742 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-6d0ca547-fdbb-4f81-b842-700458cf00ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:05.666359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:05.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:05.668040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:05.668647 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:05.671396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 87/172] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:05.672962 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767b52-3145-414e-b597-8c6e609c8df8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:05.673446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767b52-3145-414e-b597-8c6e609c8df8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:05.673929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3767b52-3145-414e-b597-8c6e609c8df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:05.694765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c3767b52-3145-414e-b597-8c6e609c8df8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:05.696220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c3767b52-3145-414e-b597-8c6e609c8df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:05.708390 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5479096-4b06-43d2-922c-ec0ab6ad7519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:05.709381 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5479096-4b06-43d2-922c-ec0ab6ad7519 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:05.710463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5479096-4b06-43d2-922c-ec0ab6ad7519 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:05.711011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5479096-4b06-43d2-922c-ec0ab6ad7519 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:05.711811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5479096-4b06-43d2-922c-ec0ab6ad7519 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:05.712224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5479096-4b06-43d2-922c-ec0ab6ad7519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:05.713809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5479096-4b06-43d2-922c-ec0ab6ad7519 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:05.723139 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 86/173] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:05.724960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461adbc7-769d-489d-9648-43caabbd65e2 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:05.725252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461adbc7-769d-489d-9648-43caabbd65e2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:05.725645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461adbc7-769d-489d-9648-43caabbd65e2 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:05.731680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 87/174] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:05.732569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461adbc7-769d-489d-9648-43caabbd65e2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:05.797238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 88/175] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:05.798223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3767b52-3145-414e-b597-8c6e609c8df8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:05.874045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461adbc7-769d-489d-9648-43caabbd65e2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:05.915864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50705ef4-ef9b-46c0-80f9-c694a52fe6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:05.916530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50705ef4-ef9b-46c0-80f9-c694a52fe6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:05.916808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50705ef4-ef9b-46c0-80f9-c694a52fe6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:05.917078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50705ef4-ef9b-46c0-80f9-c694a52fe6d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:05.917746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50705ef4-ef9b-46c0-80f9-c694a52fe6d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:05.918121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50705ef4-ef9b-46c0-80f9-c694a52fe6d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:05.919722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50705ef4-ef9b-46c0-80f9-c694a52fe6d6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:05.922828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3767b52-3145-414e-b597-8c6e609c8df8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:05.931185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 88/176] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:05.933607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a74c8-7aa0-4884-8654-b2d4f1ad6cf5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:05.934132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a74c8-7aa0-4884-8654-b2d4f1ad6cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:05.934580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a74c8-7aa0-4884-8654-b2d4f1ad6cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:05.956190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-346a74c8-7aa0-4884-8654-b2d4f1ad6cf5 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:05.957091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:05.957599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-346a74c8-7aa0-4884-8654-b2d4f1ad6cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:05.964689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61579096-0148-472b-9dce-c791aa8b18ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:05.965751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61579096-0148-472b-9dce-c791aa8b18ea None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:05.970241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61579096-0148-472b-9dce-c791aa8b18ea None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:05.970241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61579096-0148-472b-9dce-c791aa8b18ea None admin] PATH_INFO: `/v3/users/9611bb4995f64db69f45fd939815f531` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:05.970241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61579096-0148-472b-9dce-c791aa8b18ea None admin] RBAC: Authorizing `identity:get_user(user_id=9611bb4995f64db69f45fd939815f531)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:05.970241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61579096-0148-472b-9dce-c791aa8b18ea None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:05.971449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 89/177] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:05 2022] GET /identity/v3/users/9611bb4995f64db69f45fd939815f531 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:05.977331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61579096-0148-472b-9dce-c791aa8b18ea None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:05.983731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:06.033470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 89/178] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:06.035097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29874ba4-cd5e-4e7b-b2ed-a8536c60afd6 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:06.035506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29874ba4-cd5e-4e7b-b2ed-a8536c60afd6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:06.035899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29874ba4-cd5e-4e7b-b2ed-a8536c60afd6 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:06.037605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 90/179] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:06.039005 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29874ba4-cd5e-4e7b-b2ed-a8536c60afd6 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:06.108782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61579096-0148-472b-9dce-c791aa8b18ea None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:06.156640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d525d-054e-45eb-9da0-4b12c7d7dbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:06.158168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d525d-054e-45eb-9da0-4b12c7d7dbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:06.158623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d525d-054e-45eb-9da0-4b12c7d7dbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:06.159335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d525d-054e-45eb-9da0-4b12c7d7dbc2 None admin] PATH_INFO: `/v3/users/b62fac2ca2014826b13dfafe6b2b0570` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:06.160910 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d525d-054e-45eb-9da0-4b12c7d7dbc2 None admin] RBAC: Authorizing `identity:get_user(user_id=b62fac2ca2014826b13dfafe6b2b0570)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:06.163650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d525d-054e-45eb-9da0-4b12c7d7dbc2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:06.166634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 90/180] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:05 2022] GET /identity/v3/users/b62fac2ca2014826b13dfafe6b2b0570 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:06.168741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d561-bc17-42a0-bc27-228708588369 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:06.169434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d561-bc17-42a0-bc27-228708588369 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:06.169868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657d561-bc17-42a0-bc27-228708588369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:06.172770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29874ba4-cd5e-4e7b-b2ed-a8536c60afd6 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:06.193747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1657d561-bc17-42a0-bc27-228708588369 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:06.196296 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1657d561-bc17-42a0-bc27-228708588369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:06.212378 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc6bf-f976-41be-8e17-523dc6f4cc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:06.213008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc6bf-f976-41be-8e17-523dc6f4cc87 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:06.213299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc6bf-f976-41be-8e17-523dc6f4cc87 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:06.213559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682dc6bf-f976-41be-8e17-523dc6f4cc87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:06.251032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:06.268149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:06.276475 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 91/181] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:06.282959 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657d561-bc17-42a0-bc27-228708588369 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:06.297986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dc6bf-f976-41be-8e17-523dc6f4cc87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:06.299785 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682dc6bf-f976-41be-8e17-523dc6f4cc87 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:06.431580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 91/182] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:06.431580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc6bf-f976-41be-8e17-523dc6f4cc87 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:06.442700 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657d561-bc17-42a0-bc27-228708588369 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:06.488823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98a9c8-2c70-4eb0-80f4-2d4d1c16349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:06.489623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98a9c8-2c70-4eb0-80f4-2d4d1c16349c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:06.489940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98a9c8-2c70-4eb0-80f4-2d4d1c16349c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:06.490208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe98a9c8-2c70-4eb0-80f4-2d4d1c16349c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:06.503956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe98a9c8-2c70-4eb0-80f4-2d4d1c16349c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:06.508862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-fe98a9c8-2c70-4eb0-80f4-2d4d1c16349c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:06.509415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:06.510310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:06.511109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 92/183] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:16:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:06.516050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98a9c8-2c70-4eb0-80f4-2d4d1c16349c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:06.560853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682dc6bf-f976-41be-8e17-523dc6f4cc87 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:06.578083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:06.597990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a8ac7-9551-4dc9-a244-706838731e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:06.598651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a8ac7-9551-4dc9-a244-706838731e8a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:06.598930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a8ac7-9551-4dc9-a244-706838731e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:06.599205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a8ac7-9551-4dc9-a244-706838731e8a None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:06.603342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a8ac7-9551-4dc9-a244-706838731e8a None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:06.603342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a8ac7-9551-4dc9-a244-706838731e8a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:06.604670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 92/184] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:06 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:06.605318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a8ac7-9551-4dc9-a244-706838731e8a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:06.624874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe98a9c8-2c70-4eb0-80f4-2d4d1c16349c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:06.663173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e23f06-1749-4756-a656-0020e1bb3289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:06.664087 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23f06-1749-4756-a656-0020e1bb3289 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:06.664366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23f06-1749-4756-a656-0020e1bb3289 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:06.664641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e23f06-1749-4756-a656-0020e1bb3289 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:06.665805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e23f06-1749-4756-a656-0020e1bb3289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:06.667305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e23f06-1749-4756-a656-0020e1bb3289 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:06.668931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 93/185] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:06.674445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e23f06-1749-4756-a656-0020e1bb3289 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:06.710964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a8ac7-9551-4dc9-a244-706838731e8a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:06.738366 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:06.748418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284816-f35f-4878-9554-cb52bffa89ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:06.749065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284816-f35f-4878-9554-cb52bffa89ad None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:06.749342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284816-f35f-4878-9554-cb52bffa89ad None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:06.749607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c284816-f35f-4878-9554-cb52bffa89ad None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:06.750788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284816-f35f-4878-9554-cb52bffa89ad None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:06.759798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c284816-f35f-4878-9554-cb52bffa89ad None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:06.759798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 93/186] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:06 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:06.759798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284816-f35f-4878-9554-cb52bffa89ad None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:06.785335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e23f06-1749-4756-a656-0020e1bb3289 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:06.812441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:06.823326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9c918-83a1-4e35-9bc5-9aa8041deed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:06.829400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9c918-83a1-4e35-9bc5-9aa8041deed1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:06.829400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9c918-83a1-4e35-9bc5-9aa8041deed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:06.829400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9c918-83a1-4e35-9bc5-9aa8041deed1 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:06.829400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9c918-83a1-4e35-9bc5-9aa8041deed1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:06.829400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9c918-83a1-4e35-9bc5-9aa8041deed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:06.829400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9c918-83a1-4e35-9bc5-9aa8041deed1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:06.835234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 94/187] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:06.840072 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9c918-83a1-4e35-9bc5-9aa8041deed1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:06.862026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c284816-f35f-4878-9554-cb52bffa89ad None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:06.898098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca9b0-6f35-4733-8e89-25ebdd930af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:06.898756 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca9b0-6f35-4733-8e89-25ebdd930af6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:06.899030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca9b0-6f35-4733-8e89-25ebdd930af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:06.899305 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ca9b0-6f35-4733-8e89-25ebdd930af6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:06.910687 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ca9b0-6f35-4733-8e89-25ebdd930af6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-1b5ca9b0-6f35-4733-8e89-25ebdd930af6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:06.917197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:06.918197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 94/188] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:16:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:06.919117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca9b0-6f35-4733-8e89-25ebdd930af6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:06.949195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9c918-83a1-4e35-9bc5-9aa8041deed1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:06.982128 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:06.984563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ff0d6-1e76-4eff-bcc5-9b2211b60ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:06.985236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ff0d6-1e76-4eff-bcc5-9b2211b60ac0 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:06.985509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ff0d6-1e76-4eff-bcc5-9b2211b60ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:06.985806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ff0d6-1e76-4eff-bcc5-9b2211b60ac0 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/users/b62fac2ca2014826b13dfafe6b2b0570/roles/7bc837d3251a4691ac770e5a176c2218` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:06.987795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ff0d6-1e76-4eff-bcc5-9b2211b60ac0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user_id=b62fac2ca2014826b13dfafe6b2b0570, role_id=7bc837d3251a4691ac770e5a176c2218)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:07.007188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ff0d6-1e76-4eff-bcc5-9b2211b60ac0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:07.028625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ca9b0-6f35-4733-8e89-25ebdd930af6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:07.064510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c4157-7fa3-4168-b890-c1b1df5a541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:07.065129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c4157-7fa3-4168-b890-c1b1df5a541a None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:07.065413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c4157-7fa3-4168-b890-c1b1df5a541a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:07.065687 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41c4157-7fa3-4168-b890-c1b1df5a541a None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:07.066379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c4157-7fa3-4168-b890-c1b1df5a541a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:07.067830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41c4157-7fa3-4168-b890-c1b1df5a541a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:07.083794 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 95/189] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:16:06 2022] PUT /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/users/b62fac2ca2014826b13dfafe6b2b0570/roles/7bc837d3251a4691ac770e5a176c2218 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:16:07.084634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ff0d6-1e76-4eff-bcc5-9b2211b60ac0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:07.144169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:07.181694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 95/190] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:16:06 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:16:07.191237 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c4157-7fa3-4168-b890-c1b1df5a541a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:07.220588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ff0d6-1e76-4eff-bcc5-9b2211b60ac0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:07.273959 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d558b-82d6-4487-94f0-ab88301df1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:07.274585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d558b-82d6-4487-94f0-ab88301df1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:07.274861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d558b-82d6-4487-94f0-ab88301df1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:07.275126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d558b-82d6-4487-94f0-ab88301df1e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:07.275918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d558b-82d6-4487-94f0-ab88301df1e6 None admin] RBAC: Adding query filter params (role.id=57a8970530a24c16b8d86a333768e765, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user.id=9611bb4995f64db69f45fd939815f531) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:07.276209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d558b-82d6-4487-94f0-ab88301df1e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:07.277799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d558b-82d6-4487-94f0-ab88301df1e6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:07.284744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 96/191] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:07 2022] GET /identity/v3/role_assignments?user.id=9611bb4995f64db69f45fd939815f531&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=57a8970530a24c16b8d86a333768e765 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:07.285453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d558b-82d6-4487-94f0-ab88301df1e6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:07.408254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41c4157-7fa3-4168-b890-c1b1df5a541a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:07.430884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:07.438896 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d558b-82d6-4487-94f0-ab88301df1e6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:07.455336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:07.462397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a82e6b-f6a6-4889-90a1-5eb97239e1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:07.463120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82e6b-f6a6-4889-90a1-5eb97239e1cc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:07.463400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82e6b-f6a6-4889-90a1-5eb97239e1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:07.463745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82e6b-f6a6-4889-90a1-5eb97239e1cc None admin] PATH_INFO: `/v3/users/4727cc049f6c4d00947562113661b8b6` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:07.482400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a82e6b-f6a6-4889-90a1-5eb97239e1cc None admin] RBAC: Authorizing `identity:get_user(user_id=4727cc049f6c4d00947562113661b8b6)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:07.483896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a82e6b-f6a6-4889-90a1-5eb97239e1cc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:07.485614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 96/192] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:07 2022] GET /identity/v3/users/4727cc049f6c4d00947562113661b8b6 => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:07.486941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fb6d3-2bbc-4fda-8d0f-7959786acc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:07.493076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fb6d3-2bbc-4fda-8d0f-7959786acc8e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:07.493076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fb6d3-2bbc-4fda-8d0f-7959786acc8e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:07.493076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fb6d3-2bbc-4fda-8d0f-7959786acc8e None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:07.493076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fb6d3-2bbc-4fda-8d0f-7959786acc8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:07.493076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fb6d3-2bbc-4fda-8d0f-7959786acc8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:07.493076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fb6d3-2bbc-4fda-8d0f-7959786acc8e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:07.497160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a82e6b-f6a6-4889-90a1-5eb97239e1cc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:07.502150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 97/193] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:07.508782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fb6d3-2bbc-4fda-8d0f-7959786acc8e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:07.651337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a82e6b-f6a6-4889-90a1-5eb97239e1cc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:07.668735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fb6d3-2bbc-4fda-8d0f-7959786acc8e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:07.696315 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00faac-ec46-443d-8dbc-54a7a61eae0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:07.696964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00faac-ec46-443d-8dbc-54a7a61eae0a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:07.697249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00faac-ec46-443d-8dbc-54a7a61eae0a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:07.697523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00faac-ec46-443d-8dbc-54a7a61eae0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:07.715504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7902b0-0c48-4015-9674-313db70eb413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:07.716708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7902b0-0c48-4015-9674-313db70eb413 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:07.717223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7902b0-0c48-4015-9674-313db70eb413 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:07.717502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7902b0-0c48-4015-9674-313db70eb413 None admin] PATH_INFO: `/v3/users/4727cc049f6c4d00947562113661b8b6` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:07.720113 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7902b0-0c48-4015-9674-313db70eb413 None admin] RBAC: Authorizing `identity:get_user(user_id=4727cc049f6c4d00947562113661b8b6)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:07.722644 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7902b0-0c48-4015-9674-313db70eb413 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:07.725344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 98/194] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:07 2022] GET /identity/v3/users/4727cc049f6c4d00947562113661b8b6 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:07.731737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7902b0-0c48-4015-9674-313db70eb413 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:07.761294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:07.797290 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:07.809684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00faac-ec46-443d-8dbc-54a7a61eae0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:07.811982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00faac-ec46-443d-8dbc-54a7a61eae0a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:07.900294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7902b0-0c48-4015-9674-313db70eb413 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:07.938714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdaa3c-8fd4-4da4-9d6f-972a40949aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:07.939340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdaa3c-8fd4-4da4-9d6f-972a40949aef None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:07.939618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdaa3c-8fd4-4da4-9d6f-972a40949aef None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:07.939887 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdaa3c-8fd4-4da4-9d6f-972a40949aef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:07.951884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 97/195] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:16:07.959476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00faac-ec46-443d-8dbc-54a7a61eae0a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:08.038512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdaa3c-8fd4-4da4-9d6f-972a40949aef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:08.038512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bdaa3c-8fd4-4da4-9d6f-972a40949aef None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:08.126385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:08.159523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:08.259808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 99/196] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:08.262167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00faac-ec46-443d-8dbc-54a7a61eae0a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:08.270324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdaa3c-8fd4-4da4-9d6f-972a40949aef None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:08.398826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011590-60e5-4716-9cbf-025b0e20377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:08.399497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011590-60e5-4716-9cbf-025b0e20377f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:08.399779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011590-60e5-4716-9cbf-025b0e20377f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:08.400047 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0011590-60e5-4716-9cbf-025b0e20377f None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:08.401916 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0011590-60e5-4716-9cbf-025b0e20377f None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:08.402919 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0011590-60e5-4716-9cbf-025b0e20377f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:08.405940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 98/197] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:07 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:08.412169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011590-60e5-4716-9cbf-025b0e20377f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:08.417950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bdaa3c-8fd4-4da4-9d6f-972a40949aef None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:08.466478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af39586-df49-4f4a-8dfd-7a6eda3e82e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:08.467131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af39586-df49-4f4a-8dfd-7a6eda3e82e3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:08.467410 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af39586-df49-4f4a-8dfd-7a6eda3e82e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:08.467684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af39586-df49-4f4a-8dfd-7a6eda3e82e3 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:08.469941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af39586-df49-4f4a-8dfd-7a6eda3e82e3 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:08.471052 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af39586-df49-4f4a-8dfd-7a6eda3e82e3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:08.473759 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 100/198] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:08 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:08.481473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af39586-df49-4f4a-8dfd-7a6eda3e82e3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:08.503300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:08.668968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0011590-60e5-4716-9cbf-025b0e20377f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:08.725340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a11141-9e35-4c8c-b662-c56d19ea14f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:08.726148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11141-9e35-4c8c-b662-c56d19ea14f4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:08.726427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11141-9e35-4c8c-b662-c56d19ea14f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:08.726964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a11141-9e35-4c8c-b662-c56d19ea14f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:08.727707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a11141-9e35-4c8c-b662-c56d19ea14f4 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=5d7a7332da9346c680fa5fdc04291231, user.id=4727cc049f6c4d00947562113661b8b6) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:08.728013 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a11141-9e35-4c8c-b662-c56d19ea14f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:08.729447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a11141-9e35-4c8c-b662-c56d19ea14f4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:08.741700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:08.748157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 99/199] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:08 2022] GET /identity/v3/role_assignments?user.id=4727cc049f6c4d00947562113661b8b6&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:08.748786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af39586-df49-4f4a-8dfd-7a6eda3e82e3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:08.829297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b4d61-03bc-45d5-a15d-bcfa5252b093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:08.829950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b4d61-03bc-45d5-a15d-bcfa5252b093 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:08.830230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b4d61-03bc-45d5-a15d-bcfa5252b093 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:08.830505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b4d61-03bc-45d5-a15d-bcfa5252b093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:08.831243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b4d61-03bc-45d5-a15d-bcfa5252b093 None admin] RBAC: Adding query filter params (role.id=57a8970530a24c16b8d86a333768e765, scope.project.id=5d7a7332da9346c680fa5fdc04291231, user.id=4727cc049f6c4d00947562113661b8b6) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:08.831549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b4d61-03bc-45d5-a15d-bcfa5252b093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:08.833401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b4d61-03bc-45d5-a15d-bcfa5252b093 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:08.847420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 101/200] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:08 2022] GET /identity/v3/role_assignments?user.id=4727cc049f6c4d00947562113661b8b6&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=57a8970530a24c16b8d86a333768e765 => generated 259 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:09.694357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0f2e2-d7a7-46f1-bbf6-7cf2e20e225f None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:09.695124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0f2e2-d7a7-46f1-bbf6-7cf2e20e225f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:09.695341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0f2e2-d7a7-46f1-bbf6-7cf2e20e225f None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:09.697441 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 100/201] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:09.703661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634423f4-fdeb-445d-990f-65291f5fa1d8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:09.704315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634423f4-fdeb-445d-990f-65291f5fa1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:09.704740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634423f4-fdeb-445d-990f-65291f5fa1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:09.742292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-634423f4-fdeb-445d-990f-65291f5fa1d8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:09.743869 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-634423f4-fdeb-445d-990f-65291f5fa1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:09.853048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 102/202] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:10.197330 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0f2e2-d7a7-46f1-bbf6-7cf2e20e225f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:10.216195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212a858-bc67-4c16-b2cd-47f9d972e6dc None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:10.216529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212a858-bc67-4c16-b2cd-47f9d972e6dc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:10.216744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212a858-bc67-4c16-b2cd-47f9d972e6dc None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:10.218133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 103/203] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:16:10.224381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f0d65-f163-40ad-87dc-f1f453fc3e54 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:10.224663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f0d65-f163-40ad-87dc-f1f453fc3e54 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:10.224918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f0d65-f163-40ad-87dc-f1f453fc3e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:10.233500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:10.255416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-055f0d65-f163-40ad-87dc-f1f453fc3e54 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:10.257053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-055f0d65-f163-40ad-87dc-f1f453fc3e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:10.359633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 104/204] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:10.362245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fe580-dfa6-4cee-a1e9-29681a07a23c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:10.362796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fe580-dfa6-4cee-a1e9-29681a07a23c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:10.363526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fe580-dfa6-4cee-a1e9-29681a07a23c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:10.365779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 105/205] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:10.372090 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfc4c0-1bbe-4544-8daa-07ab1aff6058 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:10.372767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfc4c0-1bbe-4544-8daa-07ab1aff6058 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:10.373255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfc4c0-1bbe-4544-8daa-07ab1aff6058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:10.378409 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0f2e2-d7a7-46f1-bbf6-7cf2e20e225f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:10.393619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b9bfc4c0-1bbe-4544-8daa-07ab1aff6058 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:10.395209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b9bfc4c0-1bbe-4544-8daa-07ab1aff6058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:10.417702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1067124-ed85-4e00-83e4-1a8a89d03b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:10.418417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067124-ed85-4e00-83e4-1a8a89d03b77 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:10.418698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067124-ed85-4e00-83e4-1a8a89d03b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:10.418970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067124-ed85-4e00-83e4-1a8a89d03b77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:10.432160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1067124-ed85-4e00-83e4-1a8a89d03b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d1067124-ed85-4e00-83e4-1a8a89d03b77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:10.437700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:10.438753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:10.439602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 101/206] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:10.445510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1067124-ed85-4e00-83e4-1a8a89d03b77 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:10.479900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 106/207] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:10.515753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:10.561613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1067124-ed85-4e00-83e4-1a8a89d03b77 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:10.599044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3478f98-8c27-42e3-88b9-0a256ab15ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:10.599675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3478f98-8c27-42e3-88b9-0a256ab15ffe None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:10.599955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3478f98-8c27-42e3-88b9-0a256ab15ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:10.600228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3478f98-8c27-42e3-88b9-0a256ab15ffe None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:10.601926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3478f98-8c27-42e3-88b9-0a256ab15ffe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:10.602366 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3478f98-8c27-42e3-88b9-0a256ab15ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:10.603756 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3478f98-8c27-42e3-88b9-0a256ab15ffe None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:10.613544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 102/208] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:10.620048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfc4c0-1bbe-4544-8daa-07ab1aff6058 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:10.713838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:10.765126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfc4c0-1bbe-4544-8daa-07ab1aff6058 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:10.801753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc38191-6794-4dcb-a0ae-b2486d850535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:10.802455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38191-6794-4dcb-a0ae-b2486d850535 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:10.802737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38191-6794-4dcb-a0ae-b2486d850535 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:10.803012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc38191-6794-4dcb-a0ae-b2486d850535 None admin] PATH_INFO: `/v3/users/b62fac2ca2014826b13dfafe6b2b0570` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:10.804484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc38191-6794-4dcb-a0ae-b2486d850535 None admin] RBAC: Authorizing `identity:get_user(user_id=b62fac2ca2014826b13dfafe6b2b0570)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:10.806041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc38191-6794-4dcb-a0ae-b2486d850535 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:10.808003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 107/209] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:10 2022] GET /identity/v3/users/b62fac2ca2014826b13dfafe6b2b0570 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:10.813687 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3478f98-8c27-42e3-88b9-0a256ab15ffe None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:10.849762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc38191-6794-4dcb-a0ae-b2486d850535 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:10.963471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3478f98-8c27-42e3-88b9-0a256ab15ffe None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:10.979072 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc38191-6794-4dcb-a0ae-b2486d850535 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:10.997190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:11.010770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af4989-669b-4502-8979-d94d33d46f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:11.012652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4989-669b-4502-8979-d94d33d46f2d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.012652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4989-669b-4502-8979-d94d33d46f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.012652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af4989-669b-4502-8979-d94d33d46f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.016310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:11.023633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375a843-abad-4696-a952-e1759b029e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:11.024566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375a843-abad-4696-a952-e1759b029e3f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.025027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375a843-abad-4696-a952-e1759b029e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.025468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5375a843-abad-4696-a952-e1759b029e3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.040168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5375a843-abad-4696-a952-e1759b029e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-5375a843-abad-4696-a952-e1759b029e3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:11.045778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:11.046790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:11.047600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:11.049918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 108/210] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:11.050939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375a843-abad-4696-a952-e1759b029e3f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:11.106727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af4989-669b-4502-8979-d94d33d46f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:11.108332 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af4989-669b-4502-8979-d94d33d46f2d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:11.173817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5375a843-abad-4696-a952-e1759b029e3f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:11.220213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1d09-c59b-400a-bd3a-5e3e2b5a835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:11.220784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1d09-c59b-400a-bd3a-5e3e2b5a835a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.221065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1d09-c59b-400a-bd3a-5e3e2b5a835a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.221336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1d09-c59b-400a-bd3a-5e3e2b5a835a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.222633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1d09-c59b-400a-bd3a-5e3e2b5a835a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:11.224213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1d09-c59b-400a-bd3a-5e3e2b5a835a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:11.226395 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 109/211] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:11.227501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1d09-c59b-400a-bd3a-5e3e2b5a835a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:11.231081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 103/212] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:11.233792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb513cd-00aa-4371-9c23-1bf9f1ffe05a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.234348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb513cd-00aa-4371-9c23-1bf9f1ffe05a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.234861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb513cd-00aa-4371-9c23-1bf9f1ffe05a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.236589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 104/213] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:11.238371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb513cd-00aa-4371-9c23-1bf9f1ffe05a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:11.270987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:11.298610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:11.345450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1d09-c59b-400a-bd3a-5e3e2b5a835a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:11.386938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2837fe1-86df-42b5-a152-d1a61933e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:11.387658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2837fe1-86df-42b5-a152-d1a61933e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.388007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2837fe1-86df-42b5-a152-d1a61933e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.388370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2837fe1-86df-42b5-a152-d1a61933e1f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.389108 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2837fe1-86df-42b5-a152-d1a61933e1f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:11.389413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2837fe1-86df-42b5-a152-d1a61933e1f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:11.390233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb513cd-00aa-4371-9c23-1bf9f1ffe05a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:11.390848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2837fe1-86df-42b5-a152-d1a61933e1f4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:11.400824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 110/214] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:11.401467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2837fe1-86df-42b5-a152-d1a61933e1f4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:11.438807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5be70-9ec9-4f92-978e-74ec649cb5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:11.439462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5be70-9ec9-4f92-978e-74ec649cb5fd None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.439772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5be70-9ec9-4f92-978e-74ec649cb5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.440022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5be70-9ec9-4f92-978e-74ec649cb5fd None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.440692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5be70-9ec9-4f92-978e-74ec649cb5fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:11.442167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5be70-9ec9-4f92-978e-74ec649cb5fd None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:11.515238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2837fe1-86df-42b5-a152-d1a61933e1f4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:11.535989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:11.548744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 105/215] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:16:11 2022] POST /identity/v3/users => generated 297 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:16:11.550970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915030f-fdb7-4274-a56a-3d162258ff52 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.554551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915030f-fdb7-4274-a56a-3d162258ff52 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.554551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915030f-fdb7-4274-a56a-3d162258ff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.554843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded35aa-1fc1-4eab-a7c0-1bcd7c0424ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:11.554843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded35aa-1fc1-4eab-a7c0-1bcd7c0424ce None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.554843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded35aa-1fc1-4eab-a7c0-1bcd7c0424ce None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.554843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded35aa-1fc1-4eab-a7c0-1bcd7c0424ce None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.556819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded35aa-1fc1-4eab-a7c0-1bcd7c0424ce None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:11.559547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded35aa-1fc1-4eab-a7c0-1bcd7c0424ce None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:11.561515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 111/216] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:11 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:11.562461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded35aa-1fc1-4eab-a7c0-1bcd7c0424ce None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:11.577808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9915030f-fdb7-4274-a56a-3d162258ff52 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:11.585529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9915030f-fdb7-4274-a56a-3d162258ff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:11.671452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 106/217] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:11.672821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915030f-fdb7-4274-a56a-3d162258ff52 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:11.686012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:11.705703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded35aa-1fc1-4eab-a7c0-1bcd7c0424ce None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:11.747358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f5416-b891-4399-bc3c-c72c146491eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:11.748288 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f5416-b891-4399-bc3c-c72c146491eb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.748829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f5416-b891-4399-bc3c-c72c146491eb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.749332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f5416-b891-4399-bc3c-c72c146491eb None admin] PATH_INFO: `/v3/users/a0dcc554dc0a4b068247cc9ace08c04f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.775218 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f5416-b891-4399-bc3c-c72c146491eb None admin] RBAC: Authorizing `identity:get_user(user_id=a0dcc554dc0a4b068247cc9ace08c04f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:11.776643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f5416-b891-4399-bc3c-c72c146491eb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:11.778406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 112/218] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:11 2022] GET /identity/v3/users/a0dcc554dc0a4b068247cc9ace08c04f => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:11.779725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ae7e2-d02d-4151-8e26-80cc32e99b20 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.780010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ae7e2-d02d-4151-8e26-80cc32e99b20 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.780300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ae7e2-d02d-4151-8e26-80cc32e99b20 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.781493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 113/219] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:11.784002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ae7e2-d02d-4151-8e26-80cc32e99b20 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:11.811834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915030f-fdb7-4274-a56a-3d162258ff52 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:11.847114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:11.863975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6536e-c16d-45e0-b9cf-1df8081d5bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:11.866654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6536e-c16d-45e0-b9cf-1df8081d5bac None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.867108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6536e-c16d-45e0-b9cf-1df8081d5bac None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.870293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6536e-c16d-45e0-b9cf-1df8081d5bac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.870490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6536e-c16d-45e0-b9cf-1df8081d5bac None admin] RBAC: Adding query filter params (role.id=7bc837d3251a4691ac770e5a176c2218, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b, user.id=b62fac2ca2014826b13dfafe6b2b0570) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:11.871362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6536e-c16d-45e0-b9cf-1df8081d5bac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:11.872446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6536e-c16d-45e0-b9cf-1df8081d5bac None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:11.883777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 107/220] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:11 2022] GET /identity/v3/role_assignments?user.id=b62fac2ca2014826b13dfafe6b2b0570&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=7bc837d3251a4691ac770e5a176c2218 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:11.885638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716297-2368-44db-b29a-05170a875081 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:11.885862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716297-2368-44db-b29a-05170a875081 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:11.886145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716297-2368-44db-b29a-05170a875081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:11.920968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6d716297-2368-44db-b29a-05170a875081 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:11.922963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6d716297-2368-44db-b29a-05170a875081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:11.986385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ae7e2-d02d-4151-8e26-80cc32e99b20 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:12.035376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31791947-1e9b-44a5-a7ea-92c85cfb646d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:12.036438 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791947-1e9b-44a5-a7ea-92c85cfb646d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:12.036954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791947-1e9b-44a5-a7ea-92c85cfb646d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:12.037432 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31791947-1e9b-44a5-a7ea-92c85cfb646d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:12.078375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 108/221] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:12.079481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d716297-2368-44db-b29a-05170a875081 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:12.085974 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:12.154024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31791947-1e9b-44a5-a7ea-92c85cfb646d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:12.157244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31791947-1e9b-44a5-a7ea-92c85cfb646d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:12.285137 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:12.321944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d716297-2368-44db-b29a-05170a875081 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:12.386949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22497e-aa61-4460-bb7f-5b59793013c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:12.390182 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22497e-aa61-4460-bb7f-5b59793013c2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:12.390720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22497e-aa61-4460-bb7f-5b59793013c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:12.391199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22497e-aa61-4460-bb7f-5b59793013c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:12.422771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 114/222] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:12.423684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31791947-1e9b-44a5-a7ea-92c85cfb646d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:12.430165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22497e-aa61-4460-bb7f-5b59793013c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-3d22497e-aa61-4460-bb7f-5b59793013c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:12.441909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:12.442932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:12.443740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:12.450252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 109/223] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:16:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:12.450252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22497e-aa61-4460-bb7f-5b59793013c2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:12.537569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:12.549475 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31791947-1e9b-44a5-a7ea-92c85cfb646d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:12.591391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91737b7a-667a-428f-9125-c7daeb3ba633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:12.591966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737b7a-667a-428f-9125-c7daeb3ba633 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:12.592243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737b7a-667a-428f-9125-c7daeb3ba633 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:12.592509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91737b7a-667a-428f-9125-c7daeb3ba633 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:12.592620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22497e-aa61-4460-bb7f-5b59793013c2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:12.608109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91737b7a-667a-428f-9125-c7daeb3ba633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-91737b7a-667a-428f-9125-c7daeb3ba633 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:12.613152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:12.614104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:12.615151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 115/224] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:16:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:12.615849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91737b7a-667a-428f-9125-c7daeb3ba633 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:12.627133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:12.646706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2061f73-1e62-4867-9862-1353fa36e949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:12.648123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061f73-1e62-4867-9862-1353fa36e949 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:12.648339 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061f73-1e62-4867-9862-1353fa36e949 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:12.652965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061f73-1e62-4867-9862-1353fa36e949 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:12.652965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2061f73-1e62-4867-9862-1353fa36e949 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:12.652965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2061f73-1e62-4867-9862-1353fa36e949 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:12.652965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 110/225] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:12 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:12.653783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2061f73-1e62-4867-9862-1353fa36e949 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:12.727413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91737b7a-667a-428f-9125-c7daeb3ba633 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:12.764289 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ac72f-0e17-43a0-b6a5-5da4a6f5a3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:12.765047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac72f-0e17-43a0-b6a5-5da4a6f5a3aa None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:12.765231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac72f-0e17-43a0-b6a5-5da4a6f5a3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:12.765428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ac72f-0e17-43a0-b6a5-5da4a6f5a3aa None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:12.766148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ac72f-0e17-43a0-b6a5-5da4a6f5a3aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:12.766449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ac72f-0e17-43a0-b6a5-5da4a6f5a3aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:12.766631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2061f73-1e62-4867-9862-1353fa36e949 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:12.767839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ac72f-0e17-43a0-b6a5-5da4a6f5a3aa None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:12.777598 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 116/226] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:12.778495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ac72f-0e17-43a0-b6a5-5da4a6f5a3aa None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:12.804361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:12.811262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b3109-064f-47ab-986a-70556b729b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:12.817171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3109-064f-47ab-986a-70556b729b56 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:12.817171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3109-064f-47ab-986a-70556b729b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:12.817171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b3109-064f-47ab-986a-70556b729b56 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:12.817171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b3109-064f-47ab-986a-70556b729b56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:12.817171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b3109-064f-47ab-986a-70556b729b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:12.817171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b3109-064f-47ab-986a-70556b729b56 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:12.825531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 111/227] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:12.826557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b3109-064f-47ab-986a-70556b729b56 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:12.858462 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:12.890253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ac72f-0e17-43a0-b6a5-5da4a6f5a3aa None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:12.929925 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd02b6-13b4-431f-b068-ab231a03bb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:12.930572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd02b6-13b4-431f-b068-ab231a03bb11 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:12.931311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd02b6-13b4-431f-b068-ab231a03bb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:12.931594 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd02b6-13b4-431f-b068-ab231a03bb11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:12.932360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd02b6-13b4-431f-b068-ab231a03bb11 None admin] RBAC: Adding query filter params (role.id=eb63c7589f0c472b9e1abd79cbdd7528, scope.project.id=5d7a7332da9346c680fa5fdc04291231, user.id=a0dcc554dc0a4b068247cc9ace08c04f) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:12.932671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd02b6-13b4-431f-b068-ab231a03bb11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:12.934222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd02b6-13b4-431f-b068-ab231a03bb11 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:12.941202 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 117/228] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:12 2022] GET /identity/v3/role_assignments?user.id=a0dcc554dc0a4b068247cc9ace08c04f&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:12.946066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd02b6-13b4-431f-b068-ab231a03bb11 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:12.954983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b3109-064f-47ab-986a-70556b729b56 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:13.008893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633980e8-7646-4104-92ab-2363b0034fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:13.009799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633980e8-7646-4104-92ab-2363b0034fff None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:13.010250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633980e8-7646-4104-92ab-2363b0034fff None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:13.010653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633980e8-7646-4104-92ab-2363b0034fff None admin] PATH_INFO: `/v3/users/4727cc049f6c4d00947562113661b8b6` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:13.012386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633980e8-7646-4104-92ab-2363b0034fff None admin] RBAC: Authorizing `identity:get_user(user_id=4727cc049f6c4d00947562113661b8b6)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:13.014054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633980e8-7646-4104-92ab-2363b0034fff None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:13.015867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 112/229] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:12 2022] GET /identity/v3/users/4727cc049f6c4d00947562113661b8b6 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:13.021545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633980e8-7646-4104-92ab-2363b0034fff None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:13.089690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd02b6-13b4-431f-b068-ab231a03bb11 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:13.104772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:13.154511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:13.158937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633980e8-7646-4104-92ab-2363b0034fff None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:13.171739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bef9f-2c61-4dff-b22f-a755207aa1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:13.172496 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bef9f-2c61-4dff-b22f-a755207aa1cb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:13.172846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bef9f-2c61-4dff-b22f-a755207aa1cb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:13.173123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bef9f-2c61-4dff-b22f-a755207aa1cb None admin] PATH_INFO: `/v3/users/4727cc049f6c4d00947562113661b8b6` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:13.175905 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bef9f-2c61-4dff-b22f-a755207aa1cb None admin] RBAC: Authorizing `identity:get_user(user_id=4727cc049f6c4d00947562113661b8b6)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:13.177382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bef9f-2c61-4dff-b22f-a755207aa1cb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:13.179745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 118/230] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:12 2022] GET /identity/v3/users/4727cc049f6c4d00947562113661b8b6 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:13.186081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bef9f-2c61-4dff-b22f-a755207aa1cb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:13.197055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f07aae-654b-4fb4-a190-5f519b9f1514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:13.197673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f07aae-654b-4fb4-a190-5f519b9f1514 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:13.197979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f07aae-654b-4fb4-a190-5f519b9f1514 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:13.198247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f07aae-654b-4fb4-a190-5f519b9f1514 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:13.199409 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f07aae-654b-4fb4-a190-5f519b9f1514 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:13.200855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f07aae-654b-4fb4-a190-5f519b9f1514 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:13.202580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 113/231] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:13 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:13.212263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f07aae-654b-4fb4-a190-5f519b9f1514 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:13.343197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f07aae-654b-4fb4-a190-5f519b9f1514 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:13.388360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:13.404264 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7478b-4338-40bc-97bc-c9cd4d3ef518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:13.405703 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7478b-4338-40bc-97bc-c9cd4d3ef518 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:13.406102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7478b-4338-40bc-97bc-c9cd4d3ef518 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:13.406503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7478b-4338-40bc-97bc-c9cd4d3ef518 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231/users/4727cc049f6c4d00947562113661b8b6/roles/57a8970530a24c16b8d86a333768e765` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:13.411372 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7478b-4338-40bc-97bc-c9cd4d3ef518 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d7a7332da9346c680fa5fdc04291231, user_id=4727cc049f6c4d00947562113661b8b6, role_id=57a8970530a24c16b8d86a333768e765)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:13.412876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7478b-4338-40bc-97bc-c9cd4d3ef518 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:13.430582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bef9f-2c61-4dff-b22f-a755207aa1cb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:13.479744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 114/232] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:16:13 2022] PUT /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231/users/4727cc049f6c4d00947562113661b8b6/roles/57a8970530a24c16b8d86a333768e765 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:16:13.481301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c73d7-a522-4251-964c-cca391afbd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:13.482032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c73d7-a522-4251-964c-cca391afbd18 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:13.482318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c73d7-a522-4251-964c-cca391afbd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:13.482632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c73d7-a522-4251-964c-cca391afbd18 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:13.483768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c73d7-a522-4251-964c-cca391afbd18 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:13.485257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c73d7-a522-4251-964c-cca391afbd18 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:13.486996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 119/233] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:13 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:13.493624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7478b-4338-40bc-97bc-c9cd4d3ef518 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:13.662345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7478b-4338-40bc-97bc-c9cd4d3ef518 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:13.715910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0e6c9-d2a4-4d9b-b102-b541c5913f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:13.716607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0e6c9-d2a4-4d9b-b102-b541c5913f91 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:13.716882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0e6c9-d2a4-4d9b-b102-b541c5913f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:13.717152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0e6c9-d2a4-4d9b-b102-b541c5913f91 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231/users/4727cc049f6c4d00947562113661b8b6/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:13.719192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0e6c9-d2a4-4d9b-b102-b541c5913f91 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d7a7332da9346c680fa5fdc04291231, user_id=4727cc049f6c4d00947562113661b8b6, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:13.720656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0e6c9-d2a4-4d9b-b102-b541c5913f91 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:13.826906 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 115/234] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:16:13 2022] PUT /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231/users/4727cc049f6c4d00947562113661b8b6/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:16:14.309987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546987e3-32fe-4af8-9c8f-ef8c130379f7 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:14.310717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546987e3-32fe-4af8-9c8f-ef8c130379f7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:14.310717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546987e3-32fe-4af8-9c8f-ef8c130379f7 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:14.312210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 120/235] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:14.317934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4f28-7a50-462f-a821-9e5e1354ac03 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:14.318551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4f28-7a50-462f-a821-9e5e1354ac03 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:14.318551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d4f28-7a50-462f-a821-9e5e1354ac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:14.343031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9c9d4f28-7a50-462f-a821-9e5e1354ac03 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:14.346165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9c9d4f28-7a50-462f-a821-9e5e1354ac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:14.412467 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:14.445981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 116/236] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:14.537355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c901-559b-428e-afb2-038771d59f53 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:14.537641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c901-559b-428e-afb2-038771d59f53 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:14.538784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45c901-559b-428e-afb2-038771d59f53 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:14.540426 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 121/237] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:14.557071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907e62-0cbd-4be5-ba2d-6c954a2c6172 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:14.557386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907e62-0cbd-4be5-ba2d-6c954a2c6172 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:14.557632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f907e62-0cbd-4be5-ba2d-6c954a2c6172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:14.581079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5f907e62-0cbd-4be5-ba2d-6c954a2c6172 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:14.582299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5f907e62-0cbd-4be5-ba2d-6c954a2c6172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:14.678100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 117/238] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:14.932203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45c901-559b-428e-afb2-038771d59f53 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:15.024203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:15.068336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45c901-559b-428e-afb2-038771d59f53 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:15.107924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f907e62-0cbd-4be5-ba2d-6c954a2c6172 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:15.121563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d8c6-9b94-4aad-8dbd-fa921ebcc32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:15.122603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d8c6-9b94-4aad-8dbd-fa921ebcc32c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:15.123019 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d8c6-9b94-4aad-8dbd-fa921ebcc32c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:15.123482 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d8c6-9b94-4aad-8dbd-fa921ebcc32c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:15.130084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889d8c6-9b94-4aad-8dbd-fa921ebcc32c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:15.136656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889d8c6-9b94-4aad-8dbd-fa921ebcc32c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:15.138560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 122/239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:15.144140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d8c6-9b94-4aad-8dbd-fa921ebcc32c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:15.303232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d8c6-9b94-4aad-8dbd-fa921ebcc32c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:15.317742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f907e62-0cbd-4be5-ba2d-6c954a2c6172 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:15.330181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:15.359057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891328b1-1c98-4abf-986d-97916e8ceb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:15.359702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891328b1-1c98-4abf-986d-97916e8ceb66 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:15.359983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891328b1-1c98-4abf-986d-97916e8ceb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:15.360256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891328b1-1c98-4abf-986d-97916e8ceb66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:15.376472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891328b1-1c98-4abf-986d-97916e8ceb66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-891328b1-1c98-4abf-986d-97916e8ceb66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:15.384009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:15.385284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:15.386309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 118/240] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:15.392857 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891328b1-1c98-4abf-986d-97916e8ceb66 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:15.431897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa4a0d-a7db-4623-b03c-aa7b7e342e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:15.432618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4a0d-a7db-4623-b03c-aa7b7e342e20 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:15.432820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4a0d-a7db-4623-b03c-aa7b7e342e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:15.433060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4a0d-a7db-4623-b03c-aa7b7e342e20 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:15.433721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa4a0d-a7db-4623-b03c-aa7b7e342e20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:15.435198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa4a0d-a7db-4623-b03c-aa7b7e342e20 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:15.449935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:15.524505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 123/241] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:16:15 2022] POST /identity/v3/users => generated 293 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:16:15.524505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82678-71aa-46cb-b90f-36be809c7618 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:15.524505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82678-71aa-46cb-b90f-36be809c7618 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:15.524505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e82678-71aa-46cb-b90f-36be809c7618 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:15.533254 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 124/242] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:15.535247 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ffdd-5c83-445a-b4c8-01aae0133ee0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:15.535532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ffdd-5c83-445a-b4c8-01aae0133ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:15.535806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6ffdd-5c83-445a-b4c8-01aae0133ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:15.551894 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891328b1-1c98-4abf-986d-97916e8ceb66 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:15.578269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5de6ffdd-5c83-445a-b4c8-01aae0133ee0 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:15.580799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5de6ffdd-5c83-445a-b4c8-01aae0133ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:15.632892 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf33b03-9e03-41e2-8eb8-f64a1417302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:15.633540 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf33b03-9e03-41e2-8eb8-f64a1417302a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:15.633820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf33b03-9e03-41e2-8eb8-f64a1417302a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:15.634111 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf33b03-9e03-41e2-8eb8-f64a1417302a None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:15.638207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf33b03-9e03-41e2-8eb8-f64a1417302a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:15.638662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf33b03-9e03-41e2-8eb8-f64a1417302a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:15.641059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf33b03-9e03-41e2-8eb8-f64a1417302a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:15.668200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 119/243] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:15.677563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf33b03-9e03-41e2-8eb8-f64a1417302a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:15.752619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:15.761233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 125/244] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:15.846758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf33b03-9e03-41e2-8eb8-f64a1417302a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:15.887260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a254-6712-42ed-9fb5-cef5d7d600c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:15.888257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a254-6712-42ed-9fb5-cef5d7d600c9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:15.888762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a254-6712-42ed-9fb5-cef5d7d600c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:15.889242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686a254-6712-42ed-9fb5-cef5d7d600c9 None admin] PATH_INFO: `/v3/users/758e5d82417d47e58877e6553ff821e9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:15.893652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990818d7-3b82-483f-ad27-93888054379d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:15.893652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990818d7-3b82-483f-ad27-93888054379d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:15.893652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990818d7-3b82-483f-ad27-93888054379d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:15.894439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 126/245] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:16:15.902191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056f8d-d873-406a-b7a1-03e653a3d616 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:15.902518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056f8d-d873-406a-b7a1-03e653a3d616 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:15.902977 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056f8d-d873-406a-b7a1-03e653a3d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:15.909830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686a254-6712-42ed-9fb5-cef5d7d600c9 None admin] RBAC: Authorizing `identity:get_user(user_id=758e5d82417d47e58877e6553ff821e9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:15.912675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686a254-6712-42ed-9fb5-cef5d7d600c9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:15.915590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 120/246] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:15 2022] GET /identity/v3/users/758e5d82417d47e58877e6553ff821e9 => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:15.922234 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a254-6712-42ed-9fb5-cef5d7d600c9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:15.930359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-96056f8d-d873-406a-b7a1-03e653a3d616 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:15.932401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-96056f8d-d873-406a-b7a1-03e653a3d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:16.025620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 127/247] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:16.051678 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:16.068223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686a254-6712-42ed-9fb5-cef5d7d600c9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:16.087527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96056f8d-d873-406a-b7a1-03e653a3d616 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:16.128248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f3e0-3446-45ea-b69d-5574b8ee90d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:16.129897 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f3e0-3446-45ea-b69d-5574b8ee90d4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:16.130486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f3e0-3446-45ea-b69d-5574b8ee90d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:16.131199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22f3e0-3446-45ea-b69d-5574b8ee90d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:16.177059 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:16.230360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22f3e0-3446-45ea-b69d-5574b8ee90d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:16.232008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22f3e0-3446-45ea-b69d-5574b8ee90d4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:16.248890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96056f8d-d873-406a-b7a1-03e653a3d616 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:16.302445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1c46-494e-4c8c-9e28-55a412e03cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:16.303353 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1c46-494e-4c8c-9e28-55a412e03cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:16.304340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1c46-494e-4c8c-9e28-55a412e03cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:16.305112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1c46-494e-4c8c-9e28-55a412e03cb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:16.317347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b1c46-494e-4c8c-9e28-55a412e03cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1b3b1c46-494e-4c8c-9e28-55a412e03cb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:16.323332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:16.330888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:16.331865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 128/248] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:16.334419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1c46-494e-4c8c-9e28-55a412e03cb9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:16.367633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:16.386688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 121/249] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:16:16.389993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f3e0-3446-45ea-b69d-5574b8ee90d4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:16.472729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1c46-494e-4c8c-9e28-55a412e03cb9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:16.488479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:16.515160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3c5af-7a30-45dc-a55d-0dff26501422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:16.516232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c5af-7a30-45dc-a55d-0dff26501422 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:16.516422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c5af-7a30-45dc-a55d-0dff26501422 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:16.516818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3c5af-7a30-45dc-a55d-0dff26501422 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:16.517772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3c5af-7a30-45dc-a55d-0dff26501422 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:16.518109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3c5af-7a30-45dc-a55d-0dff26501422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:16.519600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3c5af-7a30-45dc-a55d-0dff26501422 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:16.532021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 129/250] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:16.537903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3c5af-7a30-45dc-a55d-0dff26501422 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:16.542983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22f3e0-3446-45ea-b69d-5574b8ee90d4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:16.596990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64a17-61de-4084-ac1d-89fa1736d2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:16.598549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64a17-61de-4084-ac1d-89fa1736d2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:16.599074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64a17-61de-4084-ac1d-89fa1736d2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:16.599554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64a17-61de-4084-ac1d-89fa1736d2e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:16.614389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb64a17-61de-4084-ac1d-89fa1736d2e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6fb64a17-61de-4084-ac1d-89fa1736d2e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:16.619876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:16.620791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:16.624126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:16.627994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 122/251] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:16:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:16.629564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7cd5-842b-42b3-bcaf-fda8dcd5a148 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:16.630093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7cd5-842b-42b3-bcaf-fda8dcd5a148 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:16.630632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be7cd5-842b-42b3-bcaf-fda8dcd5a148 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:16.632738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 123/252] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:16.633694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7cd5-842b-42b3-bcaf-fda8dcd5a148 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:16.653962 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3c5af-7a30-45dc-a55d-0dff26501422 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:16.693720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f3b89-61c1-4257-8de5-0ab935738167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:16.695010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f3b89-61c1-4257-8de5-0ab935738167 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:16.695269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f3b89-61c1-4257-8de5-0ab935738167 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:16.695635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f3b89-61c1-4257-8de5-0ab935738167 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:16.696802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f3b89-61c1-4257-8de5-0ab935738167 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:16.698351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f3b89-61c1-4257-8de5-0ab935738167 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:16.704928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 130/253] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:16 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:16.706071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f3b89-61c1-4257-8de5-0ab935738167 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:16.721851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:16.752657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:16.777456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be7cd5-842b-42b3-bcaf-fda8dcd5a148 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:16.824776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f3b89-61c1-4257-8de5-0ab935738167 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:16.835331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6096ee34-026a-4a0c-9ecc-9e48e35877d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:16.836286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ee34-026a-4a0c-9ecc-9e48e35877d4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:16.837187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ee34-026a-4a0c-9ecc-9e48e35877d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:16.837677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6096ee34-026a-4a0c-9ecc-9e48e35877d4 None admin] PATH_INFO: `/v3/users/a0dcc554dc0a4b068247cc9ace08c04f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:16.839720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096ee34-026a-4a0c-9ecc-9e48e35877d4 None admin] RBAC: Authorizing `identity:get_user(user_id=a0dcc554dc0a4b068247cc9ace08c04f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:16.841607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6096ee34-026a-4a0c-9ecc-9e48e35877d4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:16.844541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 124/254] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:16 2022] GET /identity/v3/users/a0dcc554dc0a4b068247cc9ace08c04f => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:16.846299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44370c9-80d3-4eaf-a9c3-3bd2634c28ef None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:16.846797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44370c9-80d3-4eaf-a9c3-3bd2634c28ef None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:16.847292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44370c9-80d3-4eaf-a9c3-3bd2634c28ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:16.864345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac9814-4c48-4ea3-a36a-b4bf44206bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:16.864968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac9814-4c48-4ea3-a36a-b4bf44206bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:16.865292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac9814-4c48-4ea3-a36a-b4bf44206bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:16.865565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac9814-4c48-4ea3-a36a-b4bf44206bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:16.866407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac9814-4c48-4ea3-a36a-b4bf44206bb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:16.866726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac9814-4c48-4ea3-a36a-b4bf44206bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:16.868173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac9814-4c48-4ea3-a36a-b4bf44206bb3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:16.872235 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e44370c9-80d3-4eaf-a9c3-3bd2634c28ef None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:16.873729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e44370c9-80d3-4eaf-a9c3-3bd2634c28ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:16.878833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 131/255] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:16.879013 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac9814-4c48-4ea3-a36a-b4bf44206bb3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:16.963990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 125/256] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:16.965045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44370c9-80d3-4eaf-a9c3-3bd2634c28ef None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:17.020111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac9814-4c48-4ea3-a36a-b4bf44206bb3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:17.024511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:17.027124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:17.059103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ea6a-bb62-4c0f-8d5d-1d546c661425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:17.059867 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ea6a-bb62-4c0f-8d5d-1d546c661425 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:17.060223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ea6a-bb62-4c0f-8d5d-1d546c661425 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:17.060567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776ea6a-bb62-4c0f-8d5d-1d546c661425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:17.061479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776ea6a-bb62-4c0f-8d5d-1d546c661425 None admin] RBAC: Adding query filter params (role.id=7bc837d3251a4691ac770e5a176c2218, scope.project.id=5d7a7332da9346c680fa5fdc04291231, user.id=758e5d82417d47e58877e6553ff821e9) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:17.061919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776ea6a-bb62-4c0f-8d5d-1d546c661425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:17.063626 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776ea6a-bb62-4c0f-8d5d-1d546c661425 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:17.078329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 132/257] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:16 2022] GET /identity/v3/role_assignments?user.id=758e5d82417d47e58877e6553ff821e9&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=7bc837d3251a4691ac770e5a176c2218 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:17.079441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ea6a-bb62-4c0f-8d5d-1d546c661425 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:17.110895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44370c9-80d3-4eaf-a9c3-3bd2634c28ef None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:17.177426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dc7ff-06d0-4acc-9083-fbd6d84e4ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:17.178536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dc7ff-06d0-4acc-9083-fbd6d84e4ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:17.179023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dc7ff-06d0-4acc-9083-fbd6d84e4ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:17.179627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dc7ff-06d0-4acc-9083-fbd6d84e4ea6 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:17.181197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dc7ff-06d0-4acc-9083-fbd6d84e4ea6 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:17.182971 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dc7ff-06d0-4acc-9083-fbd6d84e4ea6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:17.185615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 126/258] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:16 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:17.190937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dc7ff-06d0-4acc-9083-fbd6d84e4ea6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:17.325166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dc7ff-06d0-4acc-9083-fbd6d84e4ea6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:17.340424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776ea6a-bb62-4c0f-8d5d-1d546c661425 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:17.398348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:17.438430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386501d0-ac6c-4332-b180-4bcc88d12532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:17.439448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386501d0-ac6c-4332-b180-4bcc88d12532 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:17.439942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386501d0-ac6c-4332-b180-4bcc88d12532 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:17.440423 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386501d0-ac6c-4332-b180-4bcc88d12532 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231/users/a0dcc554dc0a4b068247cc9ace08c04f/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:17.447280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386501d0-ac6c-4332-b180-4bcc88d12532 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d7a7332da9346c680fa5fdc04291231, user_id=a0dcc554dc0a4b068247cc9ace08c04f, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:17.447544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c098e61-d567-42b4-8272-2fb8d1755386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:17.448137 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c098e61-d567-42b4-8272-2fb8d1755386 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:17.448422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c098e61-d567-42b4-8272-2fb8d1755386 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:17.448697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c098e61-d567-42b4-8272-2fb8d1755386 None admin] PATH_INFO: `/v3/users/4727cc049f6c4d00947562113661b8b6` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:17.449811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386501d0-ac6c-4332-b180-4bcc88d12532 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:17.449934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c098e61-d567-42b4-8272-2fb8d1755386 None admin] RBAC: Authorizing `identity:get_user(user_id=4727cc049f6c4d00947562113661b8b6)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:17.451323 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c098e61-d567-42b4-8272-2fb8d1755386 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:17.458893 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 133/259] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:17 2022] GET /identity/v3/users/4727cc049f6c4d00947562113661b8b6 => generated 283 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:17.465266 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c098e61-d567-42b4-8272-2fb8d1755386 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:17.512340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:17.522597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 127/260] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:16:17 2022] PUT /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231/users/a0dcc554dc0a4b068247cc9ace08c04f/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:16:17.523816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386501d0-ac6c-4332-b180-4bcc88d12532 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:17.682672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c098e61-d567-42b4-8272-2fb8d1755386 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:17.703290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386501d0-ac6c-4332-b180-4bcc88d12532 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:17.757301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef55a0-60e1-4322-abbf-8b09366e0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:17.758439 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef55a0-60e1-4322-abbf-8b09366e0110 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:17.758896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef55a0-60e1-4322-abbf-8b09366e0110 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:17.759364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef55a0-60e1-4322-abbf-8b09366e0110 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:17.785704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef55a0-60e1-4322-abbf-8b09366e0110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:17.794605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19930f-f09b-4eaf-a877-38c0f2cf2c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:17.795239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19930f-f09b-4eaf-a877-38c0f2cf2c98 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:17.795521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19930f-f09b-4eaf-a877-38c0f2cf2c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:17.795796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19930f-f09b-4eaf-a877-38c0f2cf2c98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-84ef55a0-60e1-4322-abbf-8b09366e0110 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:17.799251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:17.800407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:17.801229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 128/261] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:16:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:17.807133 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef55a0-60e1-4322-abbf-8b09366e0110 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:17.852324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:17.965221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19930f-f09b-4eaf-a877-38c0f2cf2c98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:17.967988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19930f-f09b-4eaf-a877-38c0f2cf2c98 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:18.013999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef55a0-60e1-4322-abbf-8b09366e0110 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:18.077091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:18.122001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20026-6dae-49f7-a340-a42f0c17831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:18.122631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20026-6dae-49f7-a340-a42f0c17831b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:18.122964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20026-6dae-49f7-a340-a42f0c17831b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:18.123234 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b20026-6dae-49f7-a340-a42f0c17831b None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:18.123917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20026-6dae-49f7-a340-a42f0c17831b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:18.124289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20026-6dae-49f7-a340-a42f0c17831b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:18.127504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b20026-6dae-49f7-a340-a42f0c17831b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:18.139257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 129/262] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:18.144766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20026-6dae-49f7-a340-a42f0c17831b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:18.180600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 134/263] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:16:18.186876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19930f-f09b-4eaf-a877-38c0f2cf2c98 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:18.329222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19930f-f09b-4eaf-a877-38c0f2cf2c98 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:18.350806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:18.358167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b20026-6dae-49f7-a340-a42f0c17831b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:18.382978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66934699-2978-4acd-b216-e03ed22a49ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:18.384034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66934699-2978-4acd-b216-e03ed22a49ed None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:18.384634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66934699-2978-4acd-b216-e03ed22a49ed None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:18.385120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66934699-2978-4acd-b216-e03ed22a49ed None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:18.390770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66934699-2978-4acd-b216-e03ed22a49ed None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:18.392694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66934699-2978-4acd-b216-e03ed22a49ed None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:18.394684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 135/264] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:18 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:18.400785 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66934699-2978-4acd-b216-e03ed22a49ed None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:18.410342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:18.418638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a169cc2-db09-47d7-94e4-04a08faf0525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:18.419304 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a169cc2-db09-47d7-94e4-04a08faf0525 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:18.419593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a169cc2-db09-47d7-94e4-04a08faf0525 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:18.419875 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a169cc2-db09-47d7-94e4-04a08faf0525 None admin] PATH_INFO: `/v3/users/4727cc049f6c4d00947562113661b8b6` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:18.421157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a169cc2-db09-47d7-94e4-04a08faf0525 None admin] RBAC: Authorizing `identity:get_user(user_id=4727cc049f6c4d00947562113661b8b6)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:18.426141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a169cc2-db09-47d7-94e4-04a08faf0525 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:18.426141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 130/265] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:18 2022] GET /identity/v3/users/4727cc049f6c4d00947562113661b8b6 => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:18.430456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a169cc2-db09-47d7-94e4-04a08faf0525 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:18.655816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66934699-2978-4acd-b216-e03ed22a49ed None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:18.672900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a169cc2-db09-47d7-94e4-04a08faf0525 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:18.718495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598b56-79a5-41f5-926f-139c5467ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:18.719461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598b56-79a5-41f5-926f-139c5467ba9b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:18.719849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598b56-79a5-41f5-926f-139c5467ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:18.720120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598b56-79a5-41f5-926f-139c5467ba9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:18.720854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598b56-79a5-41f5-926f-139c5467ba9b None admin] RBAC: Adding query filter params (role.id=57a8970530a24c16b8d86a333768e765, scope.project.id=5d7a7332da9346c680fa5fdc04291231, user.id=4727cc049f6c4d00947562113661b8b6) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:18.721226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598b56-79a5-41f5-926f-139c5467ba9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:18.722897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598b56-79a5-41f5-926f-139c5467ba9b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:18.723301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936d3f1-80c5-4f48-8856-4fce73728f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:18.723995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936d3f1-80c5-4f48-8856-4fce73728f03 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:18.724343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936d3f1-80c5-4f48-8856-4fce73728f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:18.724690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936d3f1-80c5-4f48-8856-4fce73728f03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:18.731993 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 136/266] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:18 2022] GET /identity/v3/role_assignments?user.id=4727cc049f6c4d00947562113661b8b6&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=57a8970530a24c16b8d86a333768e765 => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:18.733376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec4f4f-89e7-4c8c-99f4-29e860c20a98 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:18.733722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec4f4f-89e7-4c8c-99f4-29e860c20a98 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:18.734086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec4f4f-89e7-4c8c-99f4-29e860c20a98 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:18.735652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 137/267] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:18.736806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d696d-1b2f-47cd-94d6-97ee2b393297 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:18.737150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d696d-1b2f-47cd-94d6-97ee2b393297 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:18.737483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d696d-1b2f-47cd-94d6-97ee2b393297 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:18.739144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 138/268] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:18.742942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9f98-81a7-4b8d-b70d-2b198c714c18 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:18.743227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9f98-81a7-4b8d-b70d-2b198c714c18 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:18.743836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9f98-81a7-4b8d-b70d-2b198c714c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:18.786924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7f4a9f98-81a7-4b8d-b70d-2b198c714c18 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:18.790319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7f4a9f98-81a7-4b8d-b70d-2b198c714c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:18.796323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:18.890848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936d3f1-80c5-4f48-8856-4fce73728f03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:18.892474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936d3f1-80c5-4f48-8856-4fce73728f03 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:18.917895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:18.934860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 139/269] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:18.943301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d96b-6b46-4306-a675-cbf2ea118b42 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:18.943836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d96b-6b46-4306-a675-cbf2ea118b42 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:18.949899 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d96b-6b46-4306-a675-cbf2ea118b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:18.968155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ba70d96b-6b46-4306-a675-cbf2ea118b42 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:18.969341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ba70d96b-6b46-4306-a675-cbf2ea118b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:19.074025 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 140/270] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:19.091810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 131/271] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:19.105936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70d96b-6b46-4306-a675-cbf2ea118b42 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:19.258809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70d96b-6b46-4306-a675-cbf2ea118b42 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:19.298278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:19.307852 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd6523-df88-4e0c-b633-7d123473c81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:19.308500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd6523-df88-4e0c-b633-7d123473c81f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:19.308810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd6523-df88-4e0c-b633-7d123473c81f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:19.309086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd6523-df88-4e0c-b633-7d123473c81f None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:19.310718 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd6523-df88-4e0c-b633-7d123473c81f None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:19.312238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd6523-df88-4e0c-b633-7d123473c81f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:19.318136 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 141/272] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:19 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:19.325815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936d3f1-80c5-4f48-8856-4fce73728f03 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:19.354259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd6523-df88-4e0c-b633-7d123473c81f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:19.431979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:19.477335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936d3f1-80c5-4f48-8856-4fce73728f03 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:19.517996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd6523-df88-4e0c-b633-7d123473c81f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:19.531895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee0eae-8e7c-4c93-9543-31b965188112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:19.532516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee0eae-8e7c-4c93-9543-31b965188112 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:19.532793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee0eae-8e7c-4c93-9543-31b965188112 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:19.533063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee0eae-8e7c-4c93-9543-31b965188112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:19.533800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee0eae-8e7c-4c93-9543-31b965188112 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=5d7a7332da9346c680fa5fdc04291231, user.id=4727cc049f6c4d00947562113661b8b6) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:19.534184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee0eae-8e7c-4c93-9543-31b965188112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:19.537032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee0eae-8e7c-4c93-9543-31b965188112 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:19.544311 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 132/273] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:19 2022] GET /identity/v3/role_assignments?user.id=4727cc049f6c4d00947562113661b8b6&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:19.545407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee0eae-8e7c-4c93-9543-31b965188112 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:19.577635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144c1d2-27de-4a22-b465-a7be57a989da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:19.578319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144c1d2-27de-4a22-b465-a7be57a989da None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:19.578593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144c1d2-27de-4a22-b465-a7be57a989da None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:19.578858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144c1d2-27de-4a22-b465-a7be57a989da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:19.581914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144c1d2-27de-4a22-b465-a7be57a989da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:19.583555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144c1d2-27de-4a22-b465-a7be57a989da None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:19.590188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 142/274] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:19.591381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144c1d2-27de-4a22-b465-a7be57a989da None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:19.685045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee0eae-8e7c-4c93-9543-31b965188112 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:19.710289 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:19.750669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:19.767928 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a434-fe07-46ea-a550-93436eec49d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:19.768633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a434-fe07-46ea-a550-93436eec49d5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:19.768855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a434-fe07-46ea-a550-93436eec49d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:19.769138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148a434-fe07-46ea-a550-93436eec49d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:19.782259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144c1d2-27de-4a22-b465-a7be57a989da None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:19.784936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148a434-fe07-46ea-a550-93436eec49d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-4148a434-fe07-46ea-a550-93436eec49d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:19.793059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:19.794041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:19.794841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:19.797387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 133/275] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:19.803328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a434-fe07-46ea-a550-93436eec49d5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:19.822292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c5401-c47d-48c9-b782-7bc005727138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:19.822784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5401-c47d-48c9-b782-7bc005727138 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:19.823111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5401-c47d-48c9-b782-7bc005727138 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:19.823314 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c5401-c47d-48c9-b782-7bc005727138 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:19.823956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c5401-c47d-48c9-b782-7bc005727138 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:19.825498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c5401-c47d-48c9-b782-7bc005727138 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:19.933165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 143/276] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:16:19 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:16:19.933165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5366191-86d0-4c83-8c89-e05f75136ba6 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:19.933165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5366191-86d0-4c83-8c89-e05f75136ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:19.933497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148a434-fe07-46ea-a550-93436eec49d5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:19.933595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5366191-86d0-4c83-8c89-e05f75136ba6 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:19.934606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 144/277] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:19.950738 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db696-113c-4a53-9f46-4c4fe44996b0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:19.951079 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db696-113c-4a53-9f46-4c4fe44996b0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:19.951422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4db696-113c-4a53-9f46-4c4fe44996b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:19.974325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803de540-44e9-4168-98f7-d0722c3756e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:19.974943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803de540-44e9-4168-98f7-d0722c3756e7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:19.975380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803de540-44e9-4168-98f7-d0722c3756e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:19.975637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803de540-44e9-4168-98f7-d0722c3756e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:19.976397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803de540-44e9-4168-98f7-d0722c3756e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:19.977017 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803de540-44e9-4168-98f7-d0722c3756e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:19.979155 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803de540-44e9-4168-98f7-d0722c3756e7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:19.986458 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ed4db696-113c-4a53-9f46-4c4fe44996b0 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:19.987743 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ed4db696-113c-4a53-9f46-4c4fe44996b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:19.991489 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 134/278] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:19.997148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803de540-44e9-4168-98f7-d0722c3756e7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:20.073630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 145/279] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:20.078296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:20.135779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511818-8c8b-4b69-93c9-e7c624457402 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:20.136384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511818-8c8b-4b69-93c9-e7c624457402 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:20.136770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803de540-44e9-4168-98f7-d0722c3756e7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:20.137058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511818-8c8b-4b69-93c9-e7c624457402 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:20.139569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 146/280] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:16:20.144780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca7fb-0f71-4ac7-b123-a61d86bb2e1b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:20.145061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca7fb-0f71-4ac7-b123-a61d86bb2e1b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:20.145338 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abca7fb-0f71-4ac7-b123-a61d86bb2e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:20.168400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8abca7fb-0f71-4ac7-b123-a61d86bb2e1b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:20.170471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8abca7fb-0f71-4ac7-b123-a61d86bb2e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:20.182165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b80874-0cfc-4225-8b39-95f83f5419b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:20.183283 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b80874-0cfc-4225-8b39-95f83f5419b2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:20.183631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b80874-0cfc-4225-8b39-95f83f5419b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:20.183977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b80874-0cfc-4225-8b39-95f83f5419b2 None admin] PATH_INFO: `/v3/users/faa8f16d472b41eb9826abcbf1f32577` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:20.201739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b80874-0cfc-4225-8b39-95f83f5419b2 None admin] RBAC: Authorizing `identity:get_user(user_id=faa8f16d472b41eb9826abcbf1f32577)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:20.204294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b80874-0cfc-4225-8b39-95f83f5419b2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:20.207243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 135/281] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:19 2022] GET /identity/v3/users/faa8f16d472b41eb9826abcbf1f32577 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:20.214598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b80874-0cfc-4225-8b39-95f83f5419b2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:20.239509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:20.277952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 147/282] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:20.350744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b80874-0cfc-4225-8b39-95f83f5419b2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:20.354090 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abca7fb-0f71-4ac7-b123-a61d86bb2e1b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:20.365183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:20.401444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70305ddd-aa2d-463c-8762-bb71e3ab24e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:20.403259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70305ddd-aa2d-463c-8762-bb71e3ab24e8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:20.403740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70305ddd-aa2d-463c-8762-bb71e3ab24e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:20.404250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70305ddd-aa2d-463c-8762-bb71e3ab24e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:20.405182 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70305ddd-aa2d-463c-8762-bb71e3ab24e8 None admin] RBAC: Adding query filter params (role.id=eb63c7589f0c472b9e1abd79cbdd7528, user.id=faa8f16d472b41eb9826abcbf1f32577, scope.system=all) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:20.405667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70305ddd-aa2d-463c-8762-bb71e3ab24e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:20.407387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70305ddd-aa2d-463c-8762-bb71e3ab24e8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:20.416393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 136/283] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Sep 1 16:16:20 2022] GET /identity/v3/role_assignments?user.id=faa8f16d472b41eb9826abcbf1f32577&scope.system=all&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:20.487568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abca7fb-0f71-4ac7-b123-a61d86bb2e1b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:20.527327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd9d79-d85b-4827-ab41-ad44685cab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:20.527989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9d79-d85b-4827-ab41-ad44685cab3d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:20.528388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9d79-d85b-4827-ab41-ad44685cab3d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:20.528741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd9d79-d85b-4827-ab41-ad44685cab3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:20.541318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd9d79-d85b-4827-ab41-ad44685cab3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-5ccd9d79-d85b-4827-ab41-ad44685cab3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:20.546454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:20.547414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:20.548197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 148/284] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:20.553792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70305ddd-aa2d-463c-8762-bb71e3ab24e8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:20.603433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd9d79-d85b-4827-ab41-ad44685cab3d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:20.678247 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:20.690880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70305ddd-aa2d-463c-8762-bb71e3ab24e8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:20.730156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a1b8b-6590-4424-8c98-73c1cb7d9f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:20.730777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1b8b-6590-4424-8c98-73c1cb7d9f33 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:20.731056 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1b8b-6590-4424-8c98-73c1cb7d9f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:20.731325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1b8b-6590-4424-8c98-73c1cb7d9f33 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:20.732000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a1b8b-6590-4424-8c98-73c1cb7d9f33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:20.732300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a1b8b-6590-4424-8c98-73c1cb7d9f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:20.734074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a1b8b-6590-4424-8c98-73c1cb7d9f33 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:20.746715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 137/285] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:20.759207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a1b8b-6590-4424-8c98-73c1cb7d9f33 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:20.774874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd9d79-d85b-4827-ab41-ad44685cab3d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:20.826271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:20.838715 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c8672-fa0c-498b-a6f7-e723cff9f49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:20.839736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8672-fa0c-498b-a6f7-e723cff9f49b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:20.840209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8672-fa0c-498b-a6f7-e723cff9f49b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:20.840679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8672-fa0c-498b-a6f7-e723cff9f49b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:20.860572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c8672-fa0c-498b-a6f7-e723cff9f49b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4f0c8672-fa0c-498b-a6f7-e723cff9f49b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:20.868126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:20.869112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:20.869943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 149/286] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:20.876740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c8672-fa0c-498b-a6f7-e723cff9f49b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:20.921952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a1b8b-6590-4424-8c98-73c1cb7d9f33 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:20.966095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eea25b-12ef-49cb-bbd4-3d23c04e60b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:20.967170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eea25b-12ef-49cb-bbd4-3d23c04e60b4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:20.968490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eea25b-12ef-49cb-bbd4-3d23c04e60b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:20.970126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eea25b-12ef-49cb-bbd4-3d23c04e60b4 None admin] PATH_INFO: `/v3/users/758e5d82417d47e58877e6553ff821e9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:20.971676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eea25b-12ef-49cb-bbd4-3d23c04e60b4 None admin] RBAC: Authorizing `identity:get_user(user_id=758e5d82417d47e58877e6553ff821e9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:20.976547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eea25b-12ef-49cb-bbd4-3d23c04e60b4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:20.980162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 138/287] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:20 2022] GET /identity/v3/users/758e5d82417d47e58877e6553ff821e9 => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:20.988059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eea25b-12ef-49cb-bbd4-3d23c04e60b4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:21.065771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:21.071537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c8672-fa0c-498b-a6f7-e723cff9f49b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:21.159642 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0810f6-1884-4ff6-9c55-d1fc22814fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:21.160284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0810f6-1884-4ff6-9c55-d1fc22814fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:21.160567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0810f6-1884-4ff6-9c55-d1fc22814fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:21.160839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0810f6-1884-4ff6-9c55-d1fc22814fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:21.161515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0810f6-1884-4ff6-9c55-d1fc22814fd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:21.161817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0810f6-1884-4ff6-9c55-d1fc22814fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:21.163491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0810f6-1884-4ff6-9c55-d1fc22814fd9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:21.171856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eea25b-12ef-49cb-bbd4-3d23c04e60b4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:21.173829 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:21.184517 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 150/288] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:21.190956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0810f6-1884-4ff6-9c55-d1fc22814fd9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:21.234937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f8aaf-4fff-443a-85e9-8e001280e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:21.238988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f8aaf-4fff-443a-85e9-8e001280e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:21.239457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f8aaf-4fff-443a-85e9-8e001280e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:21.239909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f8aaf-4fff-443a-85e9-8e001280e6c0 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:21.241347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f8aaf-4fff-443a-85e9-8e001280e6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:21.244889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f8aaf-4fff-443a-85e9-8e001280e6c0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:21.250883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 139/289] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:20 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:21.254604 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f8aaf-4fff-443a-85e9-8e001280e6c0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:21.361722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0810f6-1884-4ff6-9c55-d1fc22814fd9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:21.404775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb82881-969e-407c-9b00-1f182ff799f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:21.405419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82881-969e-407c-9b00-1f182ff799f8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:21.405685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82881-969e-407c-9b00-1f182ff799f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:21.405978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82881-969e-407c-9b00-1f182ff799f8 None admin] PATH_INFO: `/v3/users/a0dcc554dc0a4b068247cc9ace08c04f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:21.414835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb82881-969e-407c-9b00-1f182ff799f8 None admin] RBAC: Authorizing `identity:get_user(user_id=a0dcc554dc0a4b068247cc9ace08c04f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:21.416245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb82881-969e-407c-9b00-1f182ff799f8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:21.418305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 151/290] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:21 2022] GET /identity/v3/users/a0dcc554dc0a4b068247cc9ace08c04f => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:21.438944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb82881-969e-407c-9b00-1f182ff799f8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:21.482346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f8aaf-4fff-443a-85e9-8e001280e6c0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:21.539689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc56ca-be26-43d9-a829-8c3794555b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:21.540371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc56ca-be26-43d9-a829-8c3794555b44 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:21.540648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc56ca-be26-43d9-a829-8c3794555b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:21.540916 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc56ca-be26-43d9-a829-8c3794555b44 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231/users/758e5d82417d47e58877e6553ff821e9/roles/7bc837d3251a4691ac770e5a176c2218` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:21.543851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc56ca-be26-43d9-a829-8c3794555b44 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d7a7332da9346c680fa5fdc04291231, user_id=758e5d82417d47e58877e6553ff821e9, role_id=7bc837d3251a4691ac770e5a176c2218)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:21.545327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc56ca-be26-43d9-a829-8c3794555b44 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:21.547747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:21.630509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 140/291] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:16:21 2022] PUT /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231/users/758e5d82417d47e58877e6553ff821e9/roles/7bc837d3251a4691ac770e5a176c2218 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:16:21.642825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb82881-969e-407c-9b00-1f182ff799f8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:21.690891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182587b-2bbc-4b44-8465-e0d57d51af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:21.691450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182587b-2bbc-4b44-8465-e0d57d51af40 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:21.691725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182587b-2bbc-4b44-8465-e0d57d51af40 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:21.691991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182587b-2bbc-4b44-8465-e0d57d51af40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:21.801544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182587b-2bbc-4b44-8465-e0d57d51af40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:21.804065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182587b-2bbc-4b44-8465-e0d57d51af40 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:21.858304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:21.933831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 152/292] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:21.939726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc56ca-be26-43d9-a829-8c3794555b44 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:22.000702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:22.090770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc56ca-be26-43d9-a829-8c3794555b44 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:22.144312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2afd6c-2942-4e19-93ed-a1f66c837de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:22.145000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2afd6c-2942-4e19-93ed-a1f66c837de4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:22.145277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2afd6c-2942-4e19-93ed-a1f66c837de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:22.145602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2afd6c-2942-4e19-93ed-a1f66c837de4 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:22.150659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2afd6c-2942-4e19-93ed-a1f66c837de4 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:22.152140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2afd6c-2942-4e19-93ed-a1f66c837de4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:22.153835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 141/293] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:21 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:22.159685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182587b-2bbc-4b44-8465-e0d57d51af40 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:22.312032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182587b-2bbc-4b44-8465-e0d57d51af40 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:22.354379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:22.362681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5573e0c-f128-45e1-879a-b39ec7a9da8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:22.363324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5573e0c-f128-45e1-879a-b39ec7a9da8f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:22.363603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5573e0c-f128-45e1-879a-b39ec7a9da8f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:22.363874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5573e0c-f128-45e1-879a-b39ec7a9da8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:22.364618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5573e0c-f128-45e1-879a-b39ec7a9da8f None admin] RBAC: Adding query filter params (role.id=eb63c7589f0c472b9e1abd79cbdd7528, scope.project.id=5d7a7332da9346c680fa5fdc04291231, user.id=a0dcc554dc0a4b068247cc9ace08c04f) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:22.364926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5573e0c-f128-45e1-879a-b39ec7a9da8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:22.367382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5573e0c-f128-45e1-879a-b39ec7a9da8f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:22.374651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 153/294] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:22 2022] GET /identity/v3/role_assignments?user.id=a0dcc554dc0a4b068247cc9ace08c04f&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:22.630656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35079-33b7-4aca-b6e7-49a293498028 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:22.631149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35079-33b7-4aca-b6e7-49a293498028 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:22.631419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a35079-33b7-4aca-b6e7-49a293498028 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:22.633817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 142/295] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:22.640527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a62d-510b-4b97-823b-cbc9f8fcc55e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:22.640942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a62d-510b-4b97-823b-cbc9f8fcc55e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:22.641331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8865a62d-510b-4b97-823b-cbc9f8fcc55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:22.667342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8865a62d-510b-4b97-823b-cbc9f8fcc55e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:22.668563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8865a62d-510b-4b97-823b-cbc9f8fcc55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:22.759812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 154/296] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:22.792851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacc2a7-5c39-4b2b-872e-d720e7c315bb None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:22.793459 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacc2a7-5c39-4b2b-872e-d720e7c315bb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:22.794069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacc2a7-5c39-4b2b-872e-d720e7c315bb None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:22.796735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 143/297] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:22.801148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54f09c-20b1-4b73-9586-edcff779c133 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:22.801424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54f09c-20b1-4b73-9586-edcff779c133 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:22.801703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54f09c-20b1-4b73-9586-edcff779c133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:22.822793 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-be54f09c-20b1-4b73-9586-edcff779c133 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:22.824595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-be54f09c-20b1-4b73-9586-edcff779c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:22.856357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7be019-9289-4de1-8ca9-82fef6e7301f None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:22.857005 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7be019-9289-4de1-8ca9-82fef6e7301f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:22.857469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7be019-9289-4de1-8ca9-82fef6e7301f None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:22.861986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 144/298] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:22.865213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7450d7-c21b-4df0-bac9-8579e0e95fff None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:22.865704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7450d7-c21b-4df0-bac9-8579e0e95fff None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:22.867258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7450d7-c21b-4df0-bac9-8579e0e95fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:22.894756 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5f7450d7-c21b-4df0-bac9-8579e0e95fff None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:22.896271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5f7450d7-c21b-4df0-bac9-8579e0e95fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:22.905008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 155/299] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:23.002883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 145/300] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:23.065921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54f09c-20b1-4b73-9586-edcff779c133 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:23.146345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:23.176640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54f09c-20b1-4b73-9586-edcff779c133 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:23.204643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7450d7-c21b-4df0-bac9-8579e0e95fff None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:23.220981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cd82c-2ca6-499d-9538-4cbbe814bcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:23.221800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cd82c-2ca6-499d-9538-4cbbe814bcdb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:23.222112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cd82c-2ca6-499d-9538-4cbbe814bcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:23.222389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cd82c-2ca6-499d-9538-4cbbe814bcdb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:23.237327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:23.237511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3cd82c-2ca6-499d-9538-4cbbe814bcdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9c3cd82c-2ca6-499d-9538-4cbbe814bcdb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:23.245236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:23.251919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:23.253023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 156/301] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:23.253685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cd82c-2ca6-499d-9538-4cbbe814bcdb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:23.333591 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7450d7-c21b-4df0-bac9-8579e0e95fff None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:23.371903 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941dfd1-4fb1-497c-913f-97d20200de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:23.372544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941dfd1-4fb1-497c-913f-97d20200de28 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:23.372824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941dfd1-4fb1-497c-913f-97d20200de28 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:23.373092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941dfd1-4fb1-497c-913f-97d20200de28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:23.385368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941dfd1-4fb1-497c-913f-97d20200de28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-5941dfd1-4fb1-497c-913f-97d20200de28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:23.390267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:23.391168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:23.391995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:23.396177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 146/302] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:23.398170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941dfd1-4fb1-497c-913f-97d20200de28 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:23.422764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cd82c-2ca6-499d-9538-4cbbe814bcdb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:23.440060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:23.463921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d7e4f-6548-46f9-bbaa-e7de441d7b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:23.464537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d7e4f-6548-46f9-bbaa-e7de441d7b57 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:23.464813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d7e4f-6548-46f9-bbaa-e7de441d7b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:23.465081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d7e4f-6548-46f9-bbaa-e7de441d7b57 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:23.465742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d7e4f-6548-46f9-bbaa-e7de441d7b57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:23.466089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d7e4f-6548-46f9-bbaa-e7de441d7b57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:23.467501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d7e4f-6548-46f9-bbaa-e7de441d7b57 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:23.477161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 157/303] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:23.479797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d7e4f-6548-46f9-bbaa-e7de441d7b57 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:23.500049 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:23.514429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941dfd1-4fb1-497c-913f-97d20200de28 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:23.558903 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e45b1-43b9-4c6b-9b03-89b6a21c291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:23.559817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e45b1-43b9-4c6b-9b03-89b6a21c291f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:23.560091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e45b1-43b9-4c6b-9b03-89b6a21c291f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:23.560363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e45b1-43b9-4c6b-9b03-89b6a21c291f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:23.561532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e45b1-43b9-4c6b-9b03-89b6a21c291f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:23.563012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e45b1-43b9-4c6b-9b03-89b6a21c291f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:23.569260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 147/304] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:23.570193 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e45b1-43b9-4c6b-9b03-89b6a21c291f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:23.603567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d7e4f-6548-46f9-bbaa-e7de441d7b57 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:23.642006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1e29e-d632-43db-b54f-af3b2ee7dc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:23.642620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1e29e-d632-43db-b54f-af3b2ee7dc12 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:23.642901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1e29e-d632-43db-b54f-af3b2ee7dc12 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:23.643172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1e29e-d632-43db-b54f-af3b2ee7dc12 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:23.643829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1e29e-d632-43db-b54f-af3b2ee7dc12 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:23.644136 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1e29e-d632-43db-b54f-af3b2ee7dc12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:23.645503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1e29e-d632-43db-b54f-af3b2ee7dc12 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:23.655678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 158/305] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:23.660959 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1e29e-d632-43db-b54f-af3b2ee7dc12 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:23.687057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e45b1-43b9-4c6b-9b03-89b6a21c291f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:23.708322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:23.725214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890657a-38a6-494d-8820-da124ed98f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:23.725935 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890657a-38a6-494d-8820-da124ed98f06 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:23.726289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890657a-38a6-494d-8820-da124ed98f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:23.726675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890657a-38a6-494d-8820-da124ed98f06 None admin] PATH_INFO: `/v3/users/f476766d0edb4757acf56a8f8c984c2e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:23.745580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890657a-38a6-494d-8820-da124ed98f06 None admin] RBAC: Authorizing `identity:get_user(user_id=f476766d0edb4757acf56a8f8c984c2e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:23.747088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890657a-38a6-494d-8820-da124ed98f06 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:23.748794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 148/306] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:23 2022] GET /identity/v3/users/f476766d0edb4757acf56a8f8c984c2e => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:23.750744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890657a-38a6-494d-8820-da124ed98f06 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:23.771184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:23.785819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1e29e-d632-43db-b54f-af3b2ee7dc12 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:23.825667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7ff96-2315-4c87-abb5-c2bef095d8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:23.826446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7ff96-2315-4c87-abb5-c2bef095d8d7 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:23.826799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7ff96-2315-4c87-abb5-c2bef095d8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:23.827138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7ff96-2315-4c87-abb5-c2bef095d8d7 None admin] PATH_INFO: `/v3/groups` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:23.827842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7ff96-2315-4c87-abb5-c2bef095d8d7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:23.829291 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7ff96-2315-4c87-abb5-c2bef095d8d7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:23.864346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890657a-38a6-494d-8820-da124ed98f06 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:23.900404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cdbf8-c84a-47b4-8269-1632c3130527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:23.901044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cdbf8-c84a-47b4-8269-1632c3130527 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:23.901328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cdbf8-c84a-47b4-8269-1632c3130527 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:23.901596 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cdbf8-c84a-47b4-8269-1632c3130527 None admin] PATH_INFO: `/v3/users/faa8f16d472b41eb9826abcbf1f32577` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:23.902758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cdbf8-c84a-47b4-8269-1632c3130527 None admin] RBAC: Authorizing `identity:get_user(user_id=faa8f16d472b41eb9826abcbf1f32577)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:23.904300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cdbf8-c84a-47b4-8269-1632c3130527 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:23.905989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 149/307] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:23 2022] GET /identity/v3/users/faa8f16d472b41eb9826abcbf1f32577 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:23.906684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cdbf8-c84a-47b4-8269-1632c3130527 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:23.911042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 159/308] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Sep 1 16:16:23 2022] POST /identity/v3/groups => generated 229 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:16:23.911866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7ff96-2315-4c87-abb5-c2bef095d8d7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:24.035113 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:24.039907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7ff96-2315-4c87-abb5-c2bef095d8d7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:24.046336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:24.071017 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cdbf8-c84a-47b4-8269-1632c3130527 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:24.078686 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896f739-7db5-4fe7-85d6-19a338a44bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:24.079650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896f739-7db5-4fe7-85d6-19a338a44bad None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:24.079916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896f739-7db5-4fe7-85d6-19a338a44bad None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:24.080182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896f739-7db5-4fe7-85d6-19a338a44bad None admin] PATH_INFO: `/v3/system/users/faa8f16d472b41eb9826abcbf1f32577/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:24.081611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896f739-7db5-4fe7-85d6-19a338a44bad None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=faa8f16d472b41eb9826abcbf1f32577, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:24.083016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896f739-7db5-4fe7-85d6-19a338a44bad None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:24.111658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85365b84-1c1b-4ef8-9645-5b94659382ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:24.112273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365b84-1c1b-4ef8-9645-5b94659382ef None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:24.113341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365b84-1c1b-4ef8-9645-5b94659382ef None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:24.113341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85365b84-1c1b-4ef8-9645-5b94659382ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:24.113678 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365b84-1c1b-4ef8-9645-5b94659382ef None admin] RBAC: Adding query filter params (role.id=7bc837d3251a4691ac770e5a176c2218, user.id=f476766d0edb4757acf56a8f8c984c2e, scope.system=all) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:24.114034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365b84-1c1b-4ef8-9645-5b94659382ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:24.115475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85365b84-1c1b-4ef8-9645-5b94659382ef None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:24.126076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 150/309] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Sep 1 16:16:23 2022] GET /identity/v3/role_assignments?user.id=f476766d0edb4757acf56a8f8c984c2e&scope.system=all&role.id=7bc837d3251a4691ac770e5a176c2218 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:24.127546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd4e3-f0f6-4bb4-8982-8b67e63afdb9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:24.127839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd4e3-f0f6-4bb4-8982-8b67e63afdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:24.128103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cd4e3-f0f6-4bb4-8982-8b67e63afdb9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:24.129635 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 151/310] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:24.135679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287e12-fa6a-42b2-b59f-bfb33fe5cce0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:24.135928 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287e12-fa6a-42b2-b59f-bfb33fe5cce0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:24.136166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287e12-fa6a-42b2-b59f-bfb33fe5cce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:24.161178 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-50287e12-fa6a-42b2-b59f-bfb33fe5cce0 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:24.161178 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-50287e12-fa6a-42b2-b59f-bfb33fe5cce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:24.181584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 160/311] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Sep 1 16:16:23 2022] PUT /identity/v3/system/users/faa8f16d472b41eb9826abcbf1f32577/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:16:24.259110 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 152/312] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:24.539385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896f739-7db5-4fe7-85d6-19a338a44bad None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:24.659785 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896f739-7db5-4fe7-85d6-19a338a44bad None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:24.697696 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2103aa-89ed-48ad-b6f4-19fc1d824c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:24.698403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2103aa-89ed-48ad-b6f4-19fc1d824c09 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:24.698684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2103aa-89ed-48ad-b6f4-19fc1d824c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:24.698956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2103aa-89ed-48ad-b6f4-19fc1d824c09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:24.711625 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2103aa-89ed-48ad-b6f4-19fc1d824c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1e2103aa-89ed-48ad-b6f4-19fc1d824c09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:24.717442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:24.718412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:24.719229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 161/313] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:24.724438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50287e12-fa6a-42b2-b59f-bfb33fe5cce0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:24.811671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:24.847159 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50287e12-fa6a-42b2-b59f-bfb33fe5cce0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:24.897799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a59245-c5ac-4f51-a403-34b98d9de3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:24.898736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a59245-c5ac-4f51-a403-34b98d9de3bd None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:24.899166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a59245-c5ac-4f51-a403-34b98d9de3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:24.899585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a59245-c5ac-4f51-a403-34b98d9de3bd None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:24.900587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a59245-c5ac-4f51-a403-34b98d9de3bd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:24.901019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a59245-c5ac-4f51-a403-34b98d9de3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:24.902500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a59245-c5ac-4f51-a403-34b98d9de3bd None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:24.911986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 153/314] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:24.918128 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2103aa-89ed-48ad-b6f4-19fc1d824c09 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:24.944793 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:25.024118 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2103aa-89ed-48ad-b6f4-19fc1d824c09 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:25.062476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafa93a-68c6-41ea-8f34-63c21c8e9ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:25.063042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafa93a-68c6-41ea-8f34-63c21c8e9ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:25.063315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafa93a-68c6-41ea-8f34-63c21c8e9ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:25.063579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafa93a-68c6-41ea-8f34-63c21c8e9ed3 None admin] PATH_INFO: `/v3/users/758e5d82417d47e58877e6553ff821e9` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:25.064724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafa93a-68c6-41ea-8f34-63c21c8e9ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=758e5d82417d47e58877e6553ff821e9)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:25.066202 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafa93a-68c6-41ea-8f34-63c21c8e9ed3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:25.067988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 162/315] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:24 2022] GET /identity/v3/users/758e5d82417d47e58877e6553ff821e9 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:25.074085 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a59245-c5ac-4f51-a403-34b98d9de3bd None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:25.197919 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a59245-c5ac-4f51-a403-34b98d9de3bd None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:25.247497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e745a6a-d086-498b-983f-6d6fead47556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:25.248513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e745a6a-d086-498b-983f-6d6fead47556 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:25.248985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e745a6a-d086-498b-983f-6d6fead47556 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:25.249448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e745a6a-d086-498b-983f-6d6fead47556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:25.259539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:25.336736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e745a6a-d086-498b-983f-6d6fead47556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:25.338284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e745a6a-d086-498b-983f-6d6fead47556 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:25.455269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 154/316] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:25.462175 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafa93a-68c6-41ea-8f34-63c21c8e9ed3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:25.559942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:25.570627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafa93a-68c6-41ea-8f34-63c21c8e9ed3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:25.611644 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea779fe-a984-408b-a3e0-ee9932f6f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:25.612223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea779fe-a984-408b-a3e0-ee9932f6f046 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:25.612505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea779fe-a984-408b-a3e0-ee9932f6f046 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:25.612772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea779fe-a984-408b-a3e0-ee9932f6f046 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:25.613965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea779fe-a984-408b-a3e0-ee9932f6f046 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:25.615422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea779fe-a984-408b-a3e0-ee9932f6f046 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:25.617609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 163/317] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:25 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:25.623656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e745a6a-d086-498b-983f-6d6fead47556 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:25.668236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:25.737587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e745a6a-d086-498b-983f-6d6fead47556 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:25.776880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be678c29-b24e-4130-a3db-79d2239b4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:25.777502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678c29-b24e-4130-a3db-79d2239b4196 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:25.777844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678c29-b24e-4130-a3db-79d2239b4196 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:25.778138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be678c29-b24e-4130-a3db-79d2239b4196 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:25.778865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be678c29-b24e-4130-a3db-79d2239b4196 None admin] RBAC: Adding query filter params (role.id=7bc837d3251a4691ac770e5a176c2218, scope.project.id=5d7a7332da9346c680fa5fdc04291231, user.id=758e5d82417d47e58877e6553ff821e9) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:25.779165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be678c29-b24e-4130-a3db-79d2239b4196 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:25.780592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be678c29-b24e-4130-a3db-79d2239b4196 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:25.787551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 155/318] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:25 2022] GET /identity/v3/role_assignments?user.id=758e5d82417d47e58877e6553ff821e9&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=7bc837d3251a4691ac770e5a176c2218 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:26.012475 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f8434-b916-4657-8755-856df03a7eb7 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:26.012981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f8434-b916-4657-8755-856df03a7eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:26.013085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f8434-b916-4657-8755-856df03a7eb7 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:26.014656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 164/319] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:26.020293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215fc3-a33d-4bbd-99b1-fe52e31beb91 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:26.020570 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215fc3-a33d-4bbd-99b1-fe52e31beb91 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:26.020905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71215fc3-a33d-4bbd-99b1-fe52e31beb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:26.041156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-71215fc3-a33d-4bbd-99b1-fe52e31beb91 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:26.042749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-71215fc3-a33d-4bbd-99b1-fe52e31beb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:26.123443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 156/320] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:26.204591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63193d3-bee7-474a-9629-2c68c61c2885 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:26.204892 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63193d3-bee7-474a-9629-2c68c61c2885 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:26.205158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63193d3-bee7-474a-9629-2c68c61c2885 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:26.206635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 165/321] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:26.212743 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b6c8d-e248-4d00-88e1-d6189a7b2e36 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:26.213024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b6c8d-e248-4d00-88e1-d6189a7b2e36 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:26.213298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b6c8d-e248-4d00-88e1-d6189a7b2e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:26.234757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-179b6c8d-e248-4d00-88e1-d6189a7b2e36 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:26.235955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-179b6c8d-e248-4d00-88e1-d6189a7b2e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:26.267388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:26.307706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0602a8-8367-4c3e-8510-77bbc0397fd7 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:26.307980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0602a8-8367-4c3e-8510-77bbc0397fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:26.308250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0602a8-8367-4c3e-8510-77bbc0397fd7 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:26.309597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 166/322] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:26.315291 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8845f17-f9a7-48cb-90e9-529edbaf9f9b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:26.315657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8845f17-f9a7-48cb-90e9-529edbaf9f9b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:26.315993 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8845f17-f9a7-48cb-90e9-529edbaf9f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:26.317929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 157/323] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:26.356512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b8845f17-f9a7-48cb-90e9-529edbaf9f9b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:26.357726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b8845f17-f9a7-48cb-90e9-529edbaf9f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:26.401255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b6c8d-e248-4d00-88e1-d6189a7b2e36 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:26.436642 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 167/324] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:26.506094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b6c8d-e248-4d00-88e1-d6189a7b2e36 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:26.548263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909478a4-06fc-4666-b7ec-f5c7fd9d024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:26.548821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909478a4-06fc-4666-b7ec-f5c7fd9d024c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:26.549093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909478a4-06fc-4666-b7ec-f5c7fd9d024c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:26.549358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909478a4-06fc-4666-b7ec-f5c7fd9d024c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:26.550494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909478a4-06fc-4666-b7ec-f5c7fd9d024c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:26.551918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909478a4-06fc-4666-b7ec-f5c7fd9d024c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:26.553745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 158/325] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:26.559250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8845f17-f9a7-48cb-90e9-529edbaf9f9b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:26.592594 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909478a4-06fc-4666-b7ec-f5c7fd9d024c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:26.625759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:26.662539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:26.678918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8845f17-f9a7-48cb-90e9-529edbaf9f9b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:26.714626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909478a4-06fc-4666-b7ec-f5c7fd9d024c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:26.720482 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a42f1f-9c38-4dd9-b245-3ae4a34ad884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:26.721091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42f1f-9c38-4dd9-b245-3ae4a34ad884 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:26.721367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42f1f-9c38-4dd9-b245-3ae4a34ad884 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:26.721636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42f1f-9c38-4dd9-b245-3ae4a34ad884 None admin] PATH_INFO: `/v3/groups` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:26.722312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a42f1f-9c38-4dd9-b245-3ae4a34ad884 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:26.723744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a42f1f-9c38-4dd9-b245-3ae4a34ad884 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:26.750955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aeb13-3687-4408-b0f5-c309b4ff7c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:26.753186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aeb13-3687-4408-b0f5-c309b4ff7c42 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:26.753186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aeb13-3687-4408-b0f5-c309b4ff7c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:26.753186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aeb13-3687-4408-b0f5-c309b4ff7c42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:26.764228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2aeb13-3687-4408-b0f5-c309b4ff7c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-af2aeb13-3687-4408-b0f5-c309b4ff7c42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:26.769256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:26.770349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:26.771176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 159/326] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:26.771842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aeb13-3687-4408-b0f5-c309b4ff7c42 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:26.810278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 168/327] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Sep 1 16:16:26 2022] POST /identity/v3/groups => generated 226 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:16:26.811004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a42f1f-9c38-4dd9-b245-3ae4a34ad884 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:26.887709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:26.899830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aeb13-3687-4408-b0f5-c309b4ff7c42 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:26.936775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a42f1f-9c38-4dd9-b245-3ae4a34ad884 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:26.945437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b624-908f-44ca-a2a6-caad8276d722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:26.946133 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b624-908f-44ca-a2a6-caad8276d722 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:26.946412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b624-908f-44ca-a2a6-caad8276d722 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:26.946679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123b624-908f-44ca-a2a6-caad8276d722 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:26.962467 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123b624-908f-44ca-a2a6-caad8276d722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-3123b624-908f-44ca-a2a6-caad8276d722 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:26.968846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:26.969842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:26.971745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 160/328] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:26.981033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b624-908f-44ca-a2a6-caad8276d722 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:26.992738 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce105968-f83b-477e-9452-7c330e8308a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:26.993703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce105968-f83b-477e-9452-7c330e8308a5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:26.994220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce105968-f83b-477e-9452-7c330e8308a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:26.994673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce105968-f83b-477e-9452-7c330e8308a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:26.995712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce105968-f83b-477e-9452-7c330e8308a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:26.996182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce105968-f83b-477e-9452-7c330e8308a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:26.998623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce105968-f83b-477e-9452-7c330e8308a5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:27.014359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 169/329] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:27.020470 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce105968-f83b-477e-9452-7c330e8308a5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:27.036648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:27.111752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123b624-908f-44ca-a2a6-caad8276d722 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:27.150390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce105968-f83b-477e-9452-7c330e8308a5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:27.163540 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed8053-beeb-4ccd-8558-f534f6a15f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:27.164331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8053-beeb-4ccd-8558-f534f6a15f45 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:27.164612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8053-beeb-4ccd-8558-f534f6a15f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:27.164882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8053-beeb-4ccd-8558-f534f6a15f45 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:27.165552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed8053-beeb-4ccd-8558-f534f6a15f45 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:27.165851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed8053-beeb-4ccd-8558-f534f6a15f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:27.167337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed8053-beeb-4ccd-8558-f534f6a15f45 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:27.177950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 161/330] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:27.183313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed8053-beeb-4ccd-8558-f534f6a15f45 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:27.197576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f522a-6ae7-412f-8bc2-ccb484f00dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:27.198579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f522a-6ae7-412f-8bc2-ccb484f00dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:27.199024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f522a-6ae7-412f-8bc2-ccb484f00dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:27.199484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f522a-6ae7-412f-8bc2-ccb484f00dd6 None admin] PATH_INFO: `/v3/users/f476766d0edb4757acf56a8f8c984c2e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:27.200905 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f522a-6ae7-412f-8bc2-ccb484f00dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=f476766d0edb4757acf56a8f8c984c2e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:27.202593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f522a-6ae7-412f-8bc2-ccb484f00dd6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:27.202982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:27.204488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 170/331] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:27 2022] GET /identity/v3/users/f476766d0edb4757acf56a8f8c984c2e => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:27.211043 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f522a-6ae7-412f-8bc2-ccb484f00dd6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:27.327927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:27.336528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed8053-beeb-4ccd-8558-f534f6a15f45 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:27.360404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f522a-6ae7-412f-8bc2-ccb484f00dd6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:27.383770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d1c68-c21f-4b0d-bbaf-fd46bc0c9687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:27.384566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d1c68-c21f-4b0d-bbaf-fd46bc0c9687 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:27.384946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d1c68-c21f-4b0d-bbaf-fd46bc0c9687 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:27.385342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d1c68-c21f-4b0d-bbaf-fd46bc0c9687 None admin] PATH_INFO: `/v3/users/faa8f16d472b41eb9826abcbf1f32577` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:27.386861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d1c68-c21f-4b0d-bbaf-fd46bc0c9687 None admin] RBAC: Authorizing `identity:get_user(user_id=faa8f16d472b41eb9826abcbf1f32577)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:27.388955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d1c68-c21f-4b0d-bbaf-fd46bc0c9687 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:27.391129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 162/332] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:27 2022] GET /identity/v3/users/faa8f16d472b41eb9826abcbf1f32577 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:27.398741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d1c68-c21f-4b0d-bbaf-fd46bc0c9687 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:27.414198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c61eed-3d96-4da0-9144-c86236860775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:27.415189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c61eed-3d96-4da0-9144-c86236860775 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:27.415576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c61eed-3d96-4da0-9144-c86236860775 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:27.415920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c61eed-3d96-4da0-9144-c86236860775 None admin] PATH_INFO: `/v3/system/users/f476766d0edb4757acf56a8f8c984c2e/roles/7bc837d3251a4691ac770e5a176c2218` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:27.417491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c61eed-3d96-4da0-9144-c86236860775 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f476766d0edb4757acf56a8f8c984c2e, role_id=7bc837d3251a4691ac770e5a176c2218)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:27.419116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c61eed-3d96-4da0-9144-c86236860775 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:27.484180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 171/333] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Sep 1 16:16:27 2022] PUT /identity/v3/system/users/f476766d0edb4757acf56a8f8c984c2e/roles/7bc837d3251a4691ac770e5a176c2218 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:16:27.505008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:27.536655 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d1c68-c21f-4b0d-bbaf-fd46bc0c9687 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:27.580365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a7545-cd7c-4959-93a3-7f0c97dc92ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:27.580999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a7545-cd7c-4959-93a3-7f0c97dc92ca None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:27.581280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a7545-cd7c-4959-93a3-7f0c97dc92ca None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:27.581551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a7545-cd7c-4959-93a3-7f0c97dc92ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:27.582359 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a7545-cd7c-4959-93a3-7f0c97dc92ca None admin] RBAC: Adding query filter params (role.id=eb63c7589f0c472b9e1abd79cbdd7528, user.id=faa8f16d472b41eb9826abcbf1f32577, scope.system=all) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:27.582668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a7545-cd7c-4959-93a3-7f0c97dc92ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:27.584308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a7545-cd7c-4959-93a3-7f0c97dc92ca None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:27.599726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 163/334] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Sep 1 16:16:27 2022] GET /identity/v3/role_assignments?user.id=faa8f16d472b41eb9826abcbf1f32577&scope.system=all&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:29.237674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a454f-89ed-4c22-84c4-b66165360d3c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:29.238726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a454f-89ed-4c22-84c4-b66165360d3c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:29.239202 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a454f-89ed-4c22-84c4-b66165360d3c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:29.241652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 172/335] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:29.248858 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbb06a-01b4-43cc-b901-b529cb535a31 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:29.249762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbb06a-01b4-43cc-b901-b529cb535a31 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:29.250272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbb06a-01b4-43cc-b901-b529cb535a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:29.270252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5fcbb06a-01b4-43cc-b901-b529cb535a31 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:29.271758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5fcbb06a-01b4-43cc-b901-b529cb535a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:29.356862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 164/336] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:29.651288 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a454f-89ed-4c22-84c4-b66165360d3c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:29.807971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a454f-89ed-4c22-84c4-b66165360d3c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:29.847455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8941970-4374-4348-97eb-98eb082e62ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:29.848101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941970-4374-4348-97eb-98eb082e62ab None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:29.848373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941970-4374-4348-97eb-98eb082e62ab None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:29.848649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8941970-4374-4348-97eb-98eb082e62ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:29.860872 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8941970-4374-4348-97eb-98eb082e62ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f8941970-4374-4348-97eb-98eb082e62ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:29.866771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:29.868386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:29.870848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 173/337] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:29.882314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbb06a-01b4-43cc-b901-b529cb535a31 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:30.007979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:30.042506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbb06a-01b4-43cc-b901-b529cb535a31 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:30.050199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae30d3-e2d7-40ff-a2e4-54ae22f7455f None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:30.050514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae30d3-e2d7-40ff-a2e4-54ae22f7455f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:30.050801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae30d3-e2d7-40ff-a2e4-54ae22f7455f None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:30.052318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 174/338] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:30.056775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a637ca8-f3d7-45c1-89cf-d5c8faa020b9 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:30.057044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a637ca8-f3d7-45c1-89cf-d5c8faa020b9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:30.057318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a637ca8-f3d7-45c1-89cf-d5c8faa020b9 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:30.058888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 175/339] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:30.062601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d84914-bf86-45d3-8250-450384f4cc4b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:30.062883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d84914-bf86-45d3-8250-450384f4cc4b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:30.063211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d84914-bf86-45d3-8250-450384f4cc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:30.076891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:30.082831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cf7d1-a614-4f0d-8123-1608b4db5339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:30.083874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf7d1-a614-4f0d-8123-1608b4db5339 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:30.084294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf7d1-a614-4f0d-8123-1608b4db5339 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:30.084855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cf7d1-a614-4f0d-8123-1608b4db5339 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:30.085668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf7d1-a614-4f0d-8123-1608b4db5339 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:30.086201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf7d1-a614-4f0d-8123-1608b4db5339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:30.087790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cf7d1-a614-4f0d-8123-1608b4db5339 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:30.103179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-80d84914-bf86-45d3-8250-450384f4cc4b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:30.104379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-80d84914-bf86-45d3-8250-450384f4cc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:30.105135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 165/340] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:30.106719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b55f6c-3630-4390-9351-17c52a406a6d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:30.107188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b55f6c-3630-4390-9351-17c52a406a6d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:30.107646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b55f6c-3630-4390-9351-17c52a406a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:30.135178 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f7b55f6c-3630-4390-9351-17c52a406a6d None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:30.136705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f7b55f6c-3630-4390-9351-17c52a406a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:30.209164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 166/341] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:30.210443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b55f6c-3630-4390-9351-17c52a406a6d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:30.239251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 176/342] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:30.264157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaba75-43f6-4ca9-a63a-af44bd05f61a None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:30.264360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaba75-43f6-4ca9-a63a-af44bd05f61a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:30.264803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaba75-43f6-4ca9-a63a-af44bd05f61a None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:30.266601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 177/343] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:30.274226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d106-477a-42cf-8b23-064ed6d365c6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:30.274756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d106-477a-42cf-8b23-064ed6d365c6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:30.275223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4d106-477a-42cf-8b23-064ed6d365c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:30.279449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:30.310328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d9b4d106-477a-42cf-8b23-064ed6d365c6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:30.312666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d9b4d106-477a-42cf-8b23-064ed6d365c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:30.327894 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b55f6c-3630-4390-9351-17c52a406a6d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:30.369021 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc720cbd-4fa7-40b3-911e-56f9d03b0a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:30.369944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720cbd-4fa7-40b3-911e-56f9d03b0a00 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:30.370444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720cbd-4fa7-40b3-911e-56f9d03b0a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:30.370854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc720cbd-4fa7-40b3-911e-56f9d03b0a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:30.427641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 178/344] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:30.448427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc720cbd-4fa7-40b3-911e-56f9d03b0a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:30.449895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc720cbd-4fa7-40b3-911e-56f9d03b0a00 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:30.518394 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:30.555179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 167/345] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:30.561084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d106-477a-42cf-8b23-064ed6d365c6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:30.606754 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc720cbd-4fa7-40b3-911e-56f9d03b0a00 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:30.689081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:30.743324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc720cbd-4fa7-40b3-911e-56f9d03b0a00 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:30.786555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e5eb8-4813-4236-9aea-b9f6b90b41b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:30.787930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4d106-477a-42cf-8b23-064ed6d365c6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:30.789314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5eb8-4813-4236-9aea-b9f6b90b41b2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:30.790025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5eb8-4813-4236-9aea-b9f6b90b41b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:30.790299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5eb8-4813-4236-9aea-b9f6b90b41b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:30.804227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e5eb8-4813-4236-9aea-b9f6b90b41b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f83e5eb8-4813-4236-9aea-b9f6b90b41b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:30.809059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:30.809964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:30.810794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 168/346] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:30.811477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e5eb8-4813-4236-9aea-b9f6b90b41b2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:30.838247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:30.891969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d61c-50b7-4dff-80ea-c9fc65685a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:30.892623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d61c-50b7-4dff-80ea-c9fc65685a63 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:30.892896 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d61c-50b7-4dff-80ea-c9fc65685a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:30.893177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d61c-50b7-4dff-80ea-c9fc65685a63 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:30.897326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5d61c-50b7-4dff-80ea-c9fc65685a63 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:30.898753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5d61c-50b7-4dff-80ea-c9fc65685a63 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:30.900639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 179/347] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:30 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:30.901272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d61c-50b7-4dff-80ea-c9fc65685a63 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:30.925060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e5eb8-4813-4236-9aea-b9f6b90b41b2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:30.963914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f8dbc-6431-4d1b-ad2a-35586f8f03b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:30.964564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f8dbc-6431-4d1b-ad2a-35586f8f03b5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:30.964836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f8dbc-6431-4d1b-ad2a-35586f8f03b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:30.965106 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f8dbc-6431-4d1b-ad2a-35586f8f03b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:30.978605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f8dbc-6431-4d1b-ad2a-35586f8f03b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f72f8dbc-6431-4d1b-ad2a-35586f8f03b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:30.984336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:30.986843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 169/348] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:16:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:30.988448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f8dbc-6431-4d1b-ad2a-35586f8f03b5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:31.089413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:31.122287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f8dbc-6431-4d1b-ad2a-35586f8f03b5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:31.146971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d61c-50b7-4dff-80ea-c9fc65685a63 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:31.167416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa71a4-d299-4a5f-b20f-46441cfa8b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:31.168513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa71a4-d299-4a5f-b20f-46441cfa8b5f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:31.168986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa71a4-d299-4a5f-b20f-46441cfa8b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:31.169702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa71a4-d299-4a5f-b20f-46441cfa8b5f None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:31.178066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa71a4-d299-4a5f-b20f-46441cfa8b5f None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:31.180437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa71a4-d299-4a5f-b20f-46441cfa8b5f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:31.182276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:31.182821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 170/349] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:30 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:31.183989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa71a4-d299-4a5f-b20f-46441cfa8b5f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:31.195077 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729c9cf-8b41-400a-b1f0-7c82b9b75133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:31.198441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c9cf-8b41-400a-b1f0-7c82b9b75133 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:31.198441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c9cf-8b41-400a-b1f0-7c82b9b75133 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:31.198441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729c9cf-8b41-400a-b1f0-7c82b9b75133 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:31.198441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729c9cf-8b41-400a-b1f0-7c82b9b75133 None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:31.198441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729c9cf-8b41-400a-b1f0-7c82b9b75133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:31.200170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729c9cf-8b41-400a-b1f0-7c82b9b75133 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:31.211790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 180/350] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:31.213354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729c9cf-8b41-400a-b1f0-7c82b9b75133 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:31.328888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa71a4-d299-4a5f-b20f-46441cfa8b5f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:31.371534 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b830ee-175c-49d1-beb4-278b9bc56c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:31.372415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b830ee-175c-49d1-beb4-278b9bc56c8d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:31.372834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b830ee-175c-49d1-beb4-278b9bc56c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:31.373238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729c9cf-8b41-400a-b1f0-7c82b9b75133 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:31.373695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b830ee-175c-49d1-beb4-278b9bc56c8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:31.388510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b830ee-175c-49d1-beb4-278b9bc56c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-51b830ee-175c-49d1-beb4-278b9bc56c8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:31.395196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:31.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 16:16:31.397515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:31.400347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 171/351] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:31.401773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b830ee-175c-49d1-beb4-278b9bc56c8d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:31.406678 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:31.433768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7ed94-74cc-491f-bae0-00d1c7261728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:31.434520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7ed94-74cc-491f-bae0-00d1c7261728 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:31.434764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7ed94-74cc-491f-bae0-00d1c7261728 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:31.435058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7ed94-74cc-491f-bae0-00d1c7261728 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:31.435751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7ed94-74cc-491f-bae0-00d1c7261728 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:31.436053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7ed94-74cc-491f-bae0-00d1c7261728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:31.438322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7ed94-74cc-491f-bae0-00d1c7261728 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:31.453720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 181/352] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:31.454947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7ed94-74cc-491f-bae0-00d1c7261728 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:31.538215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:31.540973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b830ee-175c-49d1-beb4-278b9bc56c8d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:31.593288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b38e12-9755-4094-820a-f1ebea73422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:31.594383 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b38e12-9755-4094-820a-f1ebea73422e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:31.594951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b38e12-9755-4094-820a-f1ebea73422e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:31.595232 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b38e12-9755-4094-820a-f1ebea73422e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:31.595981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b38e12-9755-4094-820a-f1ebea73422e None admin] RBAC: Adding query filter params (group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role.id=eb63c7589f0c472b9e1abd79cbdd7528, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:31.596464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b38e12-9755-4094-820a-f1ebea73422e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:31.598888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b38e12-9755-4094-820a-f1ebea73422e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:31.603991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7ed94-74cc-491f-bae0-00d1c7261728 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:31.605845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 172/353] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 1 16:16:31 2022] GET /identity/v3/role_assignments?group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:31.606812 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b38e12-9755-4094-820a-f1ebea73422e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:31.648258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fef5fd-f961-4c7f-be58-03949336cfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:31.649288 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fef5fd-f961-4c7f-be58-03949336cfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:31.649760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fef5fd-f961-4c7f-be58-03949336cfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:31.650244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fef5fd-f961-4c7f-be58-03949336cfc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:31.740878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fef5fd-f961-4c7f-be58-03949336cfc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:31.742779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fef5fd-f961-4c7f-be58-03949336cfc5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:31.755338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:31.808396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:31.816449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b38e12-9755-4094-820a-f1ebea73422e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:31.866125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 182/354] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:31.867420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fef5fd-f961-4c7f-be58-03949336cfc5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:31.883811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2098f-d2ef-4388-a606-c7a3c55b3f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:31.884452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2098f-d2ef-4388-a606-c7a3c55b3f3d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:31.884736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2098f-d2ef-4388-a606-c7a3c55b3f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:31.885013 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2098f-d2ef-4388-a606-c7a3c55b3f3d None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:31.885688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2098f-d2ef-4388-a606-c7a3c55b3f3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:31.886046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2098f-d2ef-4388-a606-c7a3c55b3f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:31.888199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2098f-d2ef-4388-a606-c7a3c55b3f3d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:31.902653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 173/355] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:31.904161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5897a-6a10-4fba-b6a0-680bad53ce8d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:31.904448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5897a-6a10-4fba-b6a0-680bad53ce8d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:31.904739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5897a-6a10-4fba-b6a0-680bad53ce8d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:31.906253 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 174/356] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:31.907283 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5897a-6a10-4fba-b6a0-680bad53ce8d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:31.999208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fef5fd-f961-4c7f-be58-03949336cfc5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:32.046899 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407c57a-eac4-4fff-9f3b-0591b21e9add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:32.047958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407c57a-eac4-4fff-9f3b-0591b21e9add None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:32.048411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407c57a-eac4-4fff-9f3b-0591b21e9add None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:32.048850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407c57a-eac4-4fff-9f3b-0591b21e9add None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:32.054093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5897a-6a10-4fba-b6a0-680bad53ce8d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:32.076618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:32.089408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:32.096850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cbbf1-c051-4d97-b8a4-73f617ada947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:32.097628 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cbbf1-c051-4d97-b8a4-73f617ada947 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:32.098096 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cbbf1-c051-4d97-b8a4-73f617ada947 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:32.098440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cbbf1-c051-4d97-b8a4-73f617ada947 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:32.100544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cbbf1-c051-4d97-b8a4-73f617ada947 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:32.102486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cbbf1-c051-4d97-b8a4-73f617ada947 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:32.105116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 175/357] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:31 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:32.106046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cbbf1-c051-4d97-b8a4-73f617ada947 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:32.148292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407c57a-eac4-4fff-9f3b-0591b21e9add None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:32.149993 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407c57a-eac4-4fff-9f3b-0591b21e9add None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:32.246599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cbbf1-c051-4d97-b8a4-73f617ada947 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:32.278978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 183/358] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:32.283361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43495dfb-a338-46fc-b9f2-6681398b3540 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:32.283361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43495dfb-a338-46fc-b9f2-6681398b3540 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:32.283361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43495dfb-a338-46fc-b9f2-6681398b3540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:32.301445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33de9a-10d1-43aa-8bef-161f1be8f0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:32.301903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-43495dfb-a338-46fc-b9f2-6681398b3540 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:32.302146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33de9a-10d1-43aa-8bef-161f1be8f0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:32.302431 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33de9a-10d1-43aa-8bef-161f1be8f0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:32.302705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33de9a-10d1-43aa-8bef-161f1be8f0f1 None admin] PATH_INFO: `/v3/users/f476766d0edb4757acf56a8f8c984c2e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:32.303152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-43495dfb-a338-46fc-b9f2-6681398b3540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:32.304852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33de9a-10d1-43aa-8bef-161f1be8f0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=f476766d0edb4757acf56a8f8c984c2e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:32.306355 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33de9a-10d1-43aa-8bef-161f1be8f0f1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:32.308173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 176/359] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:16:32 2022] GET /identity/v3/users/f476766d0edb4757acf56a8f8c984c2e => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:32.308858 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33de9a-10d1-43aa-8bef-161f1be8f0f1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:32.364689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:32.386130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:32.390017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 184/360] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:32.392642 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a132b-bb96-4979-b75d-148235ec026e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:32.393074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a132b-bb96-4979-b75d-148235ec026e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:32.399971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a132b-bb96-4979-b75d-148235ec026e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:32.399971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 185/361] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:32.399971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a132b-bb96-4979-b75d-148235ec026e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:32.431446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33de9a-10d1-43aa-8bef-161f1be8f0f1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:32.475722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6248962-2c61-4cc1-8395-8bbffbc51445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:32.476391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6248962-2c61-4cc1-8395-8bbffbc51445 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:32.476674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6248962-2c61-4cc1-8395-8bbffbc51445 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:32.476951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6248962-2c61-4cc1-8395-8bbffbc51445 None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:32.478912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6248962-2c61-4cc1-8395-8bbffbc51445 None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:32.480670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6248962-2c61-4cc1-8395-8bbffbc51445 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:32.483301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 177/362] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:32 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:32.484463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6248962-2c61-4cc1-8395-8bbffbc51445 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:32.536482 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a132b-bb96-4979-b75d-148235ec026e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:32.575558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5631c16-e82f-42c9-a241-5e30fc1fa5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:32.576198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631c16-e82f-42c9-a241-5e30fc1fa5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:32.576476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631c16-e82f-42c9-a241-5e30fc1fa5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:32.576748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5631c16-e82f-42c9-a241-5e30fc1fa5d9 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:32.577915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5631c16-e82f-42c9-a241-5e30fc1fa5d9 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:32.579358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5631c16-e82f-42c9-a241-5e30fc1fa5d9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:32.581112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 186/363] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:32 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:32.582436 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e74a43-16df-474f-a0cc-3a8dbdca14d5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:32.582980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e74a43-16df-474f-a0cc-3a8dbdca14d5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:32.583103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e74a43-16df-474f-a0cc-3a8dbdca14d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:32.603987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-71e74a43-16df-474f-a0cc-3a8dbdca14d5 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:32.606583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-71e74a43-16df-474f-a0cc-3a8dbdca14d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:32.617622 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6248962-2c61-4cc1-8395-8bbffbc51445 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:32.657323 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:32.664372 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a12946-35d1-48c4-939c-4c395a882249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:32.664994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a12946-35d1-48c4-939c-4c395a882249 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:32.665314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a12946-35d1-48c4-939c-4c395a882249 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:32.665647 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a12946-35d1-48c4-939c-4c395a882249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:32.666988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a12946-35d1-48c4-939c-4c395a882249 None admin] RBAC: Adding query filter params (role.id=7bc837d3251a4691ac770e5a176c2218, user.id=f476766d0edb4757acf56a8f8c984c2e, scope.system=all) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:32.667311 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a12946-35d1-48c4-939c-4c395a882249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:32.669154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a12946-35d1-48c4-939c-4c395a882249 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:32.671724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:32.687413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 187/364] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:32.689006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 178/365] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Sep 1 16:16:32 2022] GET /identity/v3/role_assignments?user.id=f476766d0edb4757acf56a8f8c984c2e&scope.system=all&role.id=7bc837d3251a4691ac770e5a176c2218 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:32.689439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e74a43-16df-474f-a0cc-3a8dbdca14d5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:32.690291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a12946-35d1-48c4-939c-4c395a882249 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:32.824603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e74a43-16df-474f-a0cc-3a8dbdca14d5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:32.870287 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102386f-3a12-497e-95d7-0ce777975ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:32.871190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102386f-3a12-497e-95d7-0ce777975ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:32.871492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102386f-3a12-497e-95d7-0ce777975ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:32.871768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7102386f-3a12-497e-95d7-0ce777975ba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:32.872508 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102386f-3a12-497e-95d7-0ce777975ba9 None admin] RBAC: Adding query filter params (group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role.id=eb63c7589f0c472b9e1abd79cbdd7528, scope.project.id=5d7a7332da9346c680fa5fdc04291231) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:32.872814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102386f-3a12-497e-95d7-0ce777975ba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:32.874286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7102386f-3a12-497e-95d7-0ce777975ba9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:32.875280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a12946-35d1-48c4-939c-4c395a882249 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:32.881756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 188/366] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 1 16:16:32 2022] GET /identity/v3/role_assignments?group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:32.882710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102386f-3a12-497e-95d7-0ce777975ba9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:32.941896 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:32.974870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b578-b7bb-4ab4-99ad-c18982ed4f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:32.976083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b578-b7bb-4ab4-99ad-c18982ed4f20 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:32.976683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b578-b7bb-4ab4-99ad-c18982ed4f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:32.977448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b578-b7bb-4ab4-99ad-c18982ed4f20 None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:32.980052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888b578-b7bb-4ab4-99ad-c18982ed4f20 None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:32.983018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888b578-b7bb-4ab4-99ad-c18982ed4f20 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:32.986326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 179/367] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:32 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:32.995064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b578-b7bb-4ab4-99ad-c18982ed4f20 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:33.021439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7102386f-3a12-497e-95d7-0ce777975ba9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:33.077555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358fa87-3658-472d-aa80-6eeabdedbd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:33.078315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358fa87-3658-472d-aa80-6eeabdedbd59 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:33.078601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358fa87-3658-472d-aa80-6eeabdedbd59 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:33.078876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358fa87-3658-472d-aa80-6eeabdedbd59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:33.080910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:33.106138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358fa87-3658-472d-aa80-6eeabdedbd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2358fa87-3658-472d-aa80-6eeabdedbd59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:33.111733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:33.112671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:33.113474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:33.114924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 189/368] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:16:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:33.117952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358fa87-3658-472d-aa80-6eeabdedbd59 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:33.165987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b578-b7bb-4ab4-99ad-c18982ed4f20 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:33.227261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceabb8a-dc60-4d42-8be6-9b3b7fc527d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:33.227887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceabb8a-dc60-4d42-8be6-9b3b7fc527d0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:33.228642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceabb8a-dc60-4d42-8be6-9b3b7fc527d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:33.228917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceabb8a-dc60-4d42-8be6-9b3b7fc527d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:33.230087 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceabb8a-dc60-4d42-8be6-9b3b7fc527d0 None admin] RBAC: Adding query filter params (group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role.id=57a8970530a24c16b8d86a333768e765, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:33.230401 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceabb8a-dc60-4d42-8be6-9b3b7fc527d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:33.232138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceabb8a-dc60-4d42-8be6-9b3b7fc527d0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:33.240769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 180/369] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 1 16:16:32 2022] GET /identity/v3/role_assignments?group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=57a8970530a24c16b8d86a333768e765 => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:33.242125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceabb8a-dc60-4d42-8be6-9b3b7fc527d0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:33.255727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358fa87-3658-472d-aa80-6eeabdedbd59 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:33.265956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:33.300966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fafa5-4f34-48ef-9b56-fc1583b17087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:33.302171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fafa5-4f34-48ef-9b56-fc1583b17087 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:33.302171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fafa5-4f34-48ef-9b56-fc1583b17087 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:33.302171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fafa5-4f34-48ef-9b56-fc1583b17087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:33.315516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fafa5-4f34-48ef-9b56-fc1583b17087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9f0fafa5-4f34-48ef-9b56-fc1583b17087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:33.321774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:33.322912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:33.323900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 190/370] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:16:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:33.336068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fafa5-4f34-48ef-9b56-fc1583b17087 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:33.397899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceabb8a-dc60-4d42-8be6-9b3b7fc527d0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:33.431337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:33.444996 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316fc92-e0ab-4dda-abc5-2e17aba888a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:33.446430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316fc92-e0ab-4dda-abc5-2e17aba888a5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:33.446781 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316fc92-e0ab-4dda-abc5-2e17aba888a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:33.447256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316fc92-e0ab-4dda-abc5-2e17aba888a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:33.448157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316fc92-e0ab-4dda-abc5-2e17aba888a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:33.448677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316fc92-e0ab-4dda-abc5-2e17aba888a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:33.451722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316fc92-e0ab-4dda-abc5-2e17aba888a5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:33.462583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 181/371] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:33.470958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316fc92-e0ab-4dda-abc5-2e17aba888a5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:33.509431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fafa5-4f34-48ef-9b56-fc1583b17087 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:33.566720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1725911-1ed1-43aa-adb2-8f782c96da30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:33.567345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1725911-1ed1-43aa-adb2-8f782c96da30 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:33.567625 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1725911-1ed1-43aa-adb2-8f782c96da30 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:33.567896 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1725911-1ed1-43aa-adb2-8f782c96da30 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:33.568570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1725911-1ed1-43aa-adb2-8f782c96da30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:33.569510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1725911-1ed1-43aa-adb2-8f782c96da30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:33.571160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1725911-1ed1-43aa-adb2-8f782c96da30 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:33.582544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 191/372] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:33.588682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1725911-1ed1-43aa-adb2-8f782c96da30 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:33.614130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316fc92-e0ab-4dda-abc5-2e17aba888a5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:33.628904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:33.658842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9203e-b1df-4156-8422-fc889ada6465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:33.659740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9203e-b1df-4156-8422-fc889ada6465 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:33.660168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9203e-b1df-4156-8422-fc889ada6465 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:33.660593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9203e-b1df-4156-8422-fc889ada6465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:33.728962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:33.734399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1725911-1ed1-43aa-adb2-8f782c96da30 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:33.744584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9203e-b1df-4156-8422-fc889ada6465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:33.746640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9203e-b1df-4156-8422-fc889ada6465 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:33.798775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a516169-cc7a-42c8-b1cb-b413da7eeab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:33.799648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a516169-cc7a-42c8-b1cb-b413da7eeab2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:33.800910 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a516169-cc7a-42c8-b1cb-b413da7eeab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:33.801348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a516169-cc7a-42c8-b1cb-b413da7eeab2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:33.932662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a516169-cc7a-42c8-b1cb-b413da7eeab2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:33.934414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a516169-cc7a-42c8-b1cb-b413da7eeab2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:33.938914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 182/373] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:33.944979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9203e-b1df-4156-8422-fc889ada6465 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:33.966802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:34.068170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 192/374] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:34.074433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a516169-cc7a-42c8-b1cb-b413da7eeab2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:34.115173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:34.147276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9203e-b1df-4156-8422-fc889ada6465 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:34.236277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a516169-cc7a-42c8-b1cb-b413da7eeab2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:34.254846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6a950-533b-4560-a1c9-f4e302dbe527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:34.255800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a950-533b-4560-a1c9-f4e302dbe527 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:34.256240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a950-533b-4560-a1c9-f4e302dbe527 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:34.256774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6a950-533b-4560-a1c9-f4e302dbe527 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:34.258589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6a950-533b-4560-a1c9-f4e302dbe527 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:34.260926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6a950-533b-4560-a1c9-f4e302dbe527 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:34.267859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 183/375] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:33 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:34.268461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:34.274299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6a950-533b-4560-a1c9-f4e302dbe527 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:34.291815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e331fe-359b-458c-9238-626ef4465de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:34.292472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e331fe-359b-458c-9238-626ef4465de1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:34.292845 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e331fe-359b-458c-9238-626ef4465de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:34.293121 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e331fe-359b-458c-9238-626ef4465de1 None admin] PATH_INFO: `/v3/projects/f1932bfa4cf144bf9a1f6249a0b89aa8` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:34.296260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e331fe-359b-458c-9238-626ef4465de1 None admin] RBAC: Authorizing `identity:get_project(project_id=f1932bfa4cf144bf9a1f6249a0b89aa8)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:34.297697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e331fe-359b-458c-9238-626ef4465de1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:34.299565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 193/376] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:34 2022] GET /identity/v3/projects/f1932bfa4cf144bf9a1f6249a0b89aa8 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:34.307963 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e331fe-359b-458c-9238-626ef4465de1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:34.424389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e331fe-359b-458c-9238-626ef4465de1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:34.471379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbc05e-beaf-4a58-ab36-9b7eef2fdd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:34.472035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc05e-beaf-4a58-ab36-9b7eef2fdd5e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:34.472309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc05e-beaf-4a58-ab36-9b7eef2fdd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:34.472574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbc05e-beaf-4a58-ab36-9b7eef2fdd5e None admin] PATH_INFO: `/v3/groups/43cafd596965463abb31f787496cb49f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:34.486686 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbc05e-beaf-4a58-ab36-9b7eef2fdd5e None admin] RBAC: Authorizing `identity:get_group(group_id=43cafd596965463abb31f787496cb49f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:34.488083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcbc05e-beaf-4a58-ab36-9b7eef2fdd5e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:34.492928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 194/377] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:34 2022] GET /identity/v3/groups/43cafd596965463abb31f787496cb49f => generated 229 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:34.499387 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e817f9-8198-4d8f-80c6-3384d964f56e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:34.499877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e817f9-8198-4d8f-80c6-3384d964f56e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:34.500357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e817f9-8198-4d8f-80c6-3384d964f56e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:34.502877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 195/378] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:34.508434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e817f9-8198-4d8f-80c6-3384d964f56e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:34.531418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6a950-533b-4560-a1c9-f4e302dbe527 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:34.573468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ac84a-41ac-4126-bf19-9a6d4d91a941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:34.574206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ac84a-41ac-4126-bf19-9a6d4d91a941 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:34.574482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ac84a-41ac-4126-bf19-9a6d4d91a941 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:34.574750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ac84a-41ac-4126-bf19-9a6d4d91a941 None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:34.575936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ac84a-41ac-4126-bf19-9a6d4d91a941 None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:34.577447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ac84a-41ac-4126-bf19-9a6d4d91a941 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:34.584264 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 184/379] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:34 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:34.585822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00ce82-6f74-4eee-a0fa-ef536b80d64a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:34.586141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00ce82-6f74-4eee-a0fa-ef536b80d64a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:34.586414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00ce82-6f74-4eee-a0fa-ef536b80d64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:34.592520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:34.607154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3e00ce82-6f74-4eee-a0fa-ef536b80d64a None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:34.608348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3e00ce82-6f74-4eee-a0fa-ef536b80d64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:34.628248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:34.641501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e817f9-8198-4d8f-80c6-3384d964f56e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:34.682984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616d970-5dc0-4e52-bc99-4a0581e4f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:34.683602 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616d970-5dc0-4e52-bc99-4a0581e4f353 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:34.683888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616d970-5dc0-4e52-bc99-4a0581e4f353 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:34.684172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616d970-5dc0-4e52-bc99-4a0581e4f353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:34.684904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616d970-5dc0-4e52-bc99-4a0581e4f353 None admin] RBAC: Adding query filter params (group.id=43cafd596965463abb31f787496cb49f, role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=f1932bfa4cf144bf9a1f6249a0b89aa8) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:34.685267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616d970-5dc0-4e52-bc99-4a0581e4f353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:34.686161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 185/380] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:34.686997 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616d970-5dc0-4e52-bc99-4a0581e4f353 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:34.687327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00ce82-6f74-4eee-a0fa-ef536b80d64a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:34.694526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 196/381] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 1 16:16:34 2022] GET /identity/v3/role_assignments?group.id=43cafd596965463abb31f787496cb49f&scope.project.id=f1932bfa4cf144bf9a1f6249a0b89aa8&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:34.808934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00ce82-6f74-4eee-a0fa-ef536b80d64a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:34.847428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b241df1-1b89-4eb1-a436-5a441efa6b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:34.848290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b241df1-1b89-4eb1-a436-5a441efa6b67 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:34.848713 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b241df1-1b89-4eb1-a436-5a441efa6b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:34.849153 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b241df1-1b89-4eb1-a436-5a441efa6b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:34.850636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b241df1-1b89-4eb1-a436-5a441efa6b67 None admin] RBAC: Adding query filter params (group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role.id=57a8970530a24c16b8d86a333768e765, scope.project.id=5d7a7332da9346c680fa5fdc04291231) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:34.851113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b241df1-1b89-4eb1-a436-5a441efa6b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:34.853079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b241df1-1b89-4eb1-a436-5a441efa6b67 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:34.859639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 186/382] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 1 16:16:34 2022] GET /identity/v3/role_assignments?group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=57a8970530a24c16b8d86a333768e765 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:35.120399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616d970-5dc0-4e52-bc99-4a0581e4f353 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:35.237015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616d970-5dc0-4e52-bc99-4a0581e4f353 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:35.264950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:35.278154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472289d6-9ed3-4a65-a844-b212458e1114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:35.285988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472289d6-9ed3-4a65-a844-b212458e1114 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:35.285988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472289d6-9ed3-4a65-a844-b212458e1114 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:35.285988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472289d6-9ed3-4a65-a844-b212458e1114 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:35.295582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472289d6-9ed3-4a65-a844-b212458e1114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-472289d6-9ed3-4a65-a844-b212458e1114 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:35.300474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:35.301479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:35.302321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:35.304480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 197/383] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:35.310088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b241df1-1b89-4eb1-a436-5a441efa6b67 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:35.333969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:35.432729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b241df1-1b89-4eb1-a436-5a441efa6b67 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:35.479513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebbfaa-2a44-4bbf-be9d-91337abaf1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:35.480134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebbfaa-2a44-4bbf-be9d-91337abaf1dc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:35.480416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebbfaa-2a44-4bbf-be9d-91337abaf1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:35.480688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebbfaa-2a44-4bbf-be9d-91337abaf1dc None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:35.481356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebbfaa-2a44-4bbf-be9d-91337abaf1dc None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:35.481658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebbfaa-2a44-4bbf-be9d-91337abaf1dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:35.483060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ebbfaa-2a44-4bbf-be9d-91337abaf1dc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:35.498589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 187/384] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:35.500745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472289d6-9ed3-4a65-a844-b212458e1114 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:35.614864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472289d6-9ed3-4a65-a844-b212458e1114 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:35.653646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc1461-3141-4d6e-9be7-620c48dba123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:35.654376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1461-3141-4d6e-9be7-620c48dba123 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:35.654651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1461-3141-4d6e-9be7-620c48dba123 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:35.654978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1461-3141-4d6e-9be7-620c48dba123 None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:35.656111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc1461-3141-4d6e-9be7-620c48dba123 None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:35.657553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc1461-3141-4d6e-9be7-620c48dba123 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:35.664729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 198/385] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:35 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:35.666136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebbfaa-2a44-4bbf-be9d-91337abaf1dc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:35.756532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:35.763509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5fd3b-b8b2-4045-9b1c-e54e4d715e25 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:35.763842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5fd3b-b8b2-4045-9b1c-e54e4d715e25 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:35.764101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5fd3b-b8b2-4045-9b1c-e54e4d715e25 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:35.765388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 199/386] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:35.797688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebbfaa-2a44-4bbf-be9d-91337abaf1dc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:35.805614 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647248-8211-4c71-ae3c-6d34abb9e1f3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:35.805930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647248-8211-4c71-ae3c-6d34abb9e1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:35.806195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0647248-8211-4c71-ae3c-6d34abb9e1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:35.842913 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c0647248-8211-4c71-ae3c-6d34abb9e1f3 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:35.843893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc5332-a98c-46da-8834-42ddf79b2a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:35.844783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc5332-a98c-46da-8834-42ddf79b2a4b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:35.846240 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c0647248-8211-4c71-ae3c-6d34abb9e1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:35.846370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc5332-a98c-46da-8834-42ddf79b2a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:35.846539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc5332-a98c-46da-8834-42ddf79b2a4b None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:35.851408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc5332-a98c-46da-8834-42ddf79b2a4b None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:35.857628 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc5332-a98c-46da-8834-42ddf79b2a4b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:35.859607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 188/387] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:35 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:35.866263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc5332-a98c-46da-8834-42ddf79b2a4b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:35.925263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:35.951220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 200/388] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:35.952810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26129104-40ce-4995-8377-a658bb0c6f75 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:35.953302 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26129104-40ce-4995-8377-a658bb0c6f75 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:35.954389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26129104-40ce-4995-8377-a658bb0c6f75 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:35.957130 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 201/389] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:35.965486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b663358-6d63-47db-ba57-8c462189e9e7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:35.966375 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b663358-6d63-47db-ba57-8c462189e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:35.966874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b663358-6d63-47db-ba57-8c462189e9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:36.000283 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6b663358-6d63-47db-ba57-8c462189e9e7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:36.001469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6b663358-6d63-47db-ba57-8c462189e9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:36.060053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc5332-a98c-46da-8834-42ddf79b2a4b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:36.131151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 202/390] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:36.133308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73598ea6-2a17-48a2-9cfe-8fb211c8baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:36.134318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73598ea6-2a17-48a2-9cfe-8fb211c8baa3 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:36.134805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73598ea6-2a17-48a2-9cfe-8fb211c8baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:36.135303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73598ea6-2a17-48a2-9cfe-8fb211c8baa3 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:36.143136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73598ea6-2a17-48a2-9cfe-8fb211c8baa3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b, group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:36.144779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73598ea6-2a17-48a2-9cfe-8fb211c8baa3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:36.221070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 189/391] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Sep 1 16:16:35 2022] PUT /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:16:36.334557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b663358-6d63-47db-ba57-8c462189e9e7 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:36.431982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73598ea6-2a17-48a2-9cfe-8fb211c8baa3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:36.442004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:36.460096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b663358-6d63-47db-ba57-8c462189e9e7 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:36.478834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:36.512495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2a900-f748-4b61-938b-f6eecb06dc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:36.514824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2a900-f748-4b61-938b-f6eecb06dc4c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:36.514824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2a900-f748-4b61-938b-f6eecb06dc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:36.514824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2a900-f748-4b61-938b-f6eecb06dc4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:36.528076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2a900-f748-4b61-938b-f6eecb06dc4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4eb2a900-f748-4b61-938b-f6eecb06dc4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:36.534897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:36.535929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:36.537036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:36.540240 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 203/392] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:36.548798 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2a900-f748-4b61-938b-f6eecb06dc4c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:36.615778 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73598ea6-2a17-48a2-9cfe-8fb211c8baa3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:36.689623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916f1c6-6139-45b7-bd26-71615587f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:36.690994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f1c6-6139-45b7-bd26-71615587f8ea None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:36.691414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f1c6-6139-45b7-bd26-71615587f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:36.691820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916f1c6-6139-45b7-bd26-71615587f8ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:36.718038 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916f1c6-6139-45b7-bd26-71615587f8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-2916f1c6-6139-45b7-bd26-71615587f8ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:36.726766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:36.728202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:36.729195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:36.735304 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 190/393] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:16:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:36.742849 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916f1c6-6139-45b7-bd26-71615587f8ea None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:36.744860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2a900-f748-4b61-938b-f6eecb06dc4c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:36.785977 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a57a-7eb4-4765-97f5-f0bac24eb64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:36.787000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a57a-7eb4-4765-97f5-f0bac24eb64a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:36.787417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a57a-7eb4-4765-97f5-f0bac24eb64a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:36.787954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121a57a-7eb4-4765-97f5-f0bac24eb64a None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:36.788754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121a57a-7eb4-4765-97f5-f0bac24eb64a None admin] RBAC: Adding query filter params (name=member) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:36.789240 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121a57a-7eb4-4765-97f5-f0bac24eb64a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:36.790831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121a57a-7eb4-4765-97f5-f0bac24eb64a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:36.800514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 204/394] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:36.806988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a57a-7eb4-4765-97f5-f0bac24eb64a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:36.851289 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:36.856244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:36.920181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916f1c6-6139-45b7-bd26-71615587f8ea None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:36.923906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121a57a-7eb4-4765-97f5-f0bac24eb64a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:36.960455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a325-9dca-4558-b57d-08f187e65342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:36.961106 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a325-9dca-4558-b57d-08f187e65342 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:36.961439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a325-9dca-4558-b57d-08f187e65342 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:36.961716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a325-9dca-4558-b57d-08f187e65342 None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:36.962917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129a325-9dca-4558-b57d-08f187e65342 None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:36.964464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129a325-9dca-4558-b57d-08f187e65342 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:36.966412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 205/395] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:36 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:36.972099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a325-9dca-4558-b57d-08f187e65342 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:36.999647 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6749f3-47ef-48be-a75d-4994ed0f75d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:37.000289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6749f3-47ef-48be-a75d-4994ed0f75d1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:37.000576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6749f3-47ef-48be-a75d-4994ed0f75d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:37.000850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6749f3-47ef-48be-a75d-4994ed0f75d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:37.001521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6749f3-47ef-48be-a75d-4994ed0f75d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:37.001826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6749f3-47ef-48be-a75d-4994ed0f75d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:37.003250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6749f3-47ef-48be-a75d-4994ed0f75d1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:37.028245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 191/396] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:37.045210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6749f3-47ef-48be-a75d-4994ed0f75d1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:37.092964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a325-9dca-4558-b57d-08f187e65342 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:37.102705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:37.144334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f35830-92a0-446d-93ce-5d673198e920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:37.144992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f35830-92a0-446d-93ce-5d673198e920 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:37.145272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f35830-92a0-446d-93ce-5d673198e920 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:37.145548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f35830-92a0-446d-93ce-5d673198e920 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:37.146777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f35830-92a0-446d-93ce-5d673198e920 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:37.148641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f35830-92a0-446d-93ce-5d673198e920 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:37.150512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 206/397] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:36 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:37.156124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f35830-92a0-446d-93ce-5d673198e920 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:37.252313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6749f3-47ef-48be-a75d-4994ed0f75d1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:37.277996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f35830-92a0-446d-93ce-5d673198e920 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:37.298549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:37.317773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae0804-3141-4127-a89e-9ccf7a0460b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:37.318666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae0804-3141-4127-a89e-9ccf7a0460b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:37.319052 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae0804-3141-4127-a89e-9ccf7a0460b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:37.319411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae0804-3141-4127-a89e-9ccf7a0460b2 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:37.321548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae0804-3141-4127-a89e-9ccf7a0460b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d7a7332da9346c680fa5fdc04291231, group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:37.323176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae0804-3141-4127-a89e-9ccf7a0460b2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:37.324826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca72179-2ba5-48ee-83a5-c8fb4d84b4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:37.324942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72179-2ba5-48ee-83a5-c8fb4d84b4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:37.325138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72179-2ba5-48ee-83a5-c8fb4d84b4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:37.326944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72179-2ba5-48ee-83a5-c8fb4d84b4a3 None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:37.331902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca72179-2ba5-48ee-83a5-c8fb4d84b4a3 None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:37.331902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca72179-2ba5-48ee-83a5-c8fb4d84b4a3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:37.332789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 192/398] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:37 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:37.334196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd7acf-fba6-4232-90ca-d643c0ad5cbf None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:37.335022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd7acf-fba6-4232-90ca-d643c0ad5cbf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:37.335338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd7acf-fba6-4232-90ca-d643c0ad5cbf None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:37.337273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 193/399] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:37.338102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd7acf-fba6-4232-90ca-d643c0ad5cbf None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:37.411550 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 207/400] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Sep 1 16:16:37 2022] PUT /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:16:37.413593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2edbd2-2d56-4e25-98ef-49156258a375 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:37.414049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2edbd2-2d56-4e25-98ef-49156258a375 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:37.414327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2edbd2-2d56-4e25-98ef-49156258a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:37.449444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1f2edbd2-2d56-4e25-98ef-49156258a375 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:37.451121 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1f2edbd2-2d56-4e25-98ef-49156258a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:37.464717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd7acf-fba6-4232-90ca-d643c0ad5cbf None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:37.505026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c96b2-27fc-46f8-9006-f7ab094b2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:37.505596 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c96b2-27fc-46f8-9006-f7ab094b2d69 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:37.505895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c96b2-27fc-46f8-9006-f7ab094b2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:37.506175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c96b2-27fc-46f8-9006-f7ab094b2d69 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:37.507817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c96b2-27fc-46f8-9006-f7ab094b2d69 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:37.509301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c96b2-27fc-46f8-9006-f7ab094b2d69 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:37.511222 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 194/401] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:37 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:37.514258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:37.517073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c96b2-27fc-46f8-9006-f7ab094b2d69 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:37.588770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:37.608487 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 208/402] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:37.633552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c96b2-27fc-46f8-9006-f7ab094b2d69 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:37.672311 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca7049f-134b-43a4-b2dd-01296f74e311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:37.672997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7049f-134b-43a4-b2dd-01296f74e311 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:37.673280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7049f-134b-43a4-b2dd-01296f74e311 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:37.673554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca7049f-134b-43a4-b2dd-01296f74e311 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f/roles/57a8970530a24c16b8d86a333768e765` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:37.675848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7049f-134b-43a4-b2dd-01296f74e311 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b, group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role_id=57a8970530a24c16b8d86a333768e765)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:37.677382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca7049f-134b-43a4-b2dd-01296f74e311 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:37.786695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 195/403] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Sep 1 16:16:37 2022] PUT /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f/roles/57a8970530a24c16b8d86a333768e765 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:16:37.844231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074fa4-7880-42f9-b5a4-aed367c235fd None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:37.844750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074fa4-7880-42f9-b5a4-aed367c235fd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:37.844750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074fa4-7880-42f9-b5a4-aed367c235fd None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:37.846392 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 209/404] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:37.852495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3cb33-603d-4160-93ca-5123ca25baa7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:37.852793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3cb33-603d-4160-93ca-5123ca25baa7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:37.853044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3cb33-603d-4160-93ca-5123ca25baa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:37.872787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-40f3cb33-603d-4160-93ca-5123ca25baa7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:37.874081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-40f3cb33-603d-4160-93ca-5123ca25baa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:37.923508 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074fa4-7880-42f9-b5a4-aed367c235fd None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:37.989807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 196/405] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:38.089317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074fa4-7880-42f9-b5a4-aed367c235fd None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:38.140083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d50df6-370e-4241-93a5-3a860246ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:38.140728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d50df6-370e-4241-93a5-3a860246ee10 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:38.141006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d50df6-370e-4241-93a5-3a860246ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:38.141277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d50df6-370e-4241-93a5-3a860246ee10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:38.153008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d50df6-370e-4241-93a5-3a860246ee10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-47d50df6-370e-4241-93a5-3a860246ee10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:38.157805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:38.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:38.159525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 210/406] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:16:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:38.167020 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3cb33-603d-4160-93ca-5123ca25baa7 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:38.260638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:38.316489 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3cb33-603d-4160-93ca-5123ca25baa7 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:38.347301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d50df6-370e-4241-93a5-3a860246ee10 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:38.373307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a43f6-09fe-401a-ae0c-9501de89e074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:38.373307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a43f6-09fe-401a-ae0c-9501de89e074 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:38.373307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a43f6-09fe-401a-ae0c-9501de89e074 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:38.373307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a43f6-09fe-401a-ae0c-9501de89e074 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:38.375483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a43f6-09fe-401a-ae0c-9501de89e074 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:38.375483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a43f6-09fe-401a-ae0c-9501de89e074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:38.375483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a43f6-09fe-401a-ae0c-9501de89e074 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:38.382987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:38.401321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 197/407] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:38.404216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a43f6-09fe-401a-ae0c-9501de89e074 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:38.538521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d50df6-370e-4241-93a5-3a860246ee10 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:38.583684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a43f6-09fe-401a-ae0c-9501de89e074 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:38.611345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11babc-6175-44a0-bcc1-dfc9e07e182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:38.612304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11babc-6175-44a0-bcc1-dfc9e07e182f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:38.613483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11babc-6175-44a0-bcc1-dfc9e07e182f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:38.613976 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11babc-6175-44a0-bcc1-dfc9e07e182f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:38.619345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:38.640799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11babc-6175-44a0-bcc1-dfc9e07e182f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-af11babc-6175-44a0-bcc1-dfc9e07e182f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:38.646058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:38.647204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:38.648500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:38.656342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 211/408] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:16:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:38.663590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11babc-6175-44a0-bcc1-dfc9e07e182f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:38.668804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c866edf-0d32-46b3-9a00-d3bb548a6d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:38.669723 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c866edf-0d32-46b3-9a00-d3bb548a6d2e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:38.670255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c866edf-0d32-46b3-9a00-d3bb548a6d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:38.670734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c866edf-0d32-46b3-9a00-d3bb548a6d2e None admin] PATH_INFO: `/v3/groups/43cafd596965463abb31f787496cb49f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:38.672121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c866edf-0d32-46b3-9a00-d3bb548a6d2e None admin] RBAC: Authorizing `identity:get_group(group_id=43cafd596965463abb31f787496cb49f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:38.673749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c866edf-0d32-46b3-9a00-d3bb548a6d2e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:38.675721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 198/409] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:38 2022] GET /identity/v3/groups/43cafd596965463abb31f787496cb49f => generated 229 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:38.683129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c866edf-0d32-46b3-9a00-d3bb548a6d2e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:38.794256 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:38.809514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11babc-6175-44a0-bcc1-dfc9e07e182f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:38.827699 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c866edf-0d32-46b3-9a00-d3bb548a6d2e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:38.858184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2421b5-76c3-4b98-914d-e6ce94b3f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:38.858788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2421b5-76c3-4b98-914d-e6ce94b3f91e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:38.859191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2421b5-76c3-4b98-914d-e6ce94b3f91e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:38.859528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2421b5-76c3-4b98-914d-e6ce94b3f91e None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:38.860537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2421b5-76c3-4b98-914d-e6ce94b3f91e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:38.860923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2421b5-76c3-4b98-914d-e6ce94b3f91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:38.863139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2421b5-76c3-4b98-914d-e6ce94b3f91e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:38.872580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4180e-ba22-4682-aa05-7141e0402127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:38.873309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4180e-ba22-4682-aa05-7141e0402127 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:38.873661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4180e-ba22-4682-aa05-7141e0402127 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:38.874030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4180e-ba22-4682-aa05-7141e0402127 None admin] PATH_INFO: `/v3/projects/f1932bfa4cf144bf9a1f6249a0b89aa8` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:38.878151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4180e-ba22-4682-aa05-7141e0402127 None admin] RBAC: Authorizing `identity:get_project(project_id=f1932bfa4cf144bf9a1f6249a0b89aa8)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:38.878151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4180e-ba22-4682-aa05-7141e0402127 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:38.878441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 212/411] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:38.879949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9d4b-4555-4703-a2bb-2c5b5feadf08 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:38.880385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9d4b-4555-4703-a2bb-2c5b5feadf08 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:38.880828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9d4b-4555-4703-a2bb-2c5b5feadf08 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:38.883225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 199/411] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:38 2022] GET /identity/v3/projects/f1932bfa4cf144bf9a1f6249a0b89aa8 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:38.884103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 213/412] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:38.884224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4180e-ba22-4682-aa05-7141e0402127 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:38.885147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c9d4b-4555-4703-a2bb-2c5b5feadf08 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:38.957519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:39.003380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c9d4b-4555-4703-a2bb-2c5b5feadf08 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:39.022628 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4180e-ba22-4682-aa05-7141e0402127 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:39.044153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11012de-aef8-4778-ae69-262797543045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:39.044960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11012de-aef8-4778-ae69-262797543045 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:39.045238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11012de-aef8-4778-ae69-262797543045 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:39.045514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11012de-aef8-4778-ae69-262797543045 None admin] PATH_INFO: `/v3/projects/f1932bfa4cf144bf9a1f6249a0b89aa8/groups/43cafd596965463abb31f787496cb49f/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:39.047762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11012de-aef8-4778-ae69-262797543045 None admin] RBAC: Authorizing `identity:create_grant(project_id=f1932bfa4cf144bf9a1f6249a0b89aa8, group_id=43cafd596965463abb31f787496cb49f, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:39.049195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11012de-aef8-4778-ae69-262797543045 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:39.064263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174e441-f10d-4f94-882d-5e37cb79ef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:39.078145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174e441-f10d-4f94-882d-5e37cb79ef2a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:39.078145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174e441-f10d-4f94-882d-5e37cb79ef2a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:39.078145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174e441-f10d-4f94-882d-5e37cb79ef2a None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:39.078145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174e441-f10d-4f94-882d-5e37cb79ef2a None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:39.078145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174e441-f10d-4f94-882d-5e37cb79ef2a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:39.078145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 200/413] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:38 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:39.078581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34ccb2-ffd0-4498-8176-73e406bc9bcd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:39.078581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34ccb2-ffd0-4498-8176-73e406bc9bcd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:39.078581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34ccb2-ffd0-4498-8176-73e406bc9bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:39.095416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fa34ccb2-ffd0-4498-8176-73e406bc9bcd None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:39.096624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fa34ccb2-ffd0-4498-8176-73e406bc9bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:39.160685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 214/414] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Sep 1 16:16:38 2022] PUT /identity/v3/projects/f1932bfa4cf144bf9a1f6249a0b89aa8/groups/43cafd596965463abb31f787496cb49f/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:16:39.160685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11012de-aef8-4778-ae69-262797543045 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:39.167904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:39.221021 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 201/415] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:39.331956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11012de-aef8-4778-ae69-262797543045 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:39.383305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46d5ba-ad87-4b8a-893e-c2997df2d6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:39.383958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46d5ba-ad87-4b8a-893e-c2997df2d6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:39.384234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46d5ba-ad87-4b8a-893e-c2997df2d6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:39.384503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46d5ba-ad87-4b8a-893e-c2997df2d6d2 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:39.386603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46d5ba-ad87-4b8a-893e-c2997df2d6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:39.388249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46d5ba-ad87-4b8a-893e-c2997df2d6d2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:39.390469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 215/416] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:39 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:39.398999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34ccb2-ffd0-4498-8176-73e406bc9bcd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:39.472696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:39.534093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34ccb2-ffd0-4498-8176-73e406bc9bcd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:39.587405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27979882-68c7-4a4e-a21e-7723ef04e5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:39.588102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27979882-68c7-4a4e-a21e-7723ef04e5a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:39.588380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27979882-68c7-4a4e-a21e-7723ef04e5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:39.588654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27979882-68c7-4a4e-a21e-7723ef04e5a1 None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f/roles/57a8970530a24c16b8d86a333768e765` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:39.590989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27979882-68c7-4a4e-a21e-7723ef04e5a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d7a7332da9346c680fa5fdc04291231, group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role_id=57a8970530a24c16b8d86a333768e765)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:39.592452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27979882-68c7-4a4e-a21e-7723ef04e5a1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:39.688885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46d5ba-ad87-4b8a-893e-c2997df2d6d2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:39.696733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 202/417] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Sep 1 16:16:39 2022] PUT /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f/roles/57a8970530a24c16b8d86a333768e765 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:16:39.715979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fedd4-d090-4e75-b8cf-68e75c6d0344 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:39.716281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fedd4-d090-4e75-b8cf-68e75c6d0344 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:39.716522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fedd4-d090-4e75-b8cf-68e75c6d0344 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:39.718431 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 203/418] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:16:39.723661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fee10-b516-4a97-9d5f-d15ac022d6df None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:39.726620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fee10-b516-4a97-9d5f-d15ac022d6df None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:39.728975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fee10-b516-4a97-9d5f-d15ac022d6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:39.770773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9f7fee10-b516-4a97-9d5f-d15ac022d6df None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:39.774598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9f7fee10-b516-4a97-9d5f-d15ac022d6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:39.830273 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:39.877919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46d5ba-ad87-4b8a-893e-c2997df2d6d2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:39.901929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 204/419] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 01 16:16:39.919263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48386495-a2f3-436f-8d54-3b305e426738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:39.919901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48386495-a2f3-436f-8d54-3b305e426738 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:39.920177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48386495-a2f3-436f-8d54-3b305e426738 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:39.920440 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48386495-a2f3-436f-8d54-3b305e426738 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:39.932150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48386495-a2f3-436f-8d54-3b305e426738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-48386495-a2f3-436f-8d54-3b305e426738 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:39.937479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:39.938453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:39.939514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 216/420] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:39.947354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fee10-b516-4a97-9d5f-d15ac022d6df None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:39.994344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:40.057202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fee10-b516-4a97-9d5f-d15ac022d6df None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:40.094299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3f374-79d1-4a71-a2bf-1a7bc2323236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:40.094913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3f374-79d1-4a71-a2bf-1a7bc2323236 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:40.095190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3f374-79d1-4a71-a2bf-1a7bc2323236 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:40.095460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3f374-79d1-4a71-a2bf-1a7bc2323236 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:40.096119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3f374-79d1-4a71-a2bf-1a7bc2323236 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:40.096417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3f374-79d1-4a71-a2bf-1a7bc2323236 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:40.097766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3f374-79d1-4a71-a2bf-1a7bc2323236 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:40.107803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 205/421] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:40.113398 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48386495-a2f3-436f-8d54-3b305e426738 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:40.240383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48386495-a2f3-436f-8d54-3b305e426738 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:40.244595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3f374-79d1-4a71-a2bf-1a7bc2323236 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:40.297173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:40.306158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7717e472-bd8f-48c7-8941-ede52ac6e0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:40.306768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e472-bd8f-48c7-8941-ede52ac6e0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:40.307044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e472-bd8f-48c7-8941-ede52ac6e0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:40.307312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7717e472-bd8f-48c7-8941-ede52ac6e0d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:40.392800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3f374-79d1-4a71-a2bf-1a7bc2323236 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:40.394452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:40.401403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717e472-bd8f-48c7-8941-ede52ac6e0d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:40.403354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7717e472-bd8f-48c7-8941-ede52ac6e0d9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:40.435549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3d3c1-69b3-4a49-ab0c-304f5256f200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:40.436204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3d3c1-69b3-4a49-ab0c-304f5256f200 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:40.436485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3d3c1-69b3-4a49-ab0c-304f5256f200 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:40.436759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3d3c1-69b3-4a49-ab0c-304f5256f200 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:40.448497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3d3c1-69b3-4a49-ab0c-304f5256f200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-eed3d3c1-69b3-4a49-ab0c-304f5256f200 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:40.454563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:40.455978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 16:16:40.457533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:40.461497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 206/422] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:40.464091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270c84-13b8-488e-bd8c-fba7f2df94da None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:40.464091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270c84-13b8-488e-bd8c-fba7f2df94da None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:40.464316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270c84-13b8-488e-bd8c-fba7f2df94da None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:40.465572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 207/423] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:40.469618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9270c84-13b8-488e-bd8c-fba7f2df94da None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:40.546781 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 217/424] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:40.548730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c5021-1b81-4b12-82e1-0c95bbe306b8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:40.549271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c5021-1b81-4b12-82e1-0c95bbe306b8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:40.549752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c5021-1b81-4b12-82e1-0c95bbe306b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:40.570862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c52c5021-1b81-4b12-82e1-0c95bbe306b8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:40.572563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c52c5021-1b81-4b12-82e1-0c95bbe306b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:40.611964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9270c84-13b8-488e-bd8c-fba7f2df94da None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:40.617721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:40.660218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e07832-5c24-45f2-b6e7-3f0f20c0f3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:40.660843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07832-5c24-45f2-b6e7-3f0f20c0f3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:40.661124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07832-5c24-45f2-b6e7-3f0f20c0f3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:40.661396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e07832-5c24-45f2-b6e7-3f0f20c0f3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:40.662256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e07832-5c24-45f2-b6e7-3f0f20c0f3f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:40.662564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e07832-5c24-45f2-b6e7-3f0f20c0f3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:40.665289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e07832-5c24-45f2-b6e7-3f0f20c0f3f7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:40.682200 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 218/426] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:40.682495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 208/426] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:16:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:40.683315 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e07832-5c24-45f2-b6e7-3f0f20c0f3f7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:40.684196 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c5021-1b81-4b12-82e1-0c95bbe306b8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:40.715144 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:40.853997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e07832-5c24-45f2-b6e7-3f0f20c0f3f7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:40.923158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d738fe-484f-449f-bf44-21428f494f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:40.925081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d738fe-484f-449f-bf44-21428f494f98 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:40.925685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d738fe-484f-449f-bf44-21428f494f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:40.926521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d738fe-484f-449f-bf44-21428f494f98 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:40.929679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d738fe-484f-449f-bf44-21428f494f98 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:40.932233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d738fe-484f-449f-bf44-21428f494f98 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:40.936174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 209/427] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:40 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:40.942738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d738fe-484f-449f-bf44-21428f494f98 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:40.978279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c5021-1b81-4b12-82e1-0c95bbe306b8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:41.029264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424ad89-7900-4d80-9dcd-7234c15d2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:41.030038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424ad89-7900-4d80-9dcd-7234c15d2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:41.030384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424ad89-7900-4d80-9dcd-7234c15d2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:41.030721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424ad89-7900-4d80-9dcd-7234c15d2fd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:41.061729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:41.090790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:41.100137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d738fe-484f-449f-bf44-21428f494f98 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:41.107869 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424ad89-7900-4d80-9dcd-7234c15d2fd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:41.111441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424ad89-7900-4d80-9dcd-7234c15d2fd5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:41.140520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d7f42-cfb6-4fbb-9bf6-c9a764140b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:41.141196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7f42-cfb6-4fbb-9bf6-c9a764140b3f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:41.141475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7f42-cfb6-4fbb-9bf6-c9a764140b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:41.141745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7f42-cfb6-4fbb-9bf6-c9a764140b3f None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:41.142978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d7f42-cfb6-4fbb-9bf6-c9a764140b3f None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:41.144418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d7f42-cfb6-4fbb-9bf6-c9a764140b3f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:41.146476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 210/428] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:40 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:41.147906 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d7f42-cfb6-4fbb-9bf6-c9a764140b3f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:41.231268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 219/429] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:41.232596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424ad89-7900-4d80-9dcd-7234c15d2fd5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:41.263534 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d7f42-cfb6-4fbb-9bf6-c9a764140b3f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:41.297571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:41.301989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587697c1-aa5f-48a2-b74d-041b229904ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:41.302631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587697c1-aa5f-48a2-b74d-041b229904ef None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:41.302907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587697c1-aa5f-48a2-b74d-041b229904ef None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:41.303257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587697c1-aa5f-48a2-b74d-041b229904ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:41.314831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587697c1-aa5f-48a2-b74d-041b229904ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-587697c1-aa5f-48a2-b74d-041b229904ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:41.320388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:41.321297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 211/430] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:16:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:41.326868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587697c1-aa5f-48a2-b74d-041b229904ef None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:41.346138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:41.359185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424ad89-7900-4d80-9dcd-7234c15d2fd5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:41.398305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966416e2-68de-4481-baa8-38127fa463d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:41.399212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966416e2-68de-4481-baa8-38127fa463d3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:41.399638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966416e2-68de-4481-baa8-38127fa463d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:41.400054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966416e2-68de-4481-baa8-38127fa463d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:41.400940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966416e2-68de-4481-baa8-38127fa463d3 None admin] RBAC: Adding query filter params (group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role.id=eb63c7589f0c472b9e1abd79cbdd7528, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:41.401405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966416e2-68de-4481-baa8-38127fa463d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:41.403147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966416e2-68de-4481-baa8-38127fa463d3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:41.410346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 220/431] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 1 16:16:41 2022] GET /identity/v3/role_assignments?group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:41.411484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966416e2-68de-4481-baa8-38127fa463d3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:41.470938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587697c1-aa5f-48a2-b74d-041b229904ef None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:41.546419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a571a62-0eff-4043-b1db-c4f1f62c630a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:41.547100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a571a62-0eff-4043-b1db-c4f1f62c630a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:41.547804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a571a62-0eff-4043-b1db-c4f1f62c630a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:41.547804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a571a62-0eff-4043-b1db-c4f1f62c630a None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:41.548854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a571a62-0eff-4043-b1db-c4f1f62c630a None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:41.550363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a571a62-0eff-4043-b1db-c4f1f62c630a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:41.552080 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 212/432] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:41 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:41.553521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b370-57e8-4d53-a0a9-b39461a4f6c8 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:41.553870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b370-57e8-4d53-a0a9-b39461a4f6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:41.554168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b370-57e8-4d53-a0a9-b39461a4f6c8 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:41.555606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 213/433] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:41.561791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b370-57e8-4d53-a0a9-b39461a4f6c8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:41.605545 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966416e2-68de-4481-baa8-38127fa463d3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:41.640248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:41.653469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100014c-f969-45b3-9afc-97d59d65bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:41.654511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100014c-f969-45b3-9afc-97d59d65bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:41.661608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100014c-f969-45b3-9afc-97d59d65bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:41.661608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100014c-f969-45b3-9afc-97d59d65bdf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:41.661608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100014c-f969-45b3-9afc-97d59d65bdf7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:41.661608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100014c-f969-45b3-9afc-97d59d65bdf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:41.661608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100014c-f969-45b3-9afc-97d59d65bdf7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:41.668596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 221/434] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:41.674651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159be14-832c-429c-a677-b0213a6f54e4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:41.674932 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159be14-832c-429c-a677-b0213a6f54e4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:41.675270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159be14-832c-429c-a677-b0213a6f54e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:41.687929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:41.706546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c159be14-832c-429c-a677-b0213a6f54e4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:41.707774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c159be14-832c-429c-a677-b0213a6f54e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:41.711551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b370-57e8-4d53-a0a9-b39461a4f6c8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:41.754284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd241b8-73e3-4594-b2f9-d61911734e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:41.755055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd241b8-73e3-4594-b2f9-d61911734e25 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:41.755338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd241b8-73e3-4594-b2f9-d61911734e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:41.755711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd241b8-73e3-4594-b2f9-d61911734e25 None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:41.756978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd241b8-73e3-4594-b2f9-d61911734e25 None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:41.758603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd241b8-73e3-4594-b2f9-d61911734e25 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:41.760580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 214/435] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:41 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:41.761375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd241b8-73e3-4594-b2f9-d61911734e25 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:41.805949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 222/436] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:41.807097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159be14-832c-429c-a677-b0213a6f54e4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:41.914987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd241b8-73e3-4594-b2f9-d61911734e25 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:41.942662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159be14-832c-429c-a677-b0213a6f54e4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:41.954710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdde02-fe35-4bc9-9bc4-27fe3d8d78e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:41.955270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdde02-fe35-4bc9-9bc4-27fe3d8d78e5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:41.955359 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdde02-fe35-4bc9-9bc4-27fe3d8d78e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:41.955622 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdde02-fe35-4bc9-9bc4-27fe3d8d78e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:41.965397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:41.985593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f60d7b-4151-4054-8317-17ab551839a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:41.987251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60d7b-4151-4054-8317-17ab551839a3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:41.987740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60d7b-4151-4054-8317-17ab551839a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:41.988165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f60d7b-4151-4054-8317-17ab551839a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:41.989848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:41.989985 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f60d7b-4151-4054-8317-17ab551839a3 None admin] RBAC: Adding query filter params (group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role.id=eb63c7589f0c472b9e1abd79cbdd7528, scope.project.id=5d7a7332da9346c680fa5fdc04291231) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:41.989985 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f60d7b-4151-4054-8317-17ab551839a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:41.992200 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f60d7b-4151-4054-8317-17ab551839a3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:41.999348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 223/437] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 1 16:16:41 2022] GET /identity/v3/role_assignments?group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=eb63c7589f0c472b9e1abd79cbdd7528 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:42.046769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdde02-fe35-4bc9-9bc4-27fe3d8d78e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:42.048247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdde02-fe35-4bc9-9bc4-27fe3d8d78e5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:42.168613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f60d7b-4151-4054-8317-17ab551839a3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:42.220486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 215/438] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:42.226882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdde02-fe35-4bc9-9bc4-27fe3d8d78e5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:42.315340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:42.329186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f60d7b-4151-4054-8317-17ab551839a3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:42.365585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdde02-fe35-4bc9-9bc4-27fe3d8d78e5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:42.366678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e177d1f-5041-4451-9c45-bb24ea90bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:42.367312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177d1f-5041-4451-9c45-bb24ea90bf77 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:42.367586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177d1f-5041-4451-9c45-bb24ea90bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:42.367853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e177d1f-5041-4451-9c45-bb24ea90bf77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:42.378854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e177d1f-5041-4451-9c45-bb24ea90bf77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4e177d1f-5041-4451-9c45-bb24ea90bf77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:42.383901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:42.384979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:42.385991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 224/439] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:16:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:42.388283 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98787c-6f19-4f40-bdef-8434feb77ac5 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:42.388565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98787c-6f19-4f40-bdef-8434feb77ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:42.388838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98787c-6f19-4f40-bdef-8434feb77ac5 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:42.392329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 225/440] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:42.392329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98787c-6f19-4f40-bdef-8434feb77ac5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:42.419180 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b25ee-3b3f-4cc4-8918-dcd58864c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:42.419735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b25ee-3b3f-4cc4-8918-dcd58864c849 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:42.420016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b25ee-3b3f-4cc4-8918-dcd58864c849 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:42.420286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b25ee-3b3f-4cc4-8918-dcd58864c849 None admin] PATH_INFO: `/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:42.422025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b25ee-3b3f-4cc4-8918-dcd58864c849 None admin] RBAC: Authorizing `identity:get_project(project_id=e9d466d9e83d40f1ad5c126b1a8f4b0b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:42.423484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b25ee-3b3f-4cc4-8918-dcd58864c849 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:42.425156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 216/441] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:42 2022] GET /identity/v3/projects/e9d466d9e83d40f1ad5c126b1a8f4b0b => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:42.426373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edba0f-cf40-4071-8829-3aa38d7e9661 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:42.426660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edba0f-cf40-4071-8829-3aa38d7e9661 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:42.426936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edba0f-cf40-4071-8829-3aa38d7e9661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:42.443610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:42.445683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-27edba0f-cf40-4071-8829-3aa38d7e9661 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:42.446974 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-27edba0f-cf40-4071-8829-3aa38d7e9661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:42.515661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98787c-6f19-4f40-bdef-8434feb77ac5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:42.527839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 217/442] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:42.528707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edba0f-cf40-4071-8829-3aa38d7e9661 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:42.555565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a3acd-255e-40b4-afd6-498203884ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:42.556548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a3acd-255e-40b4-afd6-498203884ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:42.557015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a3acd-255e-40b4-afd6-498203884ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:42.557430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a3acd-255e-40b4-afd6-498203884ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:42.558395 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a3acd-255e-40b4-afd6-498203884ce1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:42.558750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a3acd-255e-40b4-afd6-498203884ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:42.561054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a3acd-255e-40b4-afd6-498203884ce1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:42.581786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 226/443] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:42.583189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a3acd-255e-40b4-afd6-498203884ce1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:42.611038 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:42.662914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edba0f-cf40-4071-8829-3aa38d7e9661 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:42.703072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393820c-4f68-478d-8e33-481b05cd453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:42.703630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393820c-4f68-478d-8e33-481b05cd453b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:42.703897 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393820c-4f68-478d-8e33-481b05cd453b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:42.704166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393820c-4f68-478d-8e33-481b05cd453b None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:42.705266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393820c-4f68-478d-8e33-481b05cd453b None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:42.706734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393820c-4f68-478d-8e33-481b05cd453b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:42.707263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a3acd-255e-40b4-afd6-498203884ce1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:42.708611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 218/444] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:42 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:42.709264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:42.715257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393820c-4f68-478d-8e33-481b05cd453b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:42.745645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e408b-4b95-4bd6-837e-64e9c01e0e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:42.746304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e408b-4b95-4bd6-837e-64e9c01e0e51 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:42.746597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e408b-4b95-4bd6-837e-64e9c01e0e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:42.746858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e408b-4b95-4bd6-837e-64e9c01e0e51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:42.825844 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e408b-4b95-4bd6-837e-64e9c01e0e51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:42.826296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393820c-4f68-478d-8e33-481b05cd453b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:42.827336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e408b-4b95-4bd6-837e-64e9c01e0e51 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:42.856334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:42.870152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35395c-93a7-4868-a04c-6c647a37307d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:42.870763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35395c-93a7-4868-a04c-6c647a37307d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:42.871226 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35395c-93a7-4868-a04c-6c647a37307d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:42.871395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35395c-93a7-4868-a04c-6c647a37307d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:42.872148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35395c-93a7-4868-a04c-6c647a37307d None admin] RBAC: Adding query filter params (group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role.id=57a8970530a24c16b8d86a333768e765, scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:42.872449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35395c-93a7-4868-a04c-6c647a37307d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:42.873870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e35395c-93a7-4868-a04c-6c647a37307d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:42.880918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 219/445] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 1 16:16:42 2022] GET /identity/v3/role_assignments?group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f&scope.project.id=e9d466d9e83d40f1ad5c126b1a8f4b0b&role.id=57a8970530a24c16b8d86a333768e765 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:42.882410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35395c-93a7-4868-a04c-6c647a37307d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:42.946507 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 227/446] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 16:16:42.953004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e408b-4b95-4bd6-837e-64e9c01e0e51 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:42.955689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:43.020429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35395c-93a7-4868-a04c-6c647a37307d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:43.077123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ceb3d-2a3d-46f9-a4e5-653a97cf9e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:43.077985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ceb3d-2a3d-46f9-a4e5-653a97cf9e36 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:43.078363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ceb3d-2a3d-46f9-a4e5-653a97cf9e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:43.078729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ceb3d-2a3d-46f9-a4e5-653a97cf9e36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:43.099744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ceb3d-2a3d-46f9-a4e5-653a97cf9e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:43.101527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e408b-4b95-4bd6-837e-64e9c01e0e51 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-7d8ceb3d-2a3d-46f9-a4e5-653a97cf9e36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:43.106435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:43.107356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:43.108346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 220/447] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:16:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:43.115537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ceb3d-2a3d-46f9-a4e5-653a97cf9e36 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:43.160341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef04d2-bc42-48b0-b8d8-3253fac310b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:43.161164 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef04d2-bc42-48b0-b8d8-3253fac310b5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:43.161506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef04d2-bc42-48b0-b8d8-3253fac310b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:43.161787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef04d2-bc42-48b0-b8d8-3253fac310b5 None admin] PATH_INFO: `/v3/projects/f1932bfa4cf144bf9a1f6249a0b89aa8` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:43.163609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef04d2-bc42-48b0-b8d8-3253fac310b5 None admin] RBAC: Authorizing `identity:get_project(project_id=f1932bfa4cf144bf9a1f6249a0b89aa8)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:43.170376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef04d2-bc42-48b0-b8d8-3253fac310b5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:43.170376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 228/448] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:42 2022] GET /identity/v3/projects/f1932bfa4cf144bf9a1f6249a0b89aa8 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:43.176401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef04d2-bc42-48b0-b8d8-3253fac310b5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:43.184878 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:43.265748 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ceb3d-2a3d-46f9-a4e5-653a97cf9e36 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:43.277124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:43.315038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef04d2-bc42-48b0-b8d8-3253fac310b5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:43.320662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a9af3-bb93-4861-b732-e21fb2e3ac08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:43.321397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a9af3-bb93-4861-b732-e21fb2e3ac08 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:43.321784 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a9af3-bb93-4861-b732-e21fb2e3ac08 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:43.322326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a9af3-bb93-4861-b732-e21fb2e3ac08 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:43.325396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a9af3-bb93-4861-b732-e21fb2e3ac08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:43.325396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a9af3-bb93-4861-b732-e21fb2e3ac08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:43.325396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a9af3-bb93-4861-b732-e21fb2e3ac08 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:43.333377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 221/449] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:43.339927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a9af3-bb93-4861-b732-e21fb2e3ac08 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:43.370529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa299c-309e-4b59-b22b-591f70c2fb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:43.371176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa299c-309e-4b59-b22b-591f70c2fb2e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:43.371451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa299c-309e-4b59-b22b-591f70c2fb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:43.371717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa299c-309e-4b59-b22b-591f70c2fb2e None admin] PATH_INFO: `/v3/groups/43cafd596965463abb31f787496cb49f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:43.372858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa299c-309e-4b59-b22b-591f70c2fb2e None admin] RBAC: Authorizing `identity:get_group(group_id=43cafd596965463abb31f787496cb49f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:43.374345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa299c-309e-4b59-b22b-591f70c2fb2e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:43.376271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 229/450] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:43 2022] GET /identity/v3/groups/43cafd596965463abb31f787496cb49f => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:43.382162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa299c-309e-4b59-b22b-591f70c2fb2e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:43.498169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a9af3-bb93-4861-b732-e21fb2e3ac08 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:43.507810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:43.515380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa299c-309e-4b59-b22b-591f70c2fb2e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:43.538286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b662d-e5c7-4423-98f5-603eed61f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:43.539059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b662d-e5c7-4423-98f5-603eed61f989 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:43.539342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b662d-e5c7-4423-98f5-603eed61f989 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:43.539618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b662d-e5c7-4423-98f5-603eed61f989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:43.562157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5dfb7-104e-4511-9336-9a3b451ff0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:43.562769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5dfb7-104e-4511-9336-9a3b451ff0fd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:43.563050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5dfb7-104e-4511-9336-9a3b451ff0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:43.563320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5dfb7-104e-4511-9336-9a3b451ff0fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:43.564051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5dfb7-104e-4511-9336-9a3b451ff0fd None admin] RBAC: Adding query filter params (group.id=43cafd596965463abb31f787496cb49f, role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=f1932bfa4cf144bf9a1f6249a0b89aa8) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:43.564360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5dfb7-104e-4511-9336-9a3b451ff0fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:43.565792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5dfb7-104e-4511-9336-9a3b451ff0fd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:43.572710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 230/451] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 1 16:16:43 2022] GET /identity/v3/role_assignments?group.id=43cafd596965463abb31f787496cb49f&scope.project.id=f1932bfa4cf144bf9a1f6249a0b89aa8&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:16:43.616912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b662d-e5c7-4423-98f5-603eed61f989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:43.618487 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b662d-e5c7-4423-98f5-603eed61f989 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:43.735198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 222/452] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:43.741823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5dfb7-104e-4511-9336-9a3b451ff0fd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:43.744897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:43.853342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5dfb7-104e-4511-9336-9a3b451ff0fd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:43.887475 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4111b8-85de-49df-a90d-d617cbd419be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:43.888114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4111b8-85de-49df-a90d-d617cbd419be None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:43.888396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4111b8-85de-49df-a90d-d617cbd419be None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:43.888670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4111b8-85de-49df-a90d-d617cbd419be None admin] PATH_INFO: `/v3/projects/5d7a7332da9346c680fa5fdc04291231` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:43.889843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4111b8-85de-49df-a90d-d617cbd419be None admin] RBAC: Authorizing `identity:get_project(project_id=5d7a7332da9346c680fa5fdc04291231)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:43.891361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4111b8-85de-49df-a90d-d617cbd419be None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:43.893085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 231/453] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:16:43 2022] GET /identity/v3/projects/5d7a7332da9346c680fa5fdc04291231 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:43.899552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b662d-e5c7-4423-98f5-603eed61f989 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:43.909870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:44.011823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b662d-e5c7-4423-98f5-603eed61f989 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:44.045311 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926da59-1044-4b14-8a05-a72eafe0de50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:44.045950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926da59-1044-4b14-8a05-a72eafe0de50 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:44.046239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926da59-1044-4b14-8a05-a72eafe0de50 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:44.046514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926da59-1044-4b14-8a05-a72eafe0de50 None admin] PATH_INFO: `/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:44.047616 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926da59-1044-4b14-8a05-a72eafe0de50 None admin] RBAC: Authorizing `identity:get_group(group_id=5f25d3d45b5d4ff59f7bc8c9a4eb275f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:44.049043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926da59-1044-4b14-8a05-a72eafe0de50 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:44.050642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 223/454] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Sep 1 16:16:43 2022] GET /identity/v3/groups/5f25d3d45b5d4ff59f7bc8c9a4eb275f => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:44.057060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4111b8-85de-49df-a90d-d617cbd419be None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:44.127133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:44.157661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4111b8-85de-49df-a90d-d617cbd419be None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:44.191711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f33036-4996-4511-b02c-b351edf2590f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:44.192317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f33036-4996-4511-b02c-b351edf2590f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:44.192603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f33036-4996-4511-b02c-b351edf2590f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:44.192876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f33036-4996-4511-b02c-b351edf2590f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:44.193604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f33036-4996-4511-b02c-b351edf2590f None admin] RBAC: Adding query filter params (group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f, role.id=57a8970530a24c16b8d86a333768e765, scope.project.id=5d7a7332da9346c680fa5fdc04291231) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:44.194154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f33036-4996-4511-b02c-b351edf2590f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:44.195597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f33036-4996-4511-b02c-b351edf2590f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:44.204540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 232/455] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Sep 1 16:16:44 2022] GET /identity/v3/role_assignments?group.id=5f25d3d45b5d4ff59f7bc8c9a4eb275f&scope.project.id=5d7a7332da9346c680fa5fdc04291231&role.id=57a8970530a24c16b8d86a333768e765 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:46.988804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48a345-3373-4479-abb7-d8a742477742 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:46.989358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48a345-3373-4479-abb7-d8a742477742 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:46.989358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48a345-3373-4479-abb7-d8a742477742 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:46.992119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 224/456] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:46.996601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f540e-9dbf-479f-a68f-8f7ef55707ea None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:46.997688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f540e-9dbf-479f-a68f-8f7ef55707ea None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:46.998186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f540e-9dbf-479f-a68f-8f7ef55707ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:47.027004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-188f540e-9dbf-479f-a68f-8f7ef55707ea None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:47.028582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-188f540e-9dbf-479f-a68f-8f7ef55707ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:47.123817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 233/457] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:47.158867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24711f62-65b0-48ae-821a-1d1271620018 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:47.159483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24711f62-65b0-48ae-821a-1d1271620018 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:47.159953 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24711f62-65b0-48ae-821a-1d1271620018 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:47.161777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 225/458] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:47.167030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9047f4-d927-440f-983f-a7f6ccbdf590 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:47.167321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9047f4-d927-440f-983f-a7f6ccbdf590 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:47.167600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9047f4-d927-440f-983f-a7f6ccbdf590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:47.190769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-de9047f4-d927-440f-983f-a7f6ccbdf590 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:47.191967 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-de9047f4-d927-440f-983f-a7f6ccbdf590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:47.284077 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:47.296401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 234/459] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:47.417033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3f90c-2fcd-4a09-b61b-39769b21b11a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:47.417675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3f90c-2fcd-4a09-b61b-39769b21b11a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:47.418186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3f90c-2fcd-4a09-b61b-39769b21b11a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:47.420039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 226/460] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:47.425178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cade8-8731-44ed-9d47-6face1aa81b2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:47.425527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cade8-8731-44ed-9d47-6face1aa81b2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:47.425810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cade8-8731-44ed-9d47-6face1aa81b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:47.430391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3f90c-2fcd-4a09-b61b-39769b21b11a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:47.449028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-148cade8-8731-44ed-9d47-6face1aa81b2 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:47.450658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-148cade8-8731-44ed-9d47-6face1aa81b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:47.526653 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 235/461] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:47.591771 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:47.621934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3f90c-2fcd-4a09-b61b-39769b21b11a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:47.639368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cade8-8731-44ed-9d47-6face1aa81b2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:47.665508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21113004-2b6f-4680-8e09-eaa9e0493aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:47.666222 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21113004-2b6f-4680-8e09-eaa9e0493aab None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:47.666506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21113004-2b6f-4680-8e09-eaa9e0493aab None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:47.667108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21113004-2b6f-4680-8e09-eaa9e0493aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:47.679030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21113004-2b6f-4680-8e09-eaa9e0493aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:47.681089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21113004-2b6f-4680-8e09-eaa9e0493aab None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-21113004-2b6f-4680-8e09-eaa9e0493aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:47.702847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:47.703842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:47.704720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:47.704720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:47.704720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:47.710249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 227/462] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:47.711192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21113004-2b6f-4680-8e09-eaa9e0493aab None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:47.827898 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cade8-8731-44ed-9d47-6face1aa81b2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:47.840390 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21113004-2b6f-4680-8e09-eaa9e0493aab None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:47.864687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:47.875406 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:47.877539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe49a3-e5ec-43cf-b415-b7b7d60cf872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:47.878221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe49a3-e5ec-43cf-b415-b7b7d60cf872 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:47.878592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe49a3-e5ec-43cf-b415-b7b7d60cf872 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:47.878877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe49a3-e5ec-43cf-b415-b7b7d60cf872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:47.886910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e1c81-9198-41f6-8907-a67a2a3eb4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:47.888170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e1c81-9198-41f6-8907-a67a2a3eb4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:47.888601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e1c81-9198-41f6-8907-a67a2a3eb4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:47.889612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e1c81-9198-41f6-8907-a67a2a3eb4c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:47.890113 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe49a3-e5ec-43cf-b415-b7b7d60cf872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:47.891140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e1c81-9198-41f6-8907-a67a2a3eb4c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:47.891593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe49a3-e5ec-43cf-b415-b7b7d60cf872 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:47.892186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e1c81-9198-41f6-8907-a67a2a3eb4c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:47.894405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e1c81-9198-41f6-8907-a67a2a3eb4c6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4dfe49a3-e5ec-43cf-b415-b7b7d60cf872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:47.910464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:47.911636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:47.913209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:47.913209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:47.913209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:47.913209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 236/463] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:47.913862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d933-695c-44df-81df-27d81e259934 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:47.914363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d933-695c-44df-81df-27d81e259934 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:47.914646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3d933-695c-44df-81df-27d81e259934 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:47.916263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 237/464] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:47.917155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3d933-695c-44df-81df-27d81e259934 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:47.922723 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 228/465] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:47.924036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e1c81-9198-41f6-8907-a67a2a3eb4c6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:48.035012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3d933-695c-44df-81df-27d81e259934 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:48.045271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e1c81-9198-41f6-8907-a67a2a3eb4c6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:48.071345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fb716-6a47-4685-ac0b-789215f61d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:48.071986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fb716-6a47-4685-ac0b-789215f61d83 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:48.072268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fb716-6a47-4685-ac0b-789215f61d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:48.072543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fb716-6a47-4685-ac0b-789215f61d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:48.082524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349224ec-80b3-44a9-a96a-ad7d05b8ce74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:48.083185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349224ec-80b3-44a9-a96a-ad7d05b8ce74 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:48.083472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349224ec-80b3-44a9-a96a-ad7d05b8ce74 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:48.083745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349224ec-80b3-44a9-a96a-ad7d05b8ce74 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:48.083876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fb716-6a47-4685-ac0b-789215f61d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:48.085134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349224ec-80b3-44a9-a96a-ad7d05b8ce74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:48.085441 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349224ec-80b3-44a9-a96a-ad7d05b8ce74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:48.085854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1fb716-6a47-4685-ac0b-789215f61d83 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:48.086837 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349224ec-80b3-44a9-a96a-ad7d05b8ce74 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-3d1fb716-6a47-4685-ac0b-789215f61d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:48.102008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:48.103154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:48.104054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:48.104054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:48.104054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:48.104054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 238/466] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:48.104275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca059f8-f06e-44fa-937b-e9d60ce487a8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:48.104806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca059f8-f06e-44fa-937b-e9d60ce487a8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:48.104806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca059f8-f06e-44fa-937b-e9d60ce487a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:48.114668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 229/467] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:48.114668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349224ec-80b3-44a9-a96a-ad7d05b8ce74 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:48.128612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0ca059f8-f06e-44fa-937b-e9d60ce487a8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:48.129832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0ca059f8-f06e-44fa-937b-e9d60ce487a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:48.155982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:48.171478 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:48.214270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 239/468] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:48.215193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca059f8-f06e-44fa-937b-e9d60ce487a8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:48.262877 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349224ec-80b3-44a9-a96a-ad7d05b8ce74 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:48.301947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83245b4b-22c9-4345-8631-5318c55d3d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:48.302564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83245b4b-22c9-4345-8631-5318c55d3d73 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:48.302841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83245b4b-22c9-4345-8631-5318c55d3d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:48.303244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83245b4b-22c9-4345-8631-5318c55d3d73 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:48.304011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83245b4b-22c9-4345-8631-5318c55d3d73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:48.305527 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83245b4b-22c9-4345-8631-5318c55d3d73 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:48.326361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca059f8-f06e-44fa-937b-e9d60ce487a8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:48.362544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1ec84-0048-412f-828b-68dcd74d3961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:48.363147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ec84-0048-412f-828b-68dcd74d3961 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:48.363419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ec84-0048-412f-828b-68dcd74d3961 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:48.363686 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1ec84-0048-412f-828b-68dcd74d3961 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:48.364318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1ec84-0048-412f-828b-68dcd74d3961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:48.364612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1ec84-0048-412f-828b-68dcd74d3961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:48.366050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1ec84-0048-412f-828b-68dcd74d3961 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:48.378261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 240/469] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:48.379443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1ec84-0048-412f-828b-68dcd74d3961 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:48.403037 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:48.423167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 230/470] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:16:48 2022] POST /identity/v3/users => generated 246 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:16:48.424467 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8541f-6160-4d47-9fc5-86cd68affc62 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:48.424754 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8541f-6160-4d47-9fc5-86cd68affc62 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:48.425022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8541f-6160-4d47-9fc5-86cd68affc62 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:48.426519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 231/471] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:48.427059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8541f-6160-4d47-9fc5-86cd68affc62 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:48.531205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1ec84-0048-412f-828b-68dcd74d3961 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:48.569277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85063fe-c85a-4030-9072-addf388da3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:48.570030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85063fe-c85a-4030-9072-addf388da3ac None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:48.570315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85063fe-c85a-4030-9072-addf388da3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:48.570587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85063fe-c85a-4030-9072-addf388da3ac None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:48.571253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85063fe-c85a-4030-9072-addf388da3ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:48.572727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85063fe-c85a-4030-9072-addf388da3ac None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:48.574586 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8541f-6160-4d47-9fc5-86cd68affc62 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:48.577208 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:48.613780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b439a-ce1f-40df-8641-e27ee978e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:48.614416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b439a-ce1f-40df-8641-e27ee978e1f4 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:48.614693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b439a-ce1f-40df-8641-e27ee978e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:48.614961 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b439a-ce1f-40df-8641-e27ee978e1f4 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:48.616291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b439a-ce1f-40df-8641-e27ee978e1f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:48.617648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b439a-ce1f-40df-8641-e27ee978e1f4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:48.660510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 241/472] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:16:48 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:16:48.661764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c688479-81bd-48b5-8b6d-cf99b98dadcc None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:48.666344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c688479-81bd-48b5-8b6d-cf99b98dadcc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:48.666344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c688479-81bd-48b5-8b6d-cf99b98dadcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:48.683804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0c688479-81bd-48b5-8b6d-cf99b98dadcc None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:48.685039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0c688479-81bd-48b5-8b6d-cf99b98dadcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:48.722476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 232/473] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:16:48 2022] POST /identity/v3/users => generated 248 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:16:48.729507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b439a-ce1f-40df-8641-e27ee978e1f4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:48.843186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 242/474] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:48.925602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b439a-ce1f-40df-8641-e27ee978e1f4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:48.965480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67001775-c68c-4fa0-806d-b80c65db78f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:48.966155 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67001775-c68c-4fa0-806d-b80c65db78f3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:48.966438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67001775-c68c-4fa0-806d-b80c65db78f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:48.966715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67001775-c68c-4fa0-806d-b80c65db78f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:48.980912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67001775-c68c-4fa0-806d-b80c65db78f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:48.982414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67001775-c68c-4fa0-806d-b80c65db78f3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-67001775-c68c-4fa0-806d-b80c65db78f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:48.998555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:48.999551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:49.000405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:49.000405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:49.000405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:49.000405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 233/475] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:49.005491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c688479-81bd-48b5-8b6d-cf99b98dadcc None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:49.009829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:49.121556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c688479-81bd-48b5-8b6d-cf99b98dadcc None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:49.167143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67001775-c68c-4fa0-806d-b80c65db78f3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:49.187164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:49.187330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ede034-7815-406d-9bca-fbc623e0f763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:49.187919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ede034-7815-406d-9bca-fbc623e0f763 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:49.189907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ede034-7815-406d-9bca-fbc623e0f763 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:49.189907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ede034-7815-406d-9bca-fbc623e0f763 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:49.189907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ede034-7815-406d-9bca-fbc623e0f763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:49.189907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ede034-7815-406d-9bca-fbc623e0f763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:49.190788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ede034-7815-406d-9bca-fbc623e0f763 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:49.218216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 243/476] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:49.222719 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ede034-7815-406d-9bca-fbc623e0f763 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:49.347534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:49.357154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67001775-c68c-4fa0-806d-b80c65db78f3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:49.407421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632a2dc-d7b0-4eb5-9afb-7d05beb1e4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:49.408378 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632a2dc-d7b0-4eb5-9afb-7d05beb1e4d2 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:49.408666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632a2dc-d7b0-4eb5-9afb-7d05beb1e4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:49.408941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632a2dc-d7b0-4eb5-9afb-7d05beb1e4d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:49.409967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632a2dc-d7b0-4eb5-9afb-7d05beb1e4d2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:49.411300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b632a2dc-d7b0-4eb5-9afb-7d05beb1e4d2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:49.423386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ede034-7815-406d-9bca-fbc623e0f763 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:49.448351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.sql.core [None req-b632a2dc-d7b0-4eb5-9afb-7d05beb1e4d2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:16:49.448351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 16:16:49.448351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [parameters: {'id': 'e9b0e40c9254410cae2ee1f64a0cf18e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 16:16:49.448351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81784) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:16:49.471200 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4f643-3a60-4422-9c4a-90c9ee3b2f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:49.471822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4f643-3a60-4422-9c4a-90c9ee3b2f27 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:49.472097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4f643-3a60-4422-9c4a-90c9ee3b2f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:49.472364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4f643-3a60-4422-9c4a-90c9ee3b2f27 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:49.473021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4f643-3a60-4422-9c4a-90c9ee3b2f27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:49.474541 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4f643-3a60-4422-9c4a-90c9ee3b2f27 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-b632a2dc-d7b0-4eb5-9afb-7d05beb1e4d2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result.read() Sep 01 16:16:49.479822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:16:49.480750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application yield resource Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise self.value Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application session.commit() Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:16:49.481696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:16:49.482631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:16:49.483550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result.read() Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:16:49.484386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [parameters: {'id': 'e9b0e40c9254410cae2ee1f64a0cf18e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:49.485261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 16:16:49.487646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:49.489615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 234/477] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Sep 1 16:16:49 2022] POST /identity/v3/roles => generated 144 bytes in 315 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:49.489615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632a2dc-d7b0-4eb5-9afb-7d05beb1e4d2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:49.582155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 244/478] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:16:49 2022] POST /identity/v3/users => generated 249 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:16:49.590545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:49.617818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632a2dc-d7b0-4eb5-9afb-7d05beb1e4d2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:49.666170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5150ea-1d84-4a1b-a3ed-0ab106bb4dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:49.667074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5150ea-1d84-4a1b-a3ed-0ab106bb4dce None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:49.667353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5150ea-1d84-4a1b-a3ed-0ab106bb4dce None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:49.667623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5150ea-1d84-4a1b-a3ed-0ab106bb4dce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:49.683920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5150ea-1d84-4a1b-a3ed-0ab106bb4dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-fc5150ea-1d84-4a1b-a3ed-0ab106bb4dce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:49.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:49.691481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:49.693429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 235/479] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:16:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:49.698016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4f643-3a60-4422-9c4a-90c9ee3b2f27 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:49.853156 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4f643-3a60-4422-9c4a-90c9ee3b2f27 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:49.874943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:49.890745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6008-b09e-451e-aef6-36ae1a0471b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:49.891524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6008-b09e-451e-aef6-36ae1a0471b7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:49.891778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6008-b09e-451e-aef6-36ae1a0471b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:49.893639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6008-b09e-451e-aef6-36ae1a0471b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:49.893639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b6008-b09e-451e-aef6-36ae1a0471b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:49.893639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b6008-b09e-451e-aef6-36ae1a0471b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:49.894538 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b6008-b09e-451e-aef6-36ae1a0471b7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:49.907028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 245/480] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:50.984217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530d3fb-10ae-40a3-94ef-b2c734af92df None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:50.984217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530d3fb-10ae-40a3-94ef-b2c734af92df None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:50.984217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530d3fb-10ae-40a3-94ef-b2c734af92df None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:50.984217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 236/481] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:50.991360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052003-5834-4cf3-9ab0-bd2ed07c0c6b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:50.992233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052003-5834-4cf3-9ab0-bd2ed07c0c6b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:50.992710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11052003-5834-4cf3-9ab0-bd2ed07c0c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:51.012978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-11052003-5834-4cf3-9ab0-bd2ed07c0c6b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:51.014573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-11052003-5834-4cf3-9ab0-bd2ed07c0c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:51.093987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 246/482] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:51.170456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b074c-7eb0-462f-af7e-ec7b2c1553c4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:51.170783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b074c-7eb0-462f-af7e-ec7b2c1553c4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:51.171012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b074c-7eb0-462f-af7e-ec7b2c1553c4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:51.172633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 237/483] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:51.178221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9e500-6358-4b79-a977-daf35003a4fe None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:51.178509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9e500-6358-4b79-a977-daf35003a4fe None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:51.178788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9e500-6358-4b79-a977-daf35003a4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:51.207795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b7e9e500-6358-4b79-a977-daf35003a4fe None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:51.208987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b7e9e500-6358-4b79-a977-daf35003a4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:51.268999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c45b3-caf1-4545-a6d7-2c47b0e10bcb None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:51.269283 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c45b3-caf1-4545-a6d7-2c47b0e10bcb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:51.269456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c45b3-caf1-4545-a6d7-2c47b0e10bcb None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:51.271052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 238/484] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:51.276562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea485e8-f01b-47e3-a822-2d1a0c7208d4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:51.276830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea485e8-f01b-47e3-a822-2d1a0c7208d4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:51.278484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea485e8-f01b-47e3-a822-2d1a0c7208d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:51.308664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 247/485] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:51.313926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-aea485e8-f01b-47e3-a822-2d1a0c7208d4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:51.313926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-aea485e8-f01b-47e3-a822-2d1a0c7208d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:51.399380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 239/486] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:51.493000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9e500-6358-4b79-a977-daf35003a4fe None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:51.557534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:51.641494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9e500-6358-4b79-a977-daf35003a4fe None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:51.652058 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea485e8-f01b-47e3-a822-2d1a0c7208d4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:51.710779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e97e6b-c7ec-4771-a906-aa42867d9344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:51.711442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e97e6b-c7ec-4771-a906-aa42867d9344 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:51.711723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e97e6b-c7ec-4771-a906-aa42867d9344 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:51.712032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e97e6b-c7ec-4771-a906-aa42867d9344 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:51.735142 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:51.737464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e97e6b-c7ec-4771-a906-aa42867d9344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-05e97e6b-c7ec-4771-a906-aa42867d9344 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:51.744276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:51.745210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:51.746506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 248/487] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:51.754954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e97e6b-c7ec-4771-a906-aa42867d9344 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:51.793298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea485e8-f01b-47e3-a822-2d1a0c7208d4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:51.882672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681117d-6b2e-4f97-87fa-243ca3efe080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:51.883279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681117d-6b2e-4f97-87fa-243ca3efe080 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:51.883562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681117d-6b2e-4f97-87fa-243ca3efe080 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:51.884078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681117d-6b2e-4f97-87fa-243ca3efe080 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:51.905176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681117d-6b2e-4f97-87fa-243ca3efe080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0681117d-6b2e-4f97-87fa-243ca3efe080 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:51.910518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:51.911417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:51.912702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 240/488] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:51.914475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681117d-6b2e-4f97-87fa-243ca3efe080 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:51.927126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e97e6b-c7ec-4771-a906-aa42867d9344 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:51.929764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:51.969115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02005eb5-9f05-4d9d-b315-e1ed7d65a12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:51.969900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02005eb5-9f05-4d9d-b315-e1ed7d65a12d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:51.970286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02005eb5-9f05-4d9d-b315-e1ed7d65a12d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:51.970748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02005eb5-9f05-4d9d-b315-e1ed7d65a12d None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:51.971854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02005eb5-9f05-4d9d-b315-e1ed7d65a12d None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:51.972077 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02005eb5-9f05-4d9d-b315-e1ed7d65a12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:51.973578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02005eb5-9f05-4d9d-b315-e1ed7d65a12d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:51.984159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 249/489] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:51.988930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02005eb5-9f05-4d9d-b315-e1ed7d65a12d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:52.051536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681117d-6b2e-4f97-87fa-243ca3efe080 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:52.086864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:52.097003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec177cb-9409-484c-ac79-bea8eaab95b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:52.100494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec177cb-9409-484c-ac79-bea8eaab95b0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.100494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec177cb-9409-484c-ac79-bea8eaab95b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.100494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec177cb-9409-484c-ac79-bea8eaab95b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.113638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec177cb-9409-484c-ac79-bea8eaab95b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:52.119398 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02005eb5-9f05-4d9d-b315-e1ed7d65a12d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-bec177cb-9409-484c-ac79-bea8eaab95b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:52.120517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:52.121400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:52.122367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:52.130100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 241/490] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:52.132095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec177cb-9409-484c-ac79-bea8eaab95b0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:52.170302 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8e339-9dc3-4ed0-a7cf-22754fa024e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:52.170929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e339-9dc3-4ed0-a7cf-22754fa024e2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.171208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e339-9dc3-4ed0-a7cf-22754fa024e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.171501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8e339-9dc3-4ed0-a7cf-22754fa024e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.172595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8e339-9dc3-4ed0-a7cf-22754fa024e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:52.173045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8e339-9dc3-4ed0-a7cf-22754fa024e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:52.174609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8e339-9dc3-4ed0-a7cf-22754fa024e2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:52.189959 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 250/491] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:52.192006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8e339-9dc3-4ed0-a7cf-22754fa024e2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:52.232676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:52.258228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec177cb-9409-484c-ac79-bea8eaab95b0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:52.302583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2aa80-423c-4b7d-885d-c866de1c542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:52.304217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2aa80-423c-4b7d-885d-c866de1c542d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.304514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2aa80-423c-4b7d-885d-c866de1c542d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.305135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd2aa80-423c-4b7d-885d-c866de1c542d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.314475 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8e339-9dc3-4ed0-a7cf-22754fa024e2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:52.315847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2aa80-423c-4b7d-885d-c866de1c542d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:52.317331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd2aa80-423c-4b7d-885d-c866de1c542d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0fd2aa80-423c-4b7d-885d-c866de1c542d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:52.333446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:52.335152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:52.336001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:52.336001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:52.336001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:52.340049 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 242/492] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:52.340761 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2aa80-423c-4b7d-885d-c866de1c542d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:52.353759 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d88e5-24c7-4b37-bce0-7254ca9c582f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:52.354398 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d88e5-24c7-4b37-bce0-7254ca9c582f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.354990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d88e5-24c7-4b37-bce0-7254ca9c582f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.355261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d88e5-24c7-4b37-bce0-7254ca9c582f None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.356081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d88e5-24c7-4b37-bce0-7254ca9c582f None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:52.356381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d88e5-24c7-4b37-bce0-7254ca9c582f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:52.357742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d88e5-24c7-4b37-bce0-7254ca9c582f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:52.367613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 251/493] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:52.368870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1ed2-8aae-48d3-9336-d63d0e5fcdfb None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.369155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1ed2-8aae-48d3-9336-d63d0e5fcdfb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.369423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1ed2-8aae-48d3-9336-d63d0e5fcdfb None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.374010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 252/494] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:52.374010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a1ed2-8aae-48d3-9336-d63d0e5fcdfb None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:52.392564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:52.462180 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd2aa80-423c-4b7d-885d-c866de1c542d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:52.474406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:52.488463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5a1ed2-8aae-48d3-9336-d63d0e5fcdfb None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:52.498313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc94191-4167-4c9c-804a-6b17578fe48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:52.498946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94191-4167-4c9c-804a-6b17578fe48e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.499227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94191-4167-4c9c-804a-6b17578fe48e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.499498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc94191-4167-4c9c-804a-6b17578fe48e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.510653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc94191-4167-4c9c-804a-6b17578fe48e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:52.512128 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc94191-4167-4c9c-804a-6b17578fe48e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:52.524879 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81680224-1740-4fa4-a767-cfe2a2ac347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:52.525495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680224-1740-4fa4-a767-cfe2a2ac347f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.525772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680224-1740-4fa4-a767-cfe2a2ac347f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.526076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81680224-1740-4fa4-a767-cfe2a2ac347f None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.526725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81680224-1740-4fa4-a767-cfe2a2ac347f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:52.527024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81680224-1740-4fa4-a767-cfe2a2ac347f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:52.528379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81680224-1740-4fa4-a767-cfe2a2ac347f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-5bc94191-4167-4c9c-804a-6b17578fe48e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:52.529201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:52.530363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:52.531660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:52.531660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:52.531660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:52.532055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 243/495] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:52.532886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc94191-4167-4c9c-804a-6b17578fe48e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:52.545275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 253/496] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:52.545275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce7fee-879b-4e88-ba7d-c584cecb3d99 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.545275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce7fee-879b-4e88-ba7d-c584cecb3d99 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.545275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce7fee-879b-4e88-ba7d-c584cecb3d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.561672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f1ce7fee-879b-4e88-ba7d-c584cecb3d99 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:52.562894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f1ce7fee-879b-4e88-ba7d-c584cecb3d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:52.629259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:52.633303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 254/497] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:52.635222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a359e17-bf27-47ff-8ba0-ff33aa0b7046 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.635506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a359e17-bf27-47ff-8ba0-ff33aa0b7046 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.635780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a359e17-bf27-47ff-8ba0-ff33aa0b7046 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.638260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 255/498] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:52.638260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a359e17-bf27-47ff-8ba0-ff33aa0b7046 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:52.644353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc94191-4167-4c9c-804a-6b17578fe48e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:52.683199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d640e-cfd5-4c50-9bda-345cb40dedc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:52.683952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d640e-cfd5-4c50-9bda-345cb40dedc7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.684581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d640e-cfd5-4c50-9bda-345cb40dedc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.684917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d640e-cfd5-4c50-9bda-345cb40dedc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.697260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d640e-cfd5-4c50-9bda-345cb40dedc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:52.698889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d640e-cfd5-4c50-9bda-345cb40dedc7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-723d640e-cfd5-4c50-9bda-345cb40dedc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:52.714793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:52.715947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:52.717240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:52.717240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:52.717240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:52.717240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 244/499] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:52.717240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d640e-cfd5-4c50-9bda-345cb40dedc7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:52.742220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:52.771508 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a359e17-bf27-47ff-8ba0-ff33aa0b7046 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:52.811165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cd33f-ca9f-45e9-8db6-048c522d3d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:52.812010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd33f-ca9f-45e9-8db6-048c522d3d09 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.812426 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd33f-ca9f-45e9-8db6-048c522d3d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.812857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cd33f-ca9f-45e9-8db6-048c522d3d09 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.813645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cd33f-ca9f-45e9-8db6-048c522d3d09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:52.813972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cd33f-ca9f-45e9-8db6-048c522d3d09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:52.815333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cd33f-ca9f-45e9-8db6-048c522d3d09 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:52.826261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d640e-cfd5-4c50-9bda-345cb40dedc7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:52.831942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 256/500] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:52.831942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57b50-9e6f-4444-b60c-b9a7005f5f01 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.831942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57b50-9e6f-4444-b60c-b9a7005f5f01 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.831942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d57b50-9e6f-4444-b60c-b9a7005f5f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.850866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c4d57b50-9e6f-4444-b60c-b9a7005f5f01 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:52.852081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c4d57b50-9e6f-4444-b60c-b9a7005f5f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:52.865781 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd2ed8-392b-4d77-b301-dc8cbd8a7603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:52.866677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2ed8-392b-4d77-b301-dc8cbd8a7603 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:52.867027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2ed8-392b-4d77-b301-dc8cbd8a7603 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:52.867362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2ed8-392b-4d77-b301-dc8cbd8a7603 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:52.876617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd2ed8-392b-4d77-b301-dc8cbd8a7603 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:52.878116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd2ed8-392b-4d77-b301-dc8cbd8a7603 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-affd2ed8-392b-4d77-b301-dc8cbd8a7603 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:16:52.891989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:52.892920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 245/501] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 1 16:16:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:52.893847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd2ed8-392b-4d77-b301-dc8cbd8a7603 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:52.901701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:52.932931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 257/502] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:52.934021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d57b50-9e6f-4444-b60c-b9a7005f5f01 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:53.008000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:53.012302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd2ed8-392b-4d77-b301-dc8cbd8a7603 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:53.045760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d57b50-9e6f-4444-b60c-b9a7005f5f01 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:53.047932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a2775-25ed-44fb-8c9b-a42507dd0ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:53.048557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a2775-25ed-44fb-8c9b-a42507dd0ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:53.048835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a2775-25ed-44fb-8c9b-a42507dd0ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:53.049110 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a2775-25ed-44fb-8c9b-a42507dd0ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:53.049757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a2775-25ed-44fb-8c9b-a42507dd0ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:53.050092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a2775-25ed-44fb-8c9b-a42507dd0ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:53.051472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a2775-25ed-44fb-8c9b-a42507dd0ed9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:53.065565 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 246/503] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:53.066479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a2775-25ed-44fb-8c9b-a42507dd0ed9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:53.090587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28fc2f-3b9d-41ad-ab8a-9342c532d006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:53.091534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28fc2f-3b9d-41ad-ab8a-9342c532d006 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:53.091997 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28fc2f-3b9d-41ad-ab8a-9342c532d006 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:53.092273 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28fc2f-3b9d-41ad-ab8a-9342c532d006 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:53.103236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28fc2f-3b9d-41ad-ab8a-9342c532d006 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:53.104813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28fc2f-3b9d-41ad-ab8a-9342c532d006 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2c28fc2f-3b9d-41ad-ab8a-9342c532d006 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:16:53.120723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:53.127377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 258/504] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:53.128327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28fc2f-3b9d-41ad-ab8a-9342c532d006 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:53.149485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:53.194583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a2775-25ed-44fb-8c9b-a42507dd0ed9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:53.231377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48543295-4d69-4b66-8e9d-c5a573da3267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:53.231982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48543295-4d69-4b66-8e9d-c5a573da3267 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:53.232257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48543295-4d69-4b66-8e9d-c5a573da3267 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:53.232523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48543295-4d69-4b66-8e9d-c5a573da3267 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:53.233245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48543295-4d69-4b66-8e9d-c5a573da3267 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:53.233546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48543295-4d69-4b66-8e9d-c5a573da3267 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:53.234987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48543295-4d69-4b66-8e9d-c5a573da3267 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:53.237531 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28fc2f-3b9d-41ad-ab8a-9342c532d006 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:53.266279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:53.273129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 247/505] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 1 16:16:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:53.274901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48543295-4d69-4b66-8e9d-c5a573da3267 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:53.278363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1f125-9e12-42c5-bde8-bfad2767ce0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:53.279007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1f125-9e12-42c5-bde8-bfad2767ce0a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:53.279288 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1f125-9e12-42c5-bde8-bfad2767ce0a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:53.279562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a1f125-9e12-42c5-bde8-bfad2767ce0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:53.291753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a1f125-9e12-42c5-bde8-bfad2767ce0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-04a1f125-9e12-42c5-bde8-bfad2767ce0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:53.296616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:53.297559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:53.298401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 259/506] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:16:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:53.299075 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1f125-9e12-42c5-bde8-bfad2767ce0a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:53.413648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a1f125-9e12-42c5-bde8-bfad2767ce0a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:53.441456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48543295-4d69-4b66-8e9d-c5a573da3267 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:53.448603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a40b42-7871-462a-81df-5f7fdb75d46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:53.449212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a40b42-7871-462a-81df-5f7fdb75d46f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:53.449488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a40b42-7871-462a-81df-5f7fdb75d46f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:53.449756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a40b42-7871-462a-81df-5f7fdb75d46f None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:53.450520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a40b42-7871-462a-81df-5f7fdb75d46f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:53.450822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a40b42-7871-462a-81df-5f7fdb75d46f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:53.452270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a40b42-7871-462a-81df-5f7fdb75d46f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:53.462503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:53.477187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd46785-7807-4cb9-b044-67af17d2a2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:53.478118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd46785-7807-4cb9-b044-67af17d2a2cc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:53.478398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd46785-7807-4cb9-b044-67af17d2a2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:53.478668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd46785-7807-4cb9-b044-67af17d2a2cc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:53.485981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd46785-7807-4cb9-b044-67af17d2a2cc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:53.487426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd46785-7807-4cb9-b044-67af17d2a2cc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:53.489552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 260/507] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 1 16:16:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:53.491047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a40b42-7871-462a-81df-5f7fdb75d46f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0fd46785-7807-4cb9-b044-67af17d2a2cc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:16:53.506561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:53.507965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 248/508] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:16:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:53.508911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd46785-7807-4cb9-b044-67af17d2a2cc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:53.546001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:53.604071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a40b42-7871-462a-81df-5f7fdb75d46f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:53.622614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd46785-7807-4cb9-b044-67af17d2a2cc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:53.641637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0fa9-3904-43df-a92b-b0eebccc13f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:53.642310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0fa9-3904-43df-a92b-b0eebccc13f0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:53.642590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0fa9-3904-43df-a92b-b0eebccc13f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:53.642856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e0fa9-3904-43df-a92b-b0eebccc13f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:53.653726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e0fa9-3904-43df-a92b-b0eebccc13f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:53.655225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e0fa9-3904-43df-a92b-b0eebccc13f0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:53.656580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb22c8-fa00-4bab-8965-a6de8599901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:53.657228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb22c8-fa00-4bab-8965-a6de8599901d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:53.657503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb22c8-fa00-4bab-8965-a6de8599901d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:53.657799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb22c8-fa00-4bab-8965-a6de8599901d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-b04e0fa9-3904-43df-a92b-b0eebccc13f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:53.672415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:53.673547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:53.674451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:53.674451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:53.674451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:53.674451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 261/509] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:53.674948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0fa9-3904-43df-a92b-b0eebccc13f0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:53.712035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:53.735548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb22c8-fa00-4bab-8965-a6de8599901d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:53.736993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb22c8-fa00-4bab-8965-a6de8599901d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:53.779612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:53.783015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e0fa9-3904-43df-a92b-b0eebccc13f0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:53.817209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f2eea-5b38-4cdc-be13-1c2520c5be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:53.817730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2eea-5b38-4cdc-be13-1c2520c5be65 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:53.818049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2eea-5b38-4cdc-be13-1c2520c5be65 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:53.818314 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2eea-5b38-4cdc-be13-1c2520c5be65 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:53.819220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f2eea-5b38-4cdc-be13-1c2520c5be65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:53.819518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f2eea-5b38-4cdc-be13-1c2520c5be65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:53.820877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f2eea-5b38-4cdc-be13-1c2520c5be65 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:53.828836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 262/510] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:16:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:53.829643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f2eea-5b38-4cdc-be13-1c2520c5be65 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:53.843479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 249/511] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:53.844299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb22c8-fa00-4bab-8965-a6de8599901d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:53.930568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:53.938479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f2eea-5b38-4cdc-be13-1c2520c5be65 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:53.950123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb22c8-fa00-4bab-8965-a6de8599901d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:53.974128 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a81526-ad0a-4137-9001-91a48eb30961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:53.974655 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a81526-ad0a-4137-9001-91a48eb30961 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:53.975764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a81526-ad0a-4137-9001-91a48eb30961 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:53.976014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a81526-ad0a-4137-9001-91a48eb30961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:53.986343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6ae2f-a219-45ab-8535-bf7e77d52813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:53.986949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6ae2f-a219-45ab-8535-bf7e77d52813 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:53.987222 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6ae2f-a219-45ab-8535-bf7e77d52813 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:53.987487 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6ae2f-a219-45ab-8535-bf7e77d52813 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:53.988211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6ae2f-a219-45ab-8535-bf7e77d52813 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:53.988513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6ae2f-a219-45ab-8535-bf7e77d52813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:53.989957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6ae2f-a219-45ab-8535-bf7e77d52813 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:54.005657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:54.008407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 250/512] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 1 16:16:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:54.009246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6ae2f-a219-45ab-8535-bf7e77d52813 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:54.049238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a81526-ad0a-4137-9001-91a48eb30961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:54.050739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a81526-ad0a-4137-9001-91a48eb30961 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:54.111912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6ae2f-a219-45ab-8535-bf7e77d52813 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:54.148684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6905973-94cd-439c-8a28-925f380b1bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:54.149293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6905973-94cd-439c-8a28-925f380b1bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:54.149569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6905973-94cd-439c-8a28-925f380b1bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:54.149843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6905973-94cd-439c-8a28-925f380b1bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:54.150509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6905973-94cd-439c-8a28-925f380b1bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:54.150814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6905973-94cd-439c-8a28-925f380b1bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:54.152171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6905973-94cd-439c-8a28-925f380b1bf1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:54.158846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:54.161924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 263/513] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:54.163324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a81526-ad0a-4137-9001-91a48eb30961 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:54.169320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 251/514] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:54.169320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6905973-94cd-439c-8a28-925f380b1bf1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:54.231631 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:54.272800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a81526-ad0a-4137-9001-91a48eb30961 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:54.275855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6905973-94cd-439c-8a28-925f380b1bf1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:54.307484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d396369-282d-440a-b5e2-2b112cd2986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:54.308117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396369-282d-440a-b5e2-2b112cd2986b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:54.308394 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396369-282d-440a-b5e2-2b112cd2986b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:54.308660 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d396369-282d-440a-b5e2-2b112cd2986b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:54.310222 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee12c8f-1e17-43f4-83d1-c8c37c228f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:54.312557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12c8f-1e17-43f4-83d1-c8c37c228f00 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:54.312557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12c8f-1e17-43f4-83d1-c8c37c228f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:54.312557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12c8f-1e17-43f4-83d1-c8c37c228f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:54.319490 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d396369-282d-440a-b5e2-2b112cd2986b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:54.320950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d396369-282d-440a-b5e2-2b112cd2986b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:54.324415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee12c8f-1e17-43f4-83d1-c8c37c228f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:54.325919 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee12c8f-1e17-43f4-83d1-c8c37c228f00 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2d396369-282d-440a-b5e2-2b112cd2986b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:54.339204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:54.340205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:54.341062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:54.341062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:54.341062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:54.341062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 264/515] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6ee12c8f-1e17-43f4-83d1-c8c37c228f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:54.341291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:54.342136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:54.343819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:54.343819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:54.343819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:54.344239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d396369-282d-440a-b5e2-2b112cd2986b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:54.344362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 252/516] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:54.344362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee12c8f-1e17-43f4-83d1-c8c37c228f00 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:54.395042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:54.446413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee12c8f-1e17-43f4-83d1-c8c37c228f00 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:54.448102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d396369-282d-440a-b5e2-2b112cd2986b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:54.461558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:54.481741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8ad6c-9635-496a-a1ce-83294e696111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:54.482456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ad6c-9635-496a-a1ce-83294e696111 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:54.482733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ad6c-9635-496a-a1ce-83294e696111 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:54.483001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8ad6c-9635-496a-a1ce-83294e696111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:54.484236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d60014-14e1-49e2-9b03-9367f75d7c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:54.484850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60014-14e1-49e2-9b03-9367f75d7c08 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:54.485131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60014-14e1-49e2-9b03-9367f75d7c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:54.485402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d60014-14e1-49e2-9b03-9367f75d7c08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:54.494435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8ad6c-9635-496a-a1ce-83294e696111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:54.495879 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8ad6c-9635-496a-a1ce-83294e696111 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-c1f8ad6c-9635-496a-a1ce-83294e696111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:54.510371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:54.511338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:54.512211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:54.512211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:54.512211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:54.512211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 253/517] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:54.512211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8ad6c-9635-496a-a1ce-83294e696111 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:54.559463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d60014-14e1-49e2-9b03-9367f75d7c08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:54.560949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d60014-14e1-49e2-9b03-9367f75d7c08 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:54.614667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8ad6c-9635-496a-a1ce-83294e696111 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:54.617846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:54.654021 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e72b4-16ad-4f4e-9a9c-de4f2fc0ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:54.654643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e72b4-16ad-4f4e-9a9c-de4f2fc0ffe7 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:54.654927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e72b4-16ad-4f4e-9a9c-de4f2fc0ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:54.655198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e72b4-16ad-4f4e-9a9c-de4f2fc0ffe7 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:54.655841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e72b4-16ad-4f4e-9a9c-de4f2fc0ffe7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:54.657324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e72b4-16ad-4f4e-9a9c-de4f2fc0ffe7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:54.667563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 265/518] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:54.668420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d60014-14e1-49e2-9b03-9367f75d7c08 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:54.686235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:54.780006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d60014-14e1-49e2-9b03-9367f75d7c08 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:54.786158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 254/519] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:16:54 2022] POST /identity/v3/users => generated 247 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:16:54.786998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e72b4-16ad-4f4e-9a9c-de4f2fc0ffe7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:54.821708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222e775-8114-4eae-b5f0-94787fd59d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:54.822379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222e775-8114-4eae-b5f0-94787fd59d59 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:54.822660 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222e775-8114-4eae-b5f0-94787fd59d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:54.822934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b222e775-8114-4eae-b5f0-94787fd59d59 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:54.823596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222e775-8114-4eae-b5f0-94787fd59d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:54.823902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222e775-8114-4eae-b5f0-94787fd59d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:54.825508 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b222e775-8114-4eae-b5f0-94787fd59d59 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:54.843677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 266/520] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:54.843677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222e775-8114-4eae-b5f0-94787fd59d59 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:54.923250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:54.932859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e72b4-16ad-4f4e-9a9c-de4f2fc0ffe7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:54.961906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b222e775-8114-4eae-b5f0-94787fd59d59 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:54.983960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f0452-61af-41cb-987c-f00bcace95a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:54.984887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f0452-61af-41cb-987c-f00bcace95a5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:54.985168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f0452-61af-41cb-987c-f00bcace95a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:54.985440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f0452-61af-41cb-987c-f00bcace95a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:54.986118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f0452-61af-41cb-987c-f00bcace95a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:54.986471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f0452-61af-41cb-987c-f00bcace95a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:54.988589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f0452-61af-41cb-987c-f00bcace95a5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:55.003045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 255/521] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:55.003244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc3096-322e-43b5-8003-c5dea5c7792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:55.004370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc3096-322e-43b5-8003-c5dea5c7792e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:55.004370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc3096-322e-43b5-8003-c5dea5c7792e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:55.004560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f0452-61af-41cb-987c-f00bcace95a5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:55.004633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc3096-322e-43b5-8003-c5dea5c7792e None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:55.004751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc3096-322e-43b5-8003-c5dea5c7792e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:55.005081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc3096-322e-43b5-8003-c5dea5c7792e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:55.007428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc3096-322e-43b5-8003-c5dea5c7792e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:55.020210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 267/522] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:55.021039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc3096-322e-43b5-8003-c5dea5c7792e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:55.029693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:55.115066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f0452-61af-41cb-987c-f00bcace95a5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:55.140577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc3096-322e-43b5-8003-c5dea5c7792e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:55.158979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cecc0df-9eca-4349-ac75-ffad02ab8ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:55.159615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecc0df-9eca-4349-ac75-ffad02ab8ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:55.159932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecc0df-9eca-4349-ac75-ffad02ab8ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:55.160167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecc0df-9eca-4349-ac75-ffad02ab8ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:55.171661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cecc0df-9eca-4349-ac75-ffad02ab8ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:55.173191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cecc0df-9eca-4349-ac75-ffad02ab8ca7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:55.173420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:55.178575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af0fe4-485e-455b-86df-f65117873c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:55.179237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0fe4-485e-455b-86df-f65117873c2d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:55.179513 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0fe4-485e-455b-86df-f65117873c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:55.179777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af0fe4-485e-455b-86df-f65117873c2d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:55.187672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af0fe4-485e-455b-86df-f65117873c2d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:55.189115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af0fe4-485e-455b-86df-f65117873c2d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0cecc0df-9eca-4349-ac75-ffad02ab8ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:55.190476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:55.191497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:55.192357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:55.192357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:55.192357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:55.192357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 256/523] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:55.192617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cecc0df-9eca-4349-ac75-ffad02ab8ca7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-b4af0fe4-485e-455b-86df-f65117873c2d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:16:55.206946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:55.208159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 268/524] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:16:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:55.209685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af0fe4-485e-455b-86df-f65117873c2d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:55.276279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:55.314577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cecc0df-9eca-4349-ac75-ffad02ab8ca7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:55.325659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af0fe4-485e-455b-86df-f65117873c2d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:55.351281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cf226-20ce-453c-b9bd-80b7b073d044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:55.351924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cf226-20ce-453c-b9bd-80b7b073d044 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:55.352201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cf226-20ce-453c-b9bd-80b7b073d044 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:55.352718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cf226-20ce-453c-b9bd-80b7b073d044 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:55.360073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cf226-20ce-453c-b9bd-80b7b073d044 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:55.361490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cf226-20ce-453c-b9bd-80b7b073d044 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:55.371751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67690763-c2e8-446a-9636-00dff743cf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:55.372389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690763-c2e8-446a-9636-00dff743cf96 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:55.372669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690763-c2e8-446a-9636-00dff743cf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:55.372939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67690763-c2e8-446a-9636-00dff743cf96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ff9cf226-20ce-453c-b9bd-80b7b073d044 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:16:55.374392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:55.375265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:55.376209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:16:55.376209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:16:55.376209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:16:55.376209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:16:55.376209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:16:55.376209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:16:55.376209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:16:55.376209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:55.376209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 257/525] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:55.376691 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cf226-20ce-453c-b9bd-80b7b073d044 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:55.383411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67690763-c2e8-446a-9636-00dff743cf96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:55.384980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67690763-c2e8-446a-9636-00dff743cf96 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-67690763-c2e8-446a-9636-00dff743cf96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:16:55.399030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:55.399903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:55.400760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:16:55.400760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:16:55.400760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:16:55.400760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:16:55.400760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:16:55.400760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:16:55.400760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:16:55.400760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:55.400760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 269/526] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:55.401220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67690763-c2e8-446a-9636-00dff743cf96 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:55.458101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:55.499585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cf226-20ce-453c-b9bd-80b7b073d044 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:55.511984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67690763-c2e8-446a-9636-00dff743cf96 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:55.534455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:55.541425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a53cf-480f-4808-8cd4-88b0feb04128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:55.542108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a53cf-480f-4808-8cd4-88b0feb04128 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:55.542353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a53cf-480f-4808-8cd4-88b0feb04128 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:55.547418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a53cf-480f-4808-8cd4-88b0feb04128 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:55.547418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a53cf-480f-4808-8cd4-88b0feb04128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:55.547418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a53cf-480f-4808-8cd4-88b0feb04128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:55.547418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a53cf-480f-4808-8cd4-88b0feb04128 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:55.556193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd236c-fd7f-4fc8-8783-fd9d566238fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:55.556801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd236c-fd7f-4fc8-8783-fd9d566238fc None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:55.561347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd236c-fd7f-4fc8-8783-fd9d566238fc None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:55.561475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 258/527] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:55.561568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd236c-fd7f-4fc8-8783-fd9d566238fc None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:55.561568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd236c-fd7f-4fc8-8783-fd9d566238fc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:55.561739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a53cf-480f-4808-8cd4-88b0feb04128 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:55.561826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd236c-fd7f-4fc8-8783-fd9d566238fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:55.561826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd236c-fd7f-4fc8-8783-fd9d566238fc None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:55.584860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 270/528] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Sep 1 16:16:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:55.584860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd236c-fd7f-4fc8-8783-fd9d566238fc None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:55.682788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a53cf-480f-4808-8cd4-88b0feb04128 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:55.694432 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd236c-fd7f-4fc8-8783-fd9d566238fc None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:55.706587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:55.719973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8e08-fc04-4749-a40e-260f0294471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:55.720744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8e08-fc04-4749-a40e-260f0294471e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:55.720744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8e08-fc04-4749-a40e-260f0294471e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:55.721031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8e08-fc04-4749-a40e-260f0294471e None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:55.721648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a8e08-fc04-4749-a40e-260f0294471e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:55.721987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a8e08-fc04-4749-a40e-260f0294471e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:55.723434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a8e08-fc04-4749-a40e-260f0294471e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:55.732891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf547d9-685c-4cd0-887f-0194d8e9b29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:55.733500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf547d9-685c-4cd0-887f-0194d8e9b29b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:55.733775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf547d9-685c-4cd0-887f-0194d8e9b29b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:55.734074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf547d9-685c-4cd0-887f-0194d8e9b29b None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:55.734763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf547d9-685c-4cd0-887f-0194d8e9b29b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:55.735059 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf547d9-685c-4cd0-887f-0194d8e9b29b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:55.736474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf547d9-685c-4cd0-887f-0194d8e9b29b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:55.749291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 259/529] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:55.749291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8e08-fc04-4749-a40e-260f0294471e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:55.757735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 271/530] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:16:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:55.762896 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf547d9-685c-4cd0-887f-0194d8e9b29b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:55.806130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:55.866323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8e08-fc04-4749-a40e-260f0294471e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:55.879362 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf547d9-685c-4cd0-887f-0194d8e9b29b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:55.903038 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e283387-efe0-402b-b72f-7f74065c9279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:55.904094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283387-efe0-402b-b72f-7f74065c9279 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:55.904496 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283387-efe0-402b-b72f-7f74065c9279 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:55.904882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283387-efe0-402b-b72f-7f74065c9279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:55.912043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e283387-efe0-402b-b72f-7f74065c9279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:55.914149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e283387-efe0-402b-b72f-7f74065c9279 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:55.918475 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328ea37-1688-41cf-a7ed-9dbee09eeab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:55.919381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328ea37-1688-41cf-a7ed-9dbee09eeab1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:55.919802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328ea37-1688-41cf-a7ed-9dbee09eeab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:55.920211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328ea37-1688-41cf-a7ed-9dbee09eeab1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-8e283387-efe0-402b-b72f-7f74065c9279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:16:55.927070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:55.928402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:55.929462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:16:55.929462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:16:55.929462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:16:55.929462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:16:55.929462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:16:55.929462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:16:55.929462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:16:55.929462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:55.929462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 260/531] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:55.929462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e283387-efe0-402b-b72f-7f74065c9279 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:55.970355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:56.007656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328ea37-1688-41cf-a7ed-9dbee09eeab1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:56.009513 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328ea37-1688-41cf-a7ed-9dbee09eeab1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:56.063797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e283387-efe0-402b-b72f-7f74065c9279 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:56.078338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:56.107725 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea6863-f71e-41c5-99a1-42fed9e3cc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:56.108343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea6863-f71e-41c5-99a1-42fed9e3cc95 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:56.108614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea6863-f71e-41c5-99a1-42fed9e3cc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:56.108884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea6863-f71e-41c5-99a1-42fed9e3cc95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:56.109613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea6863-f71e-41c5-99a1-42fed9e3cc95 None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=060b6347b13b4f67bf47169f5668b205) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:56.109942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea6863-f71e-41c5-99a1-42fed9e3cc95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:56.111438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea6863-f71e-41c5-99a1-42fed9e3cc95 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:56.117564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 261/532] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:55 2022] GET /identity/v3/role_assignments?user.id=060b6347b13b4f67bf47169f5668b205&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:56.118387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea6863-f71e-41c5-99a1-42fed9e3cc95 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:56.141338 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 272/533] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:56.141338 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328ea37-1688-41cf-a7ed-9dbee09eeab1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:56.241594 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:56.254895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea6863-f71e-41c5-99a1-42fed9e3cc95 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:56.286773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328ea37-1688-41cf-a7ed-9dbee09eeab1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:56.300943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413524-31dc-413c-9db5-f4f388468503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:56.301552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413524-31dc-413c-9db5-f4f388468503 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:56.301830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413524-31dc-413c-9db5-f4f388468503 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:56.302321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413524-31dc-413c-9db5-f4f388468503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:56.303220 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77413524-31dc-413c-9db5-f4f388468503 None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=18a16e6246fb4693b044bf939bce8244) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:56.303578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77413524-31dc-413c-9db5-f4f388468503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:56.305200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77413524-31dc-413c-9db5-f4f388468503 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:56.317909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 262/534] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:56 2022] GET /identity/v3/role_assignments?user.id=18a16e6246fb4693b044bf939bce8244&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:56.317909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413524-31dc-413c-9db5-f4f388468503 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:56.367352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:56.373042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c52cb-f118-4a3a-986b-d3a119ac9d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:56.374139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c52cb-f118-4a3a-986b-d3a119ac9d08 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:56.374641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c52cb-f118-4a3a-986b-d3a119ac9d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:56.375125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c52cb-f118-4a3a-986b-d3a119ac9d08 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:56.376567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c52cb-f118-4a3a-986b-d3a119ac9d08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:56.377089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c52cb-f118-4a3a-986b-d3a119ac9d08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:56.378778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c52cb-f118-4a3a-986b-d3a119ac9d08 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:56.406634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 273/535] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:56.426961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c52cb-f118-4a3a-986b-d3a119ac9d08 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:56.447214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413524-31dc-413c-9db5-f4f388468503 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:56.493009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46ea9-b078-479f-9fb9-29a4f0c6ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:56.493582 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46ea9-b078-479f-9fb9-29a4f0c6ede9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:56.493865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46ea9-b078-479f-9fb9-29a4f0c6ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:56.494161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa46ea9-b078-479f-9fb9-29a4f0c6ede9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:56.511663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa46ea9-b078-479f-9fb9-29a4f0c6ede9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:56.513270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa46ea9-b078-479f-9fb9-29a4f0c6ede9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-5aa46ea9-b078-479f-9fb9-29a4f0c6ede9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:56.538822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:56.539789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:56.540655 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:56.540655 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:56.540655 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:56.544882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 263/536] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:56.546179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46ea9-b078-479f-9fb9-29a4f0c6ede9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:56.653607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c52cb-f118-4a3a-986b-d3a119ac9d08 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:56.686929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:56.690582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16222f0a-2f75-4c55-80cb-cbbf1d223185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:56.691212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16222f0a-2f75-4c55-80cb-cbbf1d223185 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:56.691494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16222f0a-2f75-4c55-80cb-cbbf1d223185 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:56.691767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16222f0a-2f75-4c55-80cb-cbbf1d223185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:56.692498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16222f0a-2f75-4c55-80cb-cbbf1d223185 None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=1947d85a08e944f3a1e7451ee7847b74) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:56.692810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16222f0a-2f75-4c55-80cb-cbbf1d223185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:56.694311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16222f0a-2f75-4c55-80cb-cbbf1d223185 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:56.702216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 274/537] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:56 2022] GET /identity/v3/role_assignments?user.id=1947d85a08e944f3a1e7451ee7847b74&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:56.728501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:56.754571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa46ea9-b078-479f-9fb9-29a4f0c6ede9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:56.785209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075776b5-fccb-4f99-aa03-ec2c0e4a9193 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:56.785485 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075776b5-fccb-4f99-aa03-ec2c0e4a9193 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:56.785760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075776b5-fccb-4f99-aa03-ec2c0e4a9193 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:56.787533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 275/538] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:56.793744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791495-7288-49cb-96e3-dbe327679fe3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:56.794072 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791495-7288-49cb-96e3-dbe327679fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:56.794349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e791495-7288-49cb-96e3-dbe327679fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:56.814861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1e791495-7288-49cb-96e3-dbe327679fe3 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:56.816088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1e791495-7288-49cb-96e3-dbe327679fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:56.828731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527296ec-f50e-46b3-925c-1f349937d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:56.829362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527296ec-f50e-46b3-925c-1f349937d246 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:56.829647 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527296ec-f50e-46b3-925c-1f349937d246 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:56.829953 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527296ec-f50e-46b3-925c-1f349937d246 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:56.830623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527296ec-f50e-46b3-925c-1f349937d246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:56.830928 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527296ec-f50e-46b3-925c-1f349937d246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:56.832350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527296ec-f50e-46b3-925c-1f349937d246 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:56.860774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 264/539] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:56.867227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527296ec-f50e-46b3-925c-1f349937d246 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:56.921468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 276/540] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:57.002422 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527296ec-f50e-46b3-925c-1f349937d246 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:57.040342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f3121-387d-4618-8218-8430f2b20ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:57.041310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f3121-387d-4618-8218-8430f2b20ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:57.041772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f3121-387d-4618-8218-8430f2b20ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:57.042245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f3121-387d-4618-8218-8430f2b20ae6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:57.049993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f3121-387d-4618-8218-8430f2b20ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:57.051772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f3121-387d-4618-8218-8430f2b20ae6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-021f3121-387d-4618-8218-8430f2b20ae6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:16:57.065075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:57.066057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:57.066936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:16:57.066936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:16:57.066936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:16:57.066936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:16:57.066936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:16:57.066936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:16:57.066936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:16:57.066936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:57.070163 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 265/541] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:57.076054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e791495-7288-49cb-96e3-dbe327679fe3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:57.238124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e791495-7288-49cb-96e3-dbe327679fe3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:57.273583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:57.287775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eba67b-7027-4c74-ad63-39943da88cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:57.288716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eba67b-7027-4c74-ad63-39943da88cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:57.289000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eba67b-7027-4c74-ad63-39943da88cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:57.297519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eba67b-7027-4c74-ad63-39943da88cb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:57.297519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eba67b-7027-4c74-ad63-39943da88cb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:57.297519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eba67b-7027-4c74-ad63-39943da88cb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:57.297519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eba67b-7027-4c74-ad63-39943da88cb9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:57.310983 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 277/542] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:57.317503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f3121-387d-4618-8218-8430f2b20ae6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:57.339173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:57.344143 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eba67b-7027-4c74-ad63-39943da88cb9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:57.449085 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f3121-387d-4618-8218-8430f2b20ae6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:57.496120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3f234-a338-413e-89b3-76f3a4a62c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:57.497300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f234-a338-413e-89b3-76f3a4a62c61 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:57.498021 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f234-a338-413e-89b3-76f3a4a62c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:57.501294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3f234-a338-413e-89b3-76f3a4a62c61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:57.502723 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3f234-a338-413e-89b3-76f3a4a62c61 None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=02432d1312a34273813856362cada1d6) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:57.503259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3f234-a338-413e-89b3-76f3a4a62c61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:57.505030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3f234-a338-413e-89b3-76f3a4a62c61 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:57.513439 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 266/543] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:16:57 2022] GET /identity/v3/role_assignments?user.id=02432d1312a34273813856362cada1d6&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:57.611042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eba67b-7027-4c74-ad63-39943da88cb9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:57.672888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0ab04-c2dd-4233-b425-af5e3fb7bd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:57.673537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0ab04-c2dd-4233-b425-af5e3fb7bd1a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:57.673818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0ab04-c2dd-4233-b425-af5e3fb7bd1a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:57.674127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0ab04-c2dd-4233-b425-af5e3fb7bd1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:57.686730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0ab04-c2dd-4233-b425-af5e3fb7bd1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-84a0ab04-c2dd-4233-b425-af5e3fb7bd1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:57.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:57.693182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:57.694480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 278/544] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:16:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:57.702421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3f234-a338-413e-89b3-76f3a4a62c61 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:57.854802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:57.889106 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3f234-a338-413e-89b3-76f3a4a62c61 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:57.920739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce8689-2b4d-41c4-86f7-c60869a989a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:57.921361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce8689-2b4d-41c4-86f7-c60869a989a3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:57.921646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce8689-2b4d-41c4-86f7-c60869a989a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:57.921947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce8689-2b4d-41c4-86f7-c60869a989a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:57.922621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce8689-2b4d-41c4-86f7-c60869a989a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:57.922930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce8689-2b4d-41c4-86f7-c60869a989a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:57.931327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdce8689-2b4d-41c4-86f7-c60869a989a3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:57.940767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 267/545] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:16:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:57.947153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0ab04-c2dd-4233-b425-af5e3fb7bd1a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:58.039751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:58.127426 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0ab04-c2dd-4233-b425-af5e3fb7bd1a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:58.180362 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88958e5d-8a5d-441d-b6fa-7e12814bf249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:58.181009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88958e5d-8a5d-441d-b6fa-7e12814bf249 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:58.181284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88958e5d-8a5d-441d-b6fa-7e12814bf249 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:58.181552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88958e5d-8a5d-441d-b6fa-7e12814bf249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:58.202535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88958e5d-8a5d-441d-b6fa-7e12814bf249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:58.204018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88958e5d-8a5d-441d-b6fa-7e12814bf249 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-88958e5d-8a5d-441d-b6fa-7e12814bf249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:58.226713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:58.228450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:58.230002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:58.230002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:58.230002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:58.230002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 279/546] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:58.233846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce8689-2b4d-41c4-86f7-c60869a989a3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:58.399327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce8689-2b4d-41c4-86f7-c60869a989a3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:58.456560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c067c25-e51d-4cdd-878b-73317f18e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:58.457098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c067c25-e51d-4cdd-878b-73317f18e615 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:58.457382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c067c25-e51d-4cdd-878b-73317f18e615 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:58.457659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c067c25-e51d-4cdd-878b-73317f18e615 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:58.458391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c067c25-e51d-4cdd-878b-73317f18e615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:58.458698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c067c25-e51d-4cdd-878b-73317f18e615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:58.460830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c067c25-e51d-4cdd-878b-73317f18e615 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:58.467121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:58.481431 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 268/547] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:58.486704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88958e5d-8a5d-441d-b6fa-7e12814bf249 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:58.668026 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:58.678113 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88958e5d-8a5d-441d-b6fa-7e12814bf249 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:58.714542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704de6a1-66b7-4320-8069-c19057473d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:58.715097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704de6a1-66b7-4320-8069-c19057473d41 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:58.715372 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704de6a1-66b7-4320-8069-c19057473d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:58.715642 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704de6a1-66b7-4320-8069-c19057473d41 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:58.723733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704de6a1-66b7-4320-8069-c19057473d41 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:58.725785 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704de6a1-66b7-4320-8069-c19057473d41 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-704de6a1-66b7-4320-8069-c19057473d41 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:16:58.740722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:58.741848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:58.742795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:58.742795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:58.742795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:16:58.742795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:16:58.742795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:16:58.742795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:16:58.742795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:16:58.742795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:16:58.742795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:16:58.742795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:58.742795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 280/548] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:16:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:58.749454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c067c25-e51d-4cdd-878b-73317f18e615 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:58.750110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430b1aa-f76a-4412-a77c-7b5c5309036d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:58.750467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430b1aa-f76a-4412-a77c-7b5c5309036d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:58.750738 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430b1aa-f76a-4412-a77c-7b5c5309036d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:58.752190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 281/549] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:58.753357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986c57d-19cb-4ae7-83be-0c9242a1dd77 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:58.753639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986c57d-19cb-4ae7-83be-0c9242a1dd77 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:58.753921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986c57d-19cb-4ae7-83be-0c9242a1dd77 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:58.755362 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 282/550] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:58.763169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544e7d3-d025-4cd1-8c0b-753f695d0ff8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:58.763479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544e7d3-d025-4cd1-8c0b-753f695d0ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:58.763759 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544e7d3-d025-4cd1-8c0b-753f695d0ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:58.783305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0544e7d3-d025-4cd1-8c0b-753f695d0ff8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:58.784343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0544e7d3-d025-4cd1-8c0b-753f695d0ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:58.870732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 283/551] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:58.872099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745071f4-996b-45b6-bb69-b57f0cd53b5d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:58.872432 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745071f4-996b-45b6-bb69-b57f0cd53b5d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:58.872675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745071f4-996b-45b6-bb69-b57f0cd53b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:58.891371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-745071f4-996b-45b6-bb69-b57f0cd53b5d None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:58.892563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-745071f4-996b-45b6-bb69-b57f0cd53b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:58.903917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c067c25-e51d-4cdd-878b-73317f18e615 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:58.955884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375cd30-b195-4055-806d-e32a5f477cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:58.956942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375cd30-b195-4055-806d-e32a5f477cce None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:58.957415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375cd30-b195-4055-806d-e32a5f477cce None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:58.957997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375cd30-b195-4055-806d-e32a5f477cce None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:58.958855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375cd30-b195-4055-806d-e32a5f477cce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:58.959797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375cd30-b195-4055-806d-e32a5f477cce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:58.961439 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375cd30-b195-4055-806d-e32a5f477cce None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:58.981260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 284/552] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:16:58.982828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 269/553] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 1 16:16:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:58.990090 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745071f4-996b-45b6-bb69-b57f0cd53b5d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:59.034278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:59.046214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d96d-d23f-4537-85af-36de40722151 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:59.046540 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d96d-d23f-4537-85af-36de40722151 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:59.046762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d96d-d23f-4537-85af-36de40722151 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:59.048339 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 270/554] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:16:59.053757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f05b8-08ba-404b-a6ad-ce2fa41e256f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:59.054091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f05b8-08ba-404b-a6ad-ce2fa41e256f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:59.055572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f05b8-08ba-404b-a6ad-ce2fa41e256f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:59.073411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-587f05b8-08ba-404b-a6ad-ce2fa41e256f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:16:59.074693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-587f05b8-08ba-404b-a6ad-ce2fa41e256f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:16:59.143469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:59.178422 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 271/555] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:16:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:16:59.231399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745071f4-996b-45b6-bb69-b57f0cd53b5d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:59.255379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f05b8-08ba-404b-a6ad-ce2fa41e256f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:59.282312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71abd3-dc14-4079-a205-3830e1b47d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:59.283457 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71abd3-dc14-4079-a205-3830e1b47d07 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:59.284048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71abd3-dc14-4079-a205-3830e1b47d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:59.284537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71abd3-dc14-4079-a205-3830e1b47d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:59.384901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71abd3-dc14-4079-a205-3830e1b47d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:59.386735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71abd3-dc14-4079-a205-3830e1b47d07 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:59.406307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:59.471879 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f05b8-08ba-404b-a6ad-ce2fa41e256f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:59.499586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 285/556] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:16:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:16:59.500423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71abd3-dc14-4079-a205-3830e1b47d07 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:59.523874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65b69e-28dc-42f4-83bb-2d352eba1538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:59.524531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b69e-28dc-42f4-83bb-2d352eba1538 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:59.524807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b69e-28dc-42f4-83bb-2d352eba1538 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:59.525077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65b69e-28dc-42f4-83bb-2d352eba1538 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:59.535917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65b69e-28dc-42f4-83bb-2d352eba1538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-bc65b69e-28dc-42f4-83bb-2d352eba1538 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:59.541281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:59.542263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:59.543083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:59.547298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 272/557] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:16:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:16:59.547910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65b69e-28dc-42f4-83bb-2d352eba1538 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:59.604367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:59.617851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71abd3-dc14-4079-a205-3830e1b47d07 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:59.638843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:59.668156 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752fef-1a10-42c3-b517-0df0772d2f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:59.669285 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752fef-1a10-42c3-b517-0df0772d2f48 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:59.669773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752fef-1a10-42c3-b517-0df0772d2f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:59.670213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752fef-1a10-42c3-b517-0df0772d2f48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:59.671035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65b69e-28dc-42f4-83bb-2d352eba1538 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:59.683155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752fef-1a10-42c3-b517-0df0772d2f48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-73752fef-1a10-42c3-b517-0df0772d2f48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:59.688499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:59.689654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:59.690756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:59.693002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 286/558] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:16:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:59.694554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752fef-1a10-42c3-b517-0df0772d2f48 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:59.709764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b5fbf-d87b-46ce-8e45-c4367e9b6033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:59.710513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b5fbf-d87b-46ce-8e45-c4367e9b6033 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:59.710797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b5fbf-d87b-46ce-8e45-c4367e9b6033 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:59.711274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b5fbf-d87b-46ce-8e45-c4367e9b6033 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:59.722729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b5fbf-d87b-46ce-8e45-c4367e9b6033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-178b5fbf-d87b-46ce-8e45-c4367e9b6033 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:16:59.728057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:59.728987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 273/559] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:16:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:59.730638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b5fbf-d87b-46ce-8e45-c4367e9b6033 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:59.831733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752fef-1a10-42c3-b517-0df0772d2f48 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:59.859081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b5fbf-d87b-46ce-8e45-c4367e9b6033 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:16:59.862961 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:16:59.873654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e78ff-52ea-4278-bffd-f69bf29f7e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:59.874372 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e78ff-52ea-4278-bffd-f69bf29f7e21 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:59.874654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e78ff-52ea-4278-bffd-f69bf29f7e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:59.874923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e78ff-52ea-4278-bffd-f69bf29f7e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:59.887462 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e78ff-52ea-4278-bffd-f69bf29f7e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:59.888979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e78ff-52ea-4278-bffd-f69bf29f7e21 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-6e2e78ff-52ea-4278-bffd-f69bf29f7e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:16:59.904982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:16:59.906081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:16:59.906972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:16:59.906972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:16:59.906972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:16:59.907646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72483b-2848-47b1-a8b3-e32e60754390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:16:59.907646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72483b-2848-47b1-a8b3-e32e60754390 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:16:59.907646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72483b-2848-47b1-a8b3-e32e60754390 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:16:59.907646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72483b-2848-47b1-a8b3-e32e60754390 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:16:59.907922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72483b-2848-47b1-a8b3-e32e60754390 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:16:59.907922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72483b-2848-47b1-a8b3-e32e60754390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:16:59.908977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72483b-2848-47b1-a8b3-e32e60754390 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:16:59.913840 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 287/560] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:16:59.915047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e78ff-52ea-4278-bffd-f69bf29f7e21 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:59.926275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 274/561] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:16:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:16:59.927619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72483b-2848-47b1-a8b3-e32e60754390 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:16:59.950536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:00.032254 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e78ff-52ea-4278-bffd-f69bf29f7e21 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:00.033224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72483b-2848-47b1-a8b3-e32e60754390 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:00.067907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44ceb3-1408-454d-aaa6-3604bf0727c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:00.068286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb8406-8172-4f0b-b5f2-d333594c673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:00.069093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ceb3-1408-454d-aaa6-3604bf0727c8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.069440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8406-8172-4f0b-b5f2-d333594c673d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.069534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ceb3-1408-454d-aaa6-3604bf0727c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.069715 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44ceb3-1408-454d-aaa6-3604bf0727c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.069835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8406-8172-4f0b-b5f2-d333594c673d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.070006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb8406-8172-4f0b-b5f2-d333594c673d None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.070404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44ceb3-1408-454d-aaa6-3604bf0727c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:00.070719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb8406-8172-4f0b-b5f2-d333594c673d None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:00.070823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44ceb3-1408-454d-aaa6-3604bf0727c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:00.070967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb8406-8172-4f0b-b5f2-d333594c673d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:00.072060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44ceb3-1408-454d-aaa6-3604bf0727c8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:00.072331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb8406-8172-4f0b-b5f2-d333594c673d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:00.081034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 275/562] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:16:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:00.093649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb8406-8172-4f0b-b5f2-d333594c673d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:00.093818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 288/563] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:16:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:00.093818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44ceb3-1408-454d-aaa6-3604bf0727c8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:00.116216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:00.182476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:00.191068 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb8406-8172-4f0b-b5f2-d333594c673d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:00.191880 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44ceb3-1408-454d-aaa6-3604bf0727c8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:00.228232 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05368fd-60e0-4562-943d-c8c1f7e182d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:00.228847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05368fd-60e0-4562-943d-c8c1f7e182d7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.229124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05368fd-60e0-4562-943d-c8c1f7e182d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.229390 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05368fd-60e0-4562-943d-c8c1f7e182d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.230411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05368fd-60e0-4562-943d-c8c1f7e182d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:00.230565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1041d-0509-4608-81e5-ba8ff6c2fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:00.230805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05368fd-60e0-4562-943d-c8c1f7e182d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:00.231340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1041d-0509-4608-81e5-ba8ff6c2fd0e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.231611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1041d-0509-4608-81e5-ba8ff6c2fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.231919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1041d-0509-4608-81e5-ba8ff6c2fd0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.232716 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05368fd-60e0-4562-943d-c8c1f7e182d7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:00.245928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1041d-0509-4608-81e5-ba8ff6c2fd0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:00.247383 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 276/564] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:00.247494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1041d-0509-4608-81e5-ba8ff6c2fd0e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:00.251391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e17fd-82ac-4dbd-bb8a-ef0f39b1cb6d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.251772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e17fd-82ac-4dbd-bb8a-ef0f39b1cb6d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.252053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e17fd-82ac-4dbd-bb8a-ef0f39b1cb6d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.253477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 277/565] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:00.254267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e17fd-82ac-4dbd-bb8a-ef0f39b1cb6d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-28c1041d-0509-4608-81e5-ba8ff6c2fd0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:00.272829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:00.274479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:00.275512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:00.275512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:00.275512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:00.275512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 289/566] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:00.276680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1041d-0509-4608-81e5-ba8ff6c2fd0e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:00.349003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:00.362391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e17fd-82ac-4dbd-bb8a-ef0f39b1cb6d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:00.400465 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea60bf-6ce7-46da-abc7-c8cc01324e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:00.400681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1041d-0509-4608-81e5-ba8ff6c2fd0e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:00.401097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea60bf-6ce7-46da-abc7-c8cc01324e62 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.401381 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea60bf-6ce7-46da-abc7-c8cc01324e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.401652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea60bf-6ce7-46da-abc7-c8cc01324e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.411758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea60bf-6ce7-46da-abc7-c8cc01324e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:00.413410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea60bf-6ce7-46da-abc7-c8cc01324e62 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f4ea60bf-6ce7-46da-abc7-c8cc01324e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:00.429298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:00.430360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:00.431272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:00.431272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:00.431272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:00.431272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 278/567] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:00.431856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea60bf-6ce7-46da-abc7-c8cc01324e62 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:00.438949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f559fef-db02-4fba-9ced-dfa7dee499a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:00.439586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f559fef-db02-4fba-9ced-dfa7dee499a5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.439859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f559fef-db02-4fba-9ced-dfa7dee499a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.440124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f559fef-db02-4fba-9ced-dfa7dee499a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.451748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f559fef-db02-4fba-9ced-dfa7dee499a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:00.453187 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f559fef-db02-4fba-9ced-dfa7dee499a5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:00.454980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-2f559fef-db02-4fba-9ced-dfa7dee499a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:00.468086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:00.469061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:00.470015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:00.470015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:00.470015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:00.470015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 290/568] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:00.470668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa1ba2-8dac-4189-a5d5-a882c7145930 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.470668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa1ba2-8dac-4189-a5d5-a882c7145930 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.470908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa1ba2-8dac-4189-a5d5-a882c7145930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.488664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8cfa1ba2-8dac-4189-a5d5-a882c7145930 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:00.489837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8cfa1ba2-8dac-4189-a5d5-a882c7145930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:00.534981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea60bf-6ce7-46da-abc7-c8cc01324e62 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:00.562679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 291/569] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:00.563573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa1ba2-8dac-4189-a5d5-a882c7145930 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:00.580008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fb799-81d5-4540-9106-57cead7413be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:00.580978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fb799-81d5-4540-9106-57cead7413be None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.581411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fb799-81d5-4540-9106-57cead7413be None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.581832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fb799-81d5-4540-9106-57cead7413be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.592081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fb799-81d5-4540-9106-57cead7413be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:00.594307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fb799-81d5-4540-9106-57cead7413be None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:00.598225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-7e3fb799-81d5-4540-9106-57cead7413be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:00.618449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:00.619891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:00.621318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:00.621318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:00.621318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:00.621318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:00.621318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:00.621318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:00.621318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:00.621318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:00.621318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 279/570] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:00.621318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fb799-81d5-4540-9106-57cead7413be None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:00.691062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa1ba2-8dac-4189-a5d5-a882c7145930 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:00.718851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:00.729927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fb799-81d5-4540-9106-57cead7413be None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:00.731414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ad3f8-99b6-4999-b43b-066921e2f2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:00.732311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad3f8-99b6-4999-b43b-066921e2f2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.732706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad3f8-99b6-4999-b43b-066921e2f2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.732991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad3f8-99b6-4999-b43b-066921e2f2d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.733641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ad3f8-99b6-4999-b43b-066921e2f2d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:00.733980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ad3f8-99b6-4999-b43b-066921e2f2d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:00.735350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ad3f8-99b6-4999-b43b-066921e2f2d0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:00.748286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 292/571] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:00.749110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ad3f8-99b6-4999-b43b-066921e2f2d0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:00.767762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cdd91-4f41-4f38-a494-847e29b6e8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:00.768403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cdd91-4f41-4f38-a494-847e29b6e8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.768680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cdd91-4f41-4f38-a494-847e29b6e8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.768945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cdd91-4f41-4f38-a494-847e29b6e8a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.769570 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cdd91-4f41-4f38-a494-847e29b6e8a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:00.769868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cdd91-4f41-4f38-a494-847e29b6e8a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:00.771232 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cdd91-4f41-4f38-a494-847e29b6e8a0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:00.784571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 280/572] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:00.785219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cdd91-4f41-4f38-a494-847e29b6e8a0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:00.851091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:00.861929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ad3f8-99b6-4999-b43b-066921e2f2d0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:00.901143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cdd91-4f41-4f38-a494-847e29b6e8a0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:00.908992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d99ced-d28b-49e0-8156-8c4150135915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:00.909608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d99ced-d28b-49e0-8156-8c4150135915 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.909911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d99ced-d28b-49e0-8156-8c4150135915 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.911925 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d99ced-d28b-49e0-8156-8c4150135915 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.911925 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d99ced-d28b-49e0-8156-8c4150135915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:00.911925 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d99ced-d28b-49e0-8156-8c4150135915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:00.913016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d99ced-d28b-49e0-8156-8c4150135915 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:00.930213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 293/573] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:00.931057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d99ced-d28b-49e0-8156-8c4150135915 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:00.949107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9368e-4140-4e8c-bb51-081373e47c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:00.949714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9368e-4140-4e8c-bb51-081373e47c58 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:00.950030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9368e-4140-4e8c-bb51-081373e47c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:00.950303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9368e-4140-4e8c-bb51-081373e47c58 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:00.950989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9368e-4140-4e8c-bb51-081373e47c58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:00.951293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9368e-4140-4e8c-bb51-081373e47c58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:00.952720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9368e-4140-4e8c-bb51-081373e47c58 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:00.966314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 281/574] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:00.967388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9368e-4140-4e8c-bb51-081373e47c58 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:00.985349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:01.043035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d99ced-d28b-49e0-8156-8c4150135915 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:01.068822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9368e-4140-4e8c-bb51-081373e47c58 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:01.078504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c9c29-7f4f-4fb2-b8be-dbf7fe9b282a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:01.079138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9c29-7f4f-4fb2-b8be-dbf7fe9b282a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:01.079412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9c29-7f4f-4fb2-b8be-dbf7fe9b282a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:01.079676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c9c29-7f4f-4fb2-b8be-dbf7fe9b282a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:01.086863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c9c29-7f4f-4fb2-b8be-dbf7fe9b282a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:01.088287 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c9c29-7f4f-4fb2-b8be-dbf7fe9b282a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:01.088788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-e46c9c29-7f4f-4fb2-b8be-dbf7fe9b282a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:01.100300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:01.101306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:01.102325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:01.102325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:01.102325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:01.102325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:01.102325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:01.102325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:01.102325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:01.102325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:01.102325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:01.102325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:01.102325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 294/575] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 1 16:17:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:01.104634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c9c29-7f4f-4fb2-b8be-dbf7fe9b282a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:01.105791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215b1e4-6730-48f7-956a-851da240f6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:01.106516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215b1e4-6730-48f7-956a-851da240f6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:01.106791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215b1e4-6730-48f7-956a-851da240f6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:01.107060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215b1e4-6730-48f7-956a-851da240f6b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:01.114628 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215b1e4-6730-48f7-956a-851da240f6b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:01.116126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2215b1e4-6730-48f7-956a-851da240f6b5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-2215b1e4-6730-48f7-956a-851da240f6b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:01.127564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:01.128732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:01.130015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:01.130015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:01.130015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:01.130015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:01.130015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:01.130015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:01.130015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:01.130015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:01.130015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:17:01.130015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:01.133990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 282/576] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:17:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:01.134790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215b1e4-6730-48f7-956a-851da240f6b5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:01.210661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c9c29-7f4f-4fb2-b8be-dbf7fe9b282a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:01.214134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:01.240492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215b1e4-6730-48f7-956a-851da240f6b5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:01.247353 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f63fa0-44fa-4565-872f-ce69cc4714a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:01.247999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63fa0-44fa-4565-872f-ce69cc4714a0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:01.252277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63fa0-44fa-4565-872f-ce69cc4714a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:01.252564 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63fa0-44fa-4565-872f-ce69cc4714a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:01.265826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f63fa0-44fa-4565-872f-ce69cc4714a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-54f63fa0-44fa-4565-872f-ce69cc4714a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:01.271389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:01.273269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:01.274297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 295/577] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:01.275354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f63fa0-44fa-4565-872f-ce69cc4714a0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:01.283540 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4635a-1906-4c8c-93c8-ecdf4bcbcc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:01.284184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4635a-1906-4c8c-93c8-ecdf4bcbcc1a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:01.284461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4635a-1906-4c8c-93c8-ecdf4bcbcc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:01.284732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4635a-1906-4c8c-93c8-ecdf4bcbcc1a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:01.293709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4635a-1906-4c8c-93c8-ecdf4bcbcc1a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:01.295210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4635a-1906-4c8c-93c8-ecdf4bcbcc1a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-cfd4635a-1906-4c8c-93c8-ecdf4bcbcc1a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:01.306468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:01.307631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 283/578] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:17:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:01.308827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4635a-1906-4c8c-93c8-ecdf4bcbcc1a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:01.355977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:01.380731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f63fa0-44fa-4565-872f-ce69cc4714a0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:01.414407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4635a-1906-4c8c-93c8-ecdf4bcbcc1a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:01.417593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef185d-4d4f-4bf4-8117-97523716a20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:01.418238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef185d-4d4f-4bf4-8117-97523716a20f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:01.418518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef185d-4d4f-4bf4-8117-97523716a20f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:01.418787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef185d-4d4f-4bf4-8117-97523716a20f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:01.419512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef185d-4d4f-4bf4-8117-97523716a20f None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=589e62c8d27044eea16e7c1f803e1393) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:01.419815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef185d-4d4f-4bf4-8117-97523716a20f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:01.421241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef185d-4d4f-4bf4-8117-97523716a20f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:01.426757 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 296/579] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:01 2022] GET /identity/v3/role_assignments?user.id=589e62c8d27044eea16e7c1f803e1393&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:01.427529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef185d-4d4f-4bf4-8117-97523716a20f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:01.462542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:01.462936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bbc87-2048-42ee-93cf-64117541b5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:01.463662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bbc87-2048-42ee-93cf-64117541b5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:01.464029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bbc87-2048-42ee-93cf-64117541b5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:01.464302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bbc87-2048-42ee-93cf-64117541b5e8 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:01.465046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bbc87-2048-42ee-93cf-64117541b5e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:01.465484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bbc87-2048-42ee-93cf-64117541b5e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:01.466955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8bbc87-2048-42ee-93cf-64117541b5e8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:01.488034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 284/580] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 1 16:17:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:01.488929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bbc87-2048-42ee-93cf-64117541b5e8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:01.564354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef185d-4d4f-4bf4-8117-97523716a20f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:01.607324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eeb11-29a8-4a6f-aa83-c625c7e36153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:01.607931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eeb11-29a8-4a6f-aa83-c625c7e36153 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:01.608205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eeb11-29a8-4a6f-aa83-c625c7e36153 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:01.608472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eeb11-29a8-4a6f-aa83-c625c7e36153 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:01.609194 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418eeb11-29a8-4a6f-aa83-c625c7e36153 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:01.609489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418eeb11-29a8-4a6f-aa83-c625c7e36153 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:01.610941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418eeb11-29a8-4a6f-aa83-c625c7e36153 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:01.619078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:01.623921 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bbc87-2048-42ee-93cf-64117541b5e8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:01.634135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 297/581] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 1 16:17:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:01.634135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eeb11-29a8-4a6f-aa83-c625c7e36153 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:01.686384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fcb92-dfc8-484f-8184-0a9e3bea6015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:01.686384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fcb92-dfc8-484f-8184-0a9e3bea6015 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:01.686384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fcb92-dfc8-484f-8184-0a9e3bea6015 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:01.686384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fcb92-dfc8-484f-8184-0a9e3bea6015 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:01.686880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fcb92-dfc8-484f-8184-0a9e3bea6015 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:01.686880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fcb92-dfc8-484f-8184-0a9e3bea6015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:01.686880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145fcb92-dfc8-484f-8184-0a9e3bea6015 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:01.689151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 285/582] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:17:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:01.690199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fcb92-dfc8-484f-8184-0a9e3bea6015 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:01.745512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:01.762071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eeb11-29a8-4a6f-aa83-c625c7e36153 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:01.799004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98442e5d-89f6-4a70-9723-db84795a821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:01.799610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98442e5d-89f6-4a70-9723-db84795a821e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:01.799886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98442e5d-89f6-4a70-9723-db84795a821e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:01.800153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98442e5d-89f6-4a70-9723-db84795a821e None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:01.800874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98442e5d-89f6-4a70-9723-db84795a821e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:01.801175 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98442e5d-89f6-4a70-9723-db84795a821e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:01.802636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98442e5d-89f6-4a70-9723-db84795a821e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:01.803344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fcb92-dfc8-484f-8184-0a9e3bea6015 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:01.823871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 298/583] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 1 16:17:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:01.825006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98442e5d-89f6-4a70-9723-db84795a821e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:01.846821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223f4f2-a705-4907-ab52-b13f8b942e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:01.847460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223f4f2-a705-4907-ab52-b13f8b942e1f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:01.847738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223f4f2-a705-4907-ab52-b13f8b942e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:01.848008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223f4f2-a705-4907-ab52-b13f8b942e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:01.860197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223f4f2-a705-4907-ab52-b13f8b942e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:01.861659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e223f4f2-a705-4907-ab52-b13f8b942e1f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-e223f4f2-a705-4907-ab52-b13f8b942e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:01.877950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:01.879134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:01.880273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:01.880273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:01.880273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:01.880273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 286/584] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:01.880273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223f4f2-a705-4907-ab52-b13f8b942e1f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:01.897142 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:01.956234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98442e5d-89f6-4a70-9723-db84795a821e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:01.989597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e223f4f2-a705-4907-ab52-b13f8b942e1f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:02.002486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdad68-4b16-4280-82c9-0e6908cd2ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.003519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdad68-4b16-4280-82c9-0e6908cd2ffd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.004340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdad68-4b16-4280-82c9-0e6908cd2ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.005056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdad68-4b16-4280-82c9-0e6908cd2ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.018661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdad68-4b16-4280-82c9-0e6908cd2ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.020604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abdad68-4b16-4280-82c9-0e6908cd2ffd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.023859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:02.025296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e8bc7-b96f-49ca-b1ee-2df873f182fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.026026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e8bc7-b96f-49ca-b1ee-2df873f182fc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.026310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e8bc7-b96f-49ca-b1ee-2df873f182fc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.026584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e8bc7-b96f-49ca-b1ee-2df873f182fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-5abdad68-4b16-4280-82c9-0e6908cd2ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:02.036264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:02.040429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:02.041333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:02.041333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:02.041333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:02.041333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 299/585] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:02.041333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdad68-4b16-4280-82c9-0e6908cd2ffd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:02.043630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e8bc7-b96f-49ca-b1ee-2df873f182fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.045159 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e8bc7-b96f-49ca-b1ee-2df873f182fc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-3f5e8bc7-b96f-49ca-b1ee-2df873f182fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:02.061044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:02.062126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:02.063027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:02.063027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:02.063027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:02.063027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 287/586] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:02.063693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e8bc7-b96f-49ca-b1ee-2df873f182fc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:02.139445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:02.169256 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdad68-4b16-4280-82c9-0e6908cd2ffd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:02.181986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e8bc7-b96f-49ca-b1ee-2df873f182fc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:02.208134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83793fe2-718c-4617-8d6d-81a60cd02579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.208879 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793fe2-718c-4617-8d6d-81a60cd02579 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.209211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793fe2-718c-4617-8d6d-81a60cd02579 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.210110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793fe2-718c-4617-8d6d-81a60cd02579 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.221662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83793fe2-718c-4617-8d6d-81a60cd02579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.222555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96856ff1-c6ac-447a-a02e-324cfcacb9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.223145 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83793fe2-718c-4617-8d6d-81a60cd02579 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.223247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96856ff1-c6ac-447a-a02e-324cfcacb9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.223429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96856ff1-c6ac-447a-a02e-324cfcacb9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.223701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96856ff1-c6ac-447a-a02e-324cfcacb9b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.224332 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96856ff1-c6ac-447a-a02e-324cfcacb9b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:02.224634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96856ff1-c6ac-447a-a02e-324cfcacb9b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.227155 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96856ff1-c6ac-447a-a02e-324cfcacb9b3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-83793fe2-718c-4617-8d6d-81a60cd02579 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:02.238520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:02.239465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:02.246139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:02.246139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:02.246139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:02.246139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 300/587] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:02.246380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 288/588] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:02.246380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96856ff1-c6ac-447a-a02e-324cfcacb9b3 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:02.246599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83793fe2-718c-4617-8d6d-81a60cd02579 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:02.301820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:02.355062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96856ff1-c6ac-447a-a02e-324cfcacb9b3 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:02.358225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83793fe2-718c-4617-8d6d-81a60cd02579 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:02.382885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:02.395147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b34290-4171-4aff-968d-4400526a0a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.395869 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b34290-4171-4aff-968d-4400526a0a33 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.396146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b34290-4171-4aff-968d-4400526a0a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.396414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b34290-4171-4aff-968d-4400526a0a33 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.397629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b34290-4171-4aff-968d-4400526a0a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:02.398107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b34290-4171-4aff-968d-4400526a0a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.399669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b34290-4171-4aff-968d-4400526a0a33 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.399996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8a7e4-80d5-4bc0-956c-fcf30f33a57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.400700 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8a7e4-80d5-4bc0-956c-fcf30f33a57d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.400919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8a7e4-80d5-4bc0-956c-fcf30f33a57d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.401187 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8a7e4-80d5-4bc0-956c-fcf30f33a57d None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.401831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8a7e4-80d5-4bc0-956c-fcf30f33a57d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:02.402163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8a7e4-80d5-4bc0-956c-fcf30f33a57d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.403528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8a7e4-80d5-4bc0-956c-fcf30f33a57d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.416750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 301/589] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:02.417514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 289/590] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:02.417654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8a7e4-80d5-4bc0-956c-fcf30f33a57d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:02.418822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b34290-4171-4aff-968d-4400526a0a33 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:02.538873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8a7e4-80d5-4bc0-956c-fcf30f33a57d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:02.539400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b34290-4171-4aff-968d-4400526a0a33 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:02.549834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:02.578628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769a72d-2f3b-4cad-a45a-aa7457bf8695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.579293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54899d33-c1dd-4ffd-8052-7186effdb54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.579391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769a72d-2f3b-4cad-a45a-aa7457bf8695 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.579467 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54899d33-c1dd-4ffd-8052-7186effdb54e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.579538 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769a72d-2f3b-4cad-a45a-aa7457bf8695 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.579620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54899d33-c1dd-4ffd-8052-7186effdb54e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.579692 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769a72d-2f3b-4cad-a45a-aa7457bf8695 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.580000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54899d33-c1dd-4ffd-8052-7186effdb54e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.580333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769a72d-2f3b-4cad-a45a-aa7457bf8695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:02.580632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769a72d-2f3b-4cad-a45a-aa7457bf8695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.582048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769a72d-2f3b-4cad-a45a-aa7457bf8695 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.589051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54899d33-c1dd-4ffd-8052-7186effdb54e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.590869 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54899d33-c1dd-4ffd-8052-7186effdb54e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.594723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 302/591] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:02.595539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769a72d-2f3b-4cad-a45a-aa7457bf8695 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-54899d33-c1dd-4ffd-8052-7186effdb54e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:02.605592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:02.606580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:02.612926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:02.612926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:02.612926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:02.612926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:02.612926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:02.612926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:02.612926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:02.612926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:02.612926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 290/592] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:02.612926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54899d33-c1dd-4ffd-8052-7186effdb54e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:02.662075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:02.714250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769a72d-2f3b-4cad-a45a-aa7457bf8695 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:02.719974 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54899d33-c1dd-4ffd-8052-7186effdb54e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:02.749070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d4f85-e642-472d-b32b-e497643333fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.749704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4f85-e642-472d-b32b-e497643333fd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.750005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4f85-e642-472d-b32b-e497643333fd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.750271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4f85-e642-472d-b32b-e497643333fd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.755676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61bf25-770b-4417-a9d5-314789bb050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.756823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61bf25-770b-4417-a9d5-314789bb050a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.757154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61bf25-770b-4417-a9d5-314789bb050a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.757432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61bf25-770b-4417-a9d5-314789bb050a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.758720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d4f85-e642-472d-b32b-e497643333fd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.760277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d4f85-e642-472d-b32b-e497643333fd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.764536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61bf25-770b-4417-a9d5-314789bb050a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.765977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61bf25-770b-4417-a9d5-314789bb050a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4a7d4f85-e642-472d-b32b-e497643333fd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:02.772675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:02.774209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 303/593] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:02.775428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d4f85-e642-472d-b32b-e497643333fd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-7c61bf25-770b-4417-a9d5-314789bb050a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:02.784729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:02.785686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:02.787874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:02.787874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:02.787874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:02.787874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:02.787874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:02.787874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:02.787874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:02.787874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:02.787874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 291/594] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:02.787874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61bf25-770b-4417-a9d5-314789bb050a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:02.808173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:02.897381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d4f85-e642-472d-b32b-e497643333fd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:02.900544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61bf25-770b-4417-a9d5-314789bb050a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:02.903093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:02.938348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4330d42-b864-4949-bdf0-c3b868b5d334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.938925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4330d42-b864-4949-bdf0-c3b868b5d334 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.939648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4330d42-b864-4949-bdf0-c3b868b5d334 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.940328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4330d42-b864-4949-bdf0-c3b868b5d334 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.941567 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4330d42-b864-4949-bdf0-c3b868b5d334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:02.941744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d93ee-21ea-4b80-852b-8d382ddf4e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:02.941855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4330d42-b864-4949-bdf0-c3b868b5d334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.942397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d93ee-21ea-4b80-852b-8d382ddf4e5b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:02.942675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d93ee-21ea-4b80-852b-8d382ddf4e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:02.942942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d93ee-21ea-4b80-852b-8d382ddf4e5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:02.943289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4330d42-b864-4949-bdf0-c3b868b5d334 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.950450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d93ee-21ea-4b80-852b-8d382ddf4e5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:02.951872 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d93ee-21ea-4b80-852b-8d382ddf4e5b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:02.962852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 292/595] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:02.962852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4330d42-b864-4949-bdf0-c3b868b5d334 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-3a5d93ee-21ea-4b80-852b-8d382ddf4e5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:02.964434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:02.965684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:02.966817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:02.966817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:02.966817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:02.966817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:02.966817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:02.966817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:02.966817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:02.966817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:02.966817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 304/596] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:02.966817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d93ee-21ea-4b80-852b-8d382ddf4e5b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:03.072040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:03.085211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d93ee-21ea-4b80-852b-8d382ddf4e5b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:03.086104 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4330d42-b864-4949-bdf0-c3b868b5d334 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:03.122888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a73a6-fc19-4b3c-bd4d-c4b7fe0acb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:03.123523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a73a6-fc19-4b3c-bd4d-c4b7fe0acb19 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:03.123774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a73a6-fc19-4b3c-bd4d-c4b7fe0acb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:03.124047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a73a6-fc19-4b3c-bd4d-c4b7fe0acb19 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:03.124802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a73a6-fc19-4b3c-bd4d-c4b7fe0acb19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:03.125073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a73a6-fc19-4b3c-bd4d-c4b7fe0acb19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:03.126540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a73a6-fc19-4b3c-bd4d-c4b7fe0acb19 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:03.134647 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95f210-d5b7-485c-bdfa-e8d632e0f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:03.135817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95f210-d5b7-485c-bdfa-e8d632e0f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:03.136090 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95f210-d5b7-485c-bdfa-e8d632e0f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:03.136361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95f210-d5b7-485c-bdfa-e8d632e0f9d7 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:03.137541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95f210-d5b7-485c-bdfa-e8d632e0f9d7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:03.137852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95f210-d5b7-485c-bdfa-e8d632e0f9d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:03.139330 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95f210-d5b7-485c-bdfa-e8d632e0f9d7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:03.144954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 305/597] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:03.144954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a73a6-fc19-4b3c-bd4d-c4b7fe0acb19 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:03.164582 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 293/598] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Sep 1 16:17:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:03.164582 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95f210-d5b7-485c-bdfa-e8d632e0f9d7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:03.191592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:03.257734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a73a6-fc19-4b3c-bd4d-c4b7fe0acb19 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:03.284027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95f210-d5b7-485c-bdfa-e8d632e0f9d7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:03.296063 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130df80-1fcd-4fa6-895f-e7bfd9961dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:03.297023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130df80-1fcd-4fa6-895f-e7bfd9961dac None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:03.297618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130df80-1fcd-4fa6-895f-e7bfd9961dac None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:03.298087 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130df80-1fcd-4fa6-895f-e7bfd9961dac None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/060b6347b13b4f67bf47169f5668b205/roles/a5689ba8062a40f38b7a985af27c2f5c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:03.314889 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130df80-1fcd-4fa6-895f-e7bfd9961dac None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=060b6347b13b4f67bf47169f5668b205, role_id=a5689ba8062a40f38b7a985af27c2f5c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:03.316395 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130df80-1fcd-4fa6-895f-e7bfd9961dac None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:03.320587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14c53a-3473-4bcb-a395-d547428344f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:03.321224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14c53a-3473-4bcb-a395-d547428344f8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:03.321471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14c53a-3473-4bcb-a395-d547428344f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:03.321735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14c53a-3473-4bcb-a395-d547428344f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:03.322452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14c53a-3473-4bcb-a395-d547428344f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:03.322749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14c53a-3473-4bcb-a395-d547428344f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:03.324130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14c53a-3473-4bcb-a395-d547428344f8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:03.336106 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 294/599] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:03.336892 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14c53a-3473-4bcb-a395-d547428344f8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:03.397716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:03.402640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 306/600] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:17:03 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/060b6347b13b4f67bf47169f5668b205/roles/a5689ba8062a40f38b7a985af27c2f5c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:17:03.415388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130df80-1fcd-4fa6-895f-e7bfd9961dac None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:03.426746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:03.449027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14c53a-3473-4bcb-a395-d547428344f8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:03.489139 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a71d4-df33-4b14-a68c-3469ae1cdeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:03.489822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a71d4-df33-4b14-a68c-3469ae1cdeb8 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:03.490136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a71d4-df33-4b14-a68c-3469ae1cdeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:03.490519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a71d4-df33-4b14-a68c-3469ae1cdeb8 None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/1947d85a08e944f3a1e7451ee7847b74/roles/a5689ba8062a40f38b7a985af27c2f5c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:03.508481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a71d4-df33-4b14-a68c-3469ae1cdeb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=1947d85a08e944f3a1e7451ee7847b74, role_id=a5689ba8062a40f38b7a985af27c2f5c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:03.509960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a71d4-df33-4b14-a68c-3469ae1cdeb8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:03.539751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130df80-1fcd-4fa6-895f-e7bfd9961dac None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:03.577408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b5fc3-dcc9-4a80-bd02-94e0d9562c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:03.578070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b5fc3-dcc9-4a80-bd02-94e0d9562c9e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:03.578347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b5fc3-dcc9-4a80-bd02-94e0d9562c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:03.578613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b5fc3-dcc9-4a80-bd02-94e0d9562c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:03.587290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 295/601] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:17:03 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/1947d85a08e944f3a1e7451ee7847b74/roles/a5689ba8062a40f38b7a985af27c2f5c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:17:03.588342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a71d4-df33-4b14-a68c-3469ae1cdeb8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:03.594824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b5fc3-dcc9-4a80-bd02-94e0d9562c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:03.598045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b5fc3-dcc9-4a80-bd02-94e0d9562c9e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-699b5fc3-dcc9-4a80-bd02-94e0d9562c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:03.624762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:03.625809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:03.626814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:03.626814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:03.626814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:03.629058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 307/602] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:03.635456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b43ae-f546-4fdc-813e-b3bd212f456e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:03.636024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b43ae-f546-4fdc-813e-b3bd212f456e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:03.636540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b43ae-f546-4fdc-813e-b3bd212f456e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:03.638561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 308/603] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:03.639661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b43ae-f546-4fdc-813e-b3bd212f456e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:03.703333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:03.741264 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a71d4-df33-4b14-a68c-3469ae1cdeb8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:03.781211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b43ae-f546-4fdc-813e-b3bd212f456e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:03.782392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:03.788718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e43b07-e4c9-40f9-9f5d-71160579ebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:03.789457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e43b07-e4c9-40f9-9f5d-71160579ebe8 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:03.790172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e43b07-e4c9-40f9-9f5d-71160579ebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:03.790172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e43b07-e4c9-40f9-9f5d-71160579ebe8 None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/18a16e6246fb4693b044bf939bce8244/roles/a5689ba8062a40f38b7a985af27c2f5c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:03.806526 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e43b07-e4c9-40f9-9f5d-71160579ebe8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=18a16e6246fb4693b044bf939bce8244, role_id=a5689ba8062a40f38b7a985af27c2f5c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:03.808057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e43b07-e4c9-40f9-9f5d-71160579ebe8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:03.822695 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea827a-29d5-4e5f-83df-a2aa6aa05d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:03.823425 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea827a-29d5-4e5f-83df-a2aa6aa05d29 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:03.823708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea827a-29d5-4e5f-83df-a2aa6aa05d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:03.823974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea827a-29d5-4e5f-83df-a2aa6aa05d29 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:03.824676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea827a-29d5-4e5f-83df-a2aa6aa05d29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:03.824986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea827a-29d5-4e5f-83df-a2aa6aa05d29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:03.826402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea827a-29d5-4e5f-83df-a2aa6aa05d29 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:03.845491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 309/604] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:03.845491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f001ce-6348-428a-81dd-0fdc042f7a78 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:03.845491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f001ce-6348-428a-81dd-0fdc042f7a78 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:03.845491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f001ce-6348-428a-81dd-0fdc042f7a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:03.866378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-28f001ce-6348-428a-81dd-0fdc042f7a78 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:03.867861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-28f001ce-6348-428a-81dd-0fdc042f7a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:03.911294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 296/605] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:17:03 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/18a16e6246fb4693b044bf939bce8244/roles/a5689ba8062a40f38b7a985af27c2f5c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:17:03.918134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e43b07-e4c9-40f9-9f5d-71160579ebe8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:03.991660 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 310/606] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:04.075083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e43b07-e4c9-40f9-9f5d-71160579ebe8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:04.125568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f141d-a921-42c1-9edc-eef33b24b062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:04.126454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f141d-a921-42c1-9edc-eef33b24b062 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:04.126838 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f141d-a921-42c1-9edc-eef33b24b062 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:04.127204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f141d-a921-42c1-9edc-eef33b24b062 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:04.135514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f141d-a921-42c1-9edc-eef33b24b062 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:04.137169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f141d-a921-42c1-9edc-eef33b24b062 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-a46f141d-a921-42c1-9edc-eef33b24b062 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:04.150593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:04.151735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:04.152854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:04.152854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:04.152854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:04.152854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:04.152854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:04.152854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:04.152854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:04.152854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:04.155151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 297/607] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:04.160588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f001ce-6348-428a-81dd-0fdc042f7a78 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:04.210407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:04.280882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f001ce-6348-428a-81dd-0fdc042f7a78 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:04.324751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53785a1-8df0-4270-84a5-b4855b57f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:04.325525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53785a1-8df0-4270-84a5-b4855b57f920 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:04.325909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53785a1-8df0-4270-84a5-b4855b57f920 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:04.326278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53785a1-8df0-4270-84a5-b4855b57f920 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:04.327064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53785a1-8df0-4270-84a5-b4855b57f920 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:04.327460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53785a1-8df0-4270-84a5-b4855b57f920 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:04.329265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53785a1-8df0-4270-84a5-b4855b57f920 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:04.346404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 311/608] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:04.352246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f141d-a921-42c1-9edc-eef33b24b062 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:04.381673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53785a1-8df0-4270-84a5-b4855b57f920 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:04.434839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:04.553064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f141d-a921-42c1-9edc-eef33b24b062 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:04.574980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:04.578511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53785a1-8df0-4270-84a5-b4855b57f920 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:04.625589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316c54c-c3ac-427c-b630-23bc6cecac43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:04.626357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316c54c-c3ac-427c-b630-23bc6cecac43 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:04.626632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316c54c-c3ac-427c-b630-23bc6cecac43 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:04.626960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316c54c-c3ac-427c-b630-23bc6cecac43 None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/02432d1312a34273813856362cada1d6/roles/a5689ba8062a40f38b7a985af27c2f5c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:04.644464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ca75d-d315-42b9-a27d-0f03204e488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:04.645109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ca75d-d315-42b9-a27d-0f03204e488e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:04.645369 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ca75d-d315-42b9-a27d-0f03204e488e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:04.645639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ca75d-d315-42b9-a27d-0f03204e488e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:04.657035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316c54c-c3ac-427c-b630-23bc6cecac43 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=02432d1312a34273813856362cada1d6, role_id=a5689ba8062a40f38b7a985af27c2f5c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:04.658500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316c54c-c3ac-427c-b630-23bc6cecac43 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:04.662934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ca75d-d315-42b9-a27d-0f03204e488e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-827ca75d-d315-42b9-a27d-0f03204e488e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:04.669406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:04.670477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:04.671350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 312/609] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:04.678870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ca75d-d315-42b9-a27d-0f03204e488e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:04.780755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 298/610] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:17:04 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/02432d1312a34273813856362cada1d6/roles/a5689ba8062a40f38b7a985af27c2f5c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:17:04.815769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ca75d-d315-42b9-a27d-0f03204e488e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:04.860878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7bc8a-0821-45f5-a80c-eabb9c84dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:04.861903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7bc8a-0821-45f5-a80c-eabb9c84dbbc None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:04.862390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7bc8a-0821-45f5-a80c-eabb9c84dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:04.862861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7bc8a-0821-45f5-a80c-eabb9c84dbbc None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:04.863766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7bc8a-0821-45f5-a80c-eabb9c84dbbc None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:04.864270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7bc8a-0821-45f5-a80c-eabb9c84dbbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:04.866649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7bc8a-0821-45f5-a80c-eabb9c84dbbc None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:04.877037 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 313/611] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:17:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:04.883386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316c54c-c3ac-427c-b630-23bc6cecac43 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:05.022691 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:05.032997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316c54c-c3ac-427c-b630-23bc6cecac43 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:05.072759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b35479-3d2f-4c34-b510-695c1b9ce207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:05.073311 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b35479-3d2f-4c34-b510-695c1b9ce207 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:05.073588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b35479-3d2f-4c34-b510-695c1b9ce207 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:05.073860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b35479-3d2f-4c34-b510-695c1b9ce207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:05.085943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b35479-3d2f-4c34-b510-695c1b9ce207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:05.095246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b35479-3d2f-4c34-b510-695c1b9ce207 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d3b35479-3d2f-4c34-b510-695c1b9ce207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:05.103634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:05.104680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:05.106179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:05.106179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:05.106179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:05.106179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 299/612] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:05.115022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7bc8a-0821-45f5-a80c-eabb9c84dbbc None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:05.156886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:05.272299 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7bc8a-0821-45f5-a80c-eabb9c84dbbc None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:05.320996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc61eea-a0a0-43f1-8df4-f95d0c0c89d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:05.321706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc61eea-a0a0-43f1-8df4-f95d0c0c89d5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:05.322080 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc61eea-a0a0-43f1-8df4-f95d0c0c89d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:05.322451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc61eea-a0a0-43f1-8df4-f95d0c0c89d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:05.323158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc61eea-a0a0-43f1-8df4-f95d0c0c89d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:05.323406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc61eea-a0a0-43f1-8df4-f95d0c0c89d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:05.325914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc61eea-a0a0-43f1-8df4-f95d0c0c89d5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:05.345339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 314/613] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:05.351975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b35479-3d2f-4c34-b510-695c1b9ce207 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:05.488719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b35479-3d2f-4c34-b510-695c1b9ce207 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:05.526933 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa41bd-632f-4330-a22d-5c3704dc8762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:05.527570 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa41bd-632f-4330-a22d-5c3704dc8762 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:05.527848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa41bd-632f-4330-a22d-5c3704dc8762 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:05.528118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa41bd-632f-4330-a22d-5c3704dc8762 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:05.536065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa41bd-632f-4330-a22d-5c3704dc8762 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:05.538540 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa41bd-632f-4330-a22d-5c3704dc8762 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-e8aa41bd-632f-4330-a22d-5c3704dc8762 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:05.550554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:05.551551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:05.552522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:05.552522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:05.552522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:05.552522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:05.552522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:05.552522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:05.552522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:05.552522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:05.552522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:17:05.552522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:05.552522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 300/614] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:17:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:05.563015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc61eea-a0a0-43f1-8df4-f95d0c0c89d5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:05.682913 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:05.702280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc61eea-a0a0-43f1-8df4-f95d0c0c89d5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:05.745673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f49b41-4a12-4f83-acf7-5d2603886630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:05.746338 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f49b41-4a12-4f83-acf7-5d2603886630 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:05.746625 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f49b41-4a12-4f83-acf7-5d2603886630 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:05.746906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f49b41-4a12-4f83-acf7-5d2603886630 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:05.747648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f49b41-4a12-4f83-acf7-5d2603886630 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:05.748024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f49b41-4a12-4f83-acf7-5d2603886630 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:05.749500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ac667-88a2-44bb-962c-084365f18e7f None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:05.749790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ac667-88a2-44bb-962c-084365f18e7f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:05.750105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ac667-88a2-44bb-962c-084365f18e7f None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:05.751708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 301/615] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:05.755491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f49b41-4a12-4f83-acf7-5d2603886630 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:05.756908 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a7fa-744d-4c28-bf60-0111d5ff13b2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:05.757287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a7fa-744d-4c28-bf60-0111d5ff13b2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:05.757575 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96a7fa-744d-4c28-bf60-0111d5ff13b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:05.774255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:05.779110 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2b96a7fa-744d-4c28-bf60-0111d5ff13b2 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:05.780505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2b96a7fa-744d-4c28-bf60-0111d5ff13b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:05.784302 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 315/616] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 1 16:17:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:05.790106 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f49b41-4a12-4f83-acf7-5d2603886630 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:05.916191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 302/617] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:17:05.918164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c088-db6e-4ac7-8c39-0bc213cc2b81 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:05.918796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c088-db6e-4ac7-8c39-0bc213cc2b81 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:05.919284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6c088-db6e-4ac7-8c39-0bc213cc2b81 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:05.920954 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 303/618] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:05.922447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f49b41-4a12-4f83-acf7-5d2603886630 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:05.940789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f572c-e561-4617-a7d9-1ee9d350abab None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:05.941450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f572c-e561-4617-a7d9-1ee9d350abab None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:05.941938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f572c-e561-4617-a7d9-1ee9d350abab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:05.969997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0e4f572c-e561-4617-a7d9-1ee9d350abab None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:05.975495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eab5c6-0de5-40e8-91b6-363c36dfb217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:05.976158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eab5c6-0de5-40e8-91b6-363c36dfb217 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:05.976441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eab5c6-0de5-40e8-91b6-363c36dfb217 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:05.976714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eab5c6-0de5-40e8-91b6-363c36dfb217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:05.978596 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0e4f572c-e561-4617-a7d9-1ee9d350abab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:05.998664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eab5c6-0de5-40e8-91b6-363c36dfb217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:06.000211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eab5c6-0de5-40e8-91b6-363c36dfb217 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:06.003983 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-93eab5c6-0de5-40e8-91b6-363c36dfb217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:06.027500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:06.028709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:06.029705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:06.029705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:06.029705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:06.029705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 316/619] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:06.039640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eab5c6-0de5-40e8-91b6-363c36dfb217 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:06.119671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 304/620] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:06.200246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eab5c6-0de5-40e8-91b6-363c36dfb217 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:06.245978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f572c-e561-4617-a7d9-1ee9d350abab None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:06.247766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a405c7-4381-4b15-808a-79eddd14b38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:06.248386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a405c7-4381-4b15-808a-79eddd14b38b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:06.249042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a405c7-4381-4b15-808a-79eddd14b38b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:06.249327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a405c7-4381-4b15-808a-79eddd14b38b None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:06.250008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a405c7-4381-4b15-808a-79eddd14b38b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:06.250316 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a405c7-4381-4b15-808a-79eddd14b38b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:06.251679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a405c7-4381-4b15-808a-79eddd14b38b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:06.267235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 317/621] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:06.273502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a405c7-4381-4b15-808a-79eddd14b38b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:06.343573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:06.378148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a405c7-4381-4b15-808a-79eddd14b38b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:06.388634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:06.415766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645fc51-848c-4a51-9736-79f0f524f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:06.416422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645fc51-848c-4a51-9736-79f0f524f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:06.416703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645fc51-848c-4a51-9736-79f0f524f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:06.417006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645fc51-848c-4a51-9736-79f0f524f8c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:06.425386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645fc51-848c-4a51-9736-79f0f524f8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:06.426910 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645fc51-848c-4a51-9736-79f0f524f8c6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:06.432105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f572c-e561-4617-a7d9-1ee9d350abab None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4645fc51-848c-4a51-9736-79f0f524f8c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:06.439205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:06.440122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:06.441011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:06.441011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:06.441011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:06.441011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:06.441011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:06.441011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:06.441011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:06.441011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:06.441011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 318/622] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:06.441983 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a045-e068-4644-8e99-4811d09b9583 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:06.442199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a045-e068-4644-8e99-4811d09b9583 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:06.442757 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346a045-e068-4644-8e99-4811d09b9583 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:06.444593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 319/623] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:06.446943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a045-e068-4644-8e99-4811d09b9583 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:06.488687 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155ebc8-126c-459b-909b-a1d771c0a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:06.489341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155ebc8-126c-459b-909b-a1d771c0a6fd None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:06.489730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155ebc8-126c-459b-909b-a1d771c0a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:06.490135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155ebc8-126c-459b-909b-a1d771c0a6fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:06.501694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155ebc8-126c-459b-909b-a1d771c0a6fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f155ebc8-126c-459b-909b-a1d771c0a6fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:06.507014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:06.508010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:06.508867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:06.513192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 305/624] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:06.514719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337bd44-9776-4832-a595-8fc88fd2dc79 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:06.515343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337bd44-9776-4832-a595-8fc88fd2dc79 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:06.515515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337bd44-9776-4832-a595-8fc88fd2dc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:06.536605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0337bd44-9776-4832-a595-8fc88fd2dc79 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:06.538893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0337bd44-9776-4832-a595-8fc88fd2dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:06.575080 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346a045-e068-4644-8e99-4811d09b9583 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:06.590215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:06.613430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba75a0-ab7a-430a-9055-d6bf5295f7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:06.614191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 306/625] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:06.614379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba75a0-ab7a-430a-9055-d6bf5295f7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:06.614469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba75a0-ab7a-430a-9055-d6bf5295f7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:06.614730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba75a0-ab7a-430a-9055-d6bf5295f7d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:06.615536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba75a0-ab7a-430a-9055-d6bf5295f7d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:06.616013 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba75a0-ab7a-430a-9055-d6bf5295f7d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:06.617815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba75a0-ab7a-430a-9055-d6bf5295f7d7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:06.626867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337bd44-9776-4832-a595-8fc88fd2dc79 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:06.634224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 320/626] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:06.635083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba75a0-ab7a-430a-9055-d6bf5295f7d7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:06.742395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:06.754022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba75a0-ab7a-430a-9055-d6bf5295f7d7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:06.758250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337bd44-9776-4832-a595-8fc88fd2dc79 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:06.795623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea92ee7-360d-49b1-abbb-38a941fd7840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:06.796577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea92ee7-360d-49b1-abbb-38a941fd7840 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:06.797039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea92ee7-360d-49b1-abbb-38a941fd7840 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:06.797540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea92ee7-360d-49b1-abbb-38a941fd7840 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:06.808480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e1873-251a-4164-819d-c43040d3391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:06.809097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e1873-251a-4164-819d-c43040d3391b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:06.809404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e1873-251a-4164-819d-c43040d3391b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:06.809819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e1873-251a-4164-819d-c43040d3391b None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:06.810583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea92ee7-360d-49b1-abbb-38a941fd7840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:06.810696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e1873-251a-4164-819d-c43040d3391b None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:06.810898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e1873-251a-4164-819d-c43040d3391b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:06.812257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e1873-251a-4164-819d-c43040d3391b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-dea92ee7-360d-49b1-abbb-38a941fd7840 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:06.816812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:06.817805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:06.819557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:06.822462 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 321/627] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:06.826584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 307/628] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:17:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:06.827669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea92ee7-360d-49b1-abbb-38a941fd7840 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:06.827927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e1873-251a-4164-819d-c43040d3391b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:06.875154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:06.943664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e1873-251a-4164-819d-c43040d3391b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:06.959280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea92ee7-360d-49b1-abbb-38a941fd7840 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:06.961411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:06.981665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2953d-33cd-4c3d-8079-d5154d48adcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:06.982432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2953d-33cd-4c3d-8079-d5154d48adcc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:06.982766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2953d-33cd-4c3d-8079-d5154d48adcc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:06.983141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2953d-33cd-4c3d-8079-d5154d48adcc None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:06.983827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2953d-33cd-4c3d-8079-d5154d48adcc None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:06.984134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2953d-33cd-4c3d-8079-d5154d48adcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:06.985546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2953d-33cd-4c3d-8079-d5154d48adcc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:07.002094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 308/629] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:17:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:07.002094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2953d-33cd-4c3d-8079-d5154d48adcc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:07.009700 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2a513-26d8-4996-a7e8-b9818cd2eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:07.010472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2a513-26d8-4996-a7e8-b9818cd2eac3 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:07.010752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2a513-26d8-4996-a7e8-b9818cd2eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:07.011021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2a513-26d8-4996-a7e8-b9818cd2eac3 None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/589e62c8d27044eea16e7c1f803e1393/roles/a5689ba8062a40f38b7a985af27c2f5c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:07.027529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2a513-26d8-4996-a7e8-b9818cd2eac3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=589e62c8d27044eea16e7c1f803e1393, role_id=a5689ba8062a40f38b7a985af27c2f5c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:07.030030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2a513-26d8-4996-a7e8-b9818cd2eac3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:07.108515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 322/630] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:17:06 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/589e62c8d27044eea16e7c1f803e1393/roles/a5689ba8062a40f38b7a985af27c2f5c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:17:07.109726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2a513-26d8-4996-a7e8-b9818cd2eac3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:07.123246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2953d-33cd-4c3d-8079-d5154d48adcc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:07.178485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025f16c-cd6d-4458-b7d6-995868dfb54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:07.179478 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025f16c-cd6d-4458-b7d6-995868dfb54f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:07.180004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025f16c-cd6d-4458-b7d6-995868dfb54f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:07.180466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025f16c-cd6d-4458-b7d6-995868dfb54f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:07.204444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025f16c-cd6d-4458-b7d6-995868dfb54f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:07.207419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5025f16c-cd6d-4458-b7d6-995868dfb54f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-5025f16c-cd6d-4458-b7d6-995868dfb54f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:07.236666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:07.237749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:07.238686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:07.238686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:07.238686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:07.242061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 309/631] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:07.243699 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025f16c-cd6d-4458-b7d6-995868dfb54f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:07.249395 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:07.275047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2a513-26d8-4996-a7e8-b9818cd2eac3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:07.293347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:07.316691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55460286-9382-439d-aa32-dcdb25aeea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:07.317334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55460286-9382-439d-aa32-dcdb25aeea36 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:07.317704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55460286-9382-439d-aa32-dcdb25aeea36 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:07.317862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55460286-9382-439d-aa32-dcdb25aeea36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:07.329679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55460286-9382-439d-aa32-dcdb25aeea36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-55460286-9382-439d-aa32-dcdb25aeea36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:07.335103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:07.337680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:07.338774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:07.341671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 323/632] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:07.345965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55460286-9382-439d-aa32-dcdb25aeea36 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:07.390767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025f16c-cd6d-4458-b7d6-995868dfb54f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:07.436536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63504b38-77de-4cf6-a3e4-76169c98a2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:07.437588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504b38-77de-4cf6-a3e4-76169c98a2ea None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:07.437867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504b38-77de-4cf6-a3e4-76169c98a2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:07.438212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63504b38-77de-4cf6-a3e4-76169c98a2ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:07.450378 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63504b38-77de-4cf6-a3e4-76169c98a2ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:07.451866 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63504b38-77de-4cf6-a3e4-76169c98a2ea None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:07.460938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55460286-9382-439d-aa32-dcdb25aeea36 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-63504b38-77de-4cf6-a3e4-76169c98a2ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:07.467793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:07.468826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:07.469734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:07.469734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:07.469734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:07.469734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 310/633] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:07.470270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351380b-b0e5-49ba-9fbf-ba660e9ba759 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:07.470614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351380b-b0e5-49ba-9fbf-ba660e9ba759 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:07.470822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351380b-b0e5-49ba-9fbf-ba660e9ba759 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:07.476384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 311/634] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:07.476384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351380b-b0e5-49ba-9fbf-ba660e9ba759 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:07.508050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbdcd3-3dc8-475f-9866-2b49d9b200d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:07.508664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbdcd3-3dc8-475f-9866-2b49d9b200d6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:07.508942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbdcd3-3dc8-475f-9866-2b49d9b200d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:07.509213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbdcd3-3dc8-475f-9866-2b49d9b200d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:07.509860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbdcd3-3dc8-475f-9866-2b49d9b200d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:07.510191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbdcd3-3dc8-475f-9866-2b49d9b200d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:07.511557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbdcd3-3dc8-475f-9866-2b49d9b200d6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:07.529364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 324/635] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:07.529364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbdcd3-3dc8-475f-9866-2b49d9b200d6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:07.530457 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:07.572912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:07.596745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351380b-b0e5-49ba-9fbf-ba660e9ba759 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:07.634654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66527ca1-53da-4038-8b06-5347c549de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:07.635392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527ca1-53da-4038-8b06-5347c549de80 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:07.635674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527ca1-53da-4038-8b06-5347c549de80 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:07.635950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66527ca1-53da-4038-8b06-5347c549de80 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:07.636614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66527ca1-53da-4038-8b06-5347c549de80 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:07.636913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66527ca1-53da-4038-8b06-5347c549de80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:07.638312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66527ca1-53da-4038-8b06-5347c549de80 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:07.647606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbdcd3-3dc8-475f-9866-2b49d9b200d6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:07.648511 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 312/636] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:17:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:07.654310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacc852-0ec5-406b-973a-1f3945cf4f5c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:07.654599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacc852-0ec5-406b-973a-1f3945cf4f5c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:07.654873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacc852-0ec5-406b-973a-1f3945cf4f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:07.673155 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-eeacc852-0ec5-406b-973a-1f3945cf4f5c None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:07.674380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-eeacc852-0ec5-406b-973a-1f3945cf4f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:07.691303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d3cf0-9e68-45f5-a2cf-2d079b97277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:07.692009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d3cf0-9e68-45f5-a2cf-2d079b97277c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:07.692355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d3cf0-9e68-45f5-a2cf-2d079b97277c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:07.692731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d3cf0-9e68-45f5-a2cf-2d079b97277c None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:07.693982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d3cf0-9e68-45f5-a2cf-2d079b97277c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:07.694436 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d3cf0-9e68-45f5-a2cf-2d079b97277c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:07.696104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d3cf0-9e68-45f5-a2cf-2d079b97277c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:07.713443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 325/637] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:07.713443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d3cf0-9e68-45f5-a2cf-2d079b97277c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:07.765911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 313/638] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:07.765911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacc852-0ec5-406b-973a-1f3945cf4f5c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:07.802465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:07.850513 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d3cf0-9e68-45f5-a2cf-2d079b97277c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:07.866962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:07.895477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacc852-0ec5-406b-973a-1f3945cf4f5c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:07.902201 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434efb03-a227-4f06-b89c-843935d2ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:07.903202 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434efb03-a227-4f06-b89c-843935d2ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:07.903701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434efb03-a227-4f06-b89c-843935d2ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:07.904178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434efb03-a227-4f06-b89c-843935d2ccb4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:07.917782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434efb03-a227-4f06-b89c-843935d2ccb4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:07.920129 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434efb03-a227-4f06-b89c-843935d2ccb4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:07.934445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c4a4d-6674-416c-9ea6-bb807e8155a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:07.935081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c4a4d-6674-416c-9ea6-bb807e8155a4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:07.935361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c4a4d-6674-416c-9ea6-bb807e8155a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:07.935634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c4a4d-6674-416c-9ea6-bb807e8155a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-434efb03-a227-4f06-b89c-843935d2ccb4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:07.939373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:07.940367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:07.941415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:07.941415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:07.941415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:07.941415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:07.941415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:07.941415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:07.941415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:07.941415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:07.941415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:07.941415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:07.949190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 326/639] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 1 16:17:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:07.949190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434efb03-a227-4f06-b89c-843935d2ccb4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:07.953140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c4a4d-6674-416c-9ea6-bb807e8155a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:07.954637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c4a4d-6674-416c-9ea6-bb807e8155a4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-a47c4a4d-6674-416c-9ea6-bb807e8155a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:07.971260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:07.972325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:07.973306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:07.973306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:07.973306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:07.977495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 314/640] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:07.978818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c4a4d-6674-416c-9ea6-bb807e8155a4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:08.095560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434efb03-a227-4f06-b89c-843935d2ccb4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:08.106228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c4a4d-6674-416c-9ea6-bb807e8155a4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:08.122366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:08.135676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7627e0-bc8c-4595-a0c7-ff769a20cd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:08.136320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7627e0-bc8c-4595-a0c7-ff769a20cd6d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:08.136602 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7627e0-bc8c-4595-a0c7-ff769a20cd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:08.136875 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7627e0-bc8c-4595-a0c7-ff769a20cd6d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:08.137923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:08.145017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7627e0-bc8c-4595-a0c7-ff769a20cd6d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:08.147035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7627e0-bc8c-4595-a0c7-ff769a20cd6d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:08.147387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434e12f-2ac6-4805-9e20-e76d3cbe6ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:08.148000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e12f-2ac6-4805-9e20-e76d3cbe6ddb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:08.148278 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e12f-2ac6-4805-9e20-e76d3cbe6ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:08.148547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e12f-2ac6-4805-9e20-e76d3cbe6ddb None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:08.149281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434e12f-2ac6-4805-9e20-e76d3cbe6ddb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:08.149581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434e12f-2ac6-4805-9e20-e76d3cbe6ddb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:08.151015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434e12f-2ac6-4805-9e20-e76d3cbe6ddb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ce7627e0-bc8c-4595-a0c7-ff769a20cd6d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:08.159591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:08.160940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 327/641] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:17:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:08.168491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7627e0-bc8c-4595-a0c7-ff769a20cd6d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:08.174665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 315/642] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 1 16:17:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:08.175712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434e12f-2ac6-4805-9e20-e76d3cbe6ddb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:08.281120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7627e0-bc8c-4595-a0c7-ff769a20cd6d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:08.290991 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434e12f-2ac6-4805-9e20-e76d3cbe6ddb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:08.320734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0c234-9a84-4671-9d80-0585fc101d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:08.321475 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0c234-9a84-4671-9d80-0585fc101d25 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:08.321614 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0c234-9a84-4671-9d80-0585fc101d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:08.321863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0c234-9a84-4671-9d80-0585fc101d25 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:08.322624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0c234-9a84-4671-9d80-0585fc101d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:08.322929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0c234-9a84-4671-9d80-0585fc101d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:08.324270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0c234-9a84-4671-9d80-0585fc101d25 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:08.332748 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba9bc-5465-4202-a741-5280c9e0a1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:08.333383 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba9bc-5465-4202-a741-5280c9e0a1de None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:08.333673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba9bc-5465-4202-a741-5280c9e0a1de None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:08.334001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba9bc-5465-4202-a741-5280c9e0a1de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:08.337518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 328/643] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:08.338580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0c234-9a84-4671-9d80-0585fc101d25 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:08.353126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bba9bc-5465-4202-a741-5280c9e0a1de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-e0bba9bc-5465-4202-a741-5280c9e0a1de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:08.358881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:08.359846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 316/644] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:08.360746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba9bc-5465-4202-a741-5280c9e0a1de None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:08.391955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:08.416184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:08.454216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0c234-9a84-4671-9d80-0585fc101d25 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:08.474035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba9bc-5465-4202-a741-5280c9e0a1de None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:08.491565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43eb02-bb54-442a-af70-070eac5d7d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:08.492184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43eb02-bb54-442a-af70-070eac5d7d3c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:08.492463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43eb02-bb54-442a-af70-070eac5d7d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:08.492735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43eb02-bb54-442a-af70-070eac5d7d3c None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:08.493473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43eb02-bb54-442a-af70-070eac5d7d3c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:08.493779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43eb02-bb54-442a-af70-070eac5d7d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:08.495240 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43eb02-bb54-442a-af70-070eac5d7d3c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:08.513656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8f384-f92a-4dfa-aa75-4de87e7a5639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:08.514302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8f384-f92a-4dfa-aa75-4de87e7a5639 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:08.518916 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8f384-f92a-4dfa-aa75-4de87e7a5639 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:08.519058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 329/645] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 1 16:17:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:08.519153 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c8f384-f92a-4dfa-aa75-4de87e7a5639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:08.519256 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43eb02-bb54-442a-af70-070eac5d7d3c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:08.588943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8f384-f92a-4dfa-aa75-4de87e7a5639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:08.590421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c8f384-f92a-4dfa-aa75-4de87e7a5639 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:08.620027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:08.623956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43eb02-bb54-442a-af70-070eac5d7d3c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:08.636621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:08.663555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd831d3-fb0a-48f5-9166-5a01bba46b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:08.664478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd831d3-fb0a-48f5-9166-5a01bba46b9e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:08.664906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd831d3-fb0a-48f5-9166-5a01bba46b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:08.665324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd831d3-fb0a-48f5-9166-5a01bba46b9e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:08.673237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd831d3-fb0a-48f5-9166-5a01bba46b9e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:08.674908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd831d3-fb0a-48f5-9166-5a01bba46b9e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ddd831d3-fb0a-48f5-9166-5a01bba46b9e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:08.689253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:08.690562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 330/646] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:17:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:08.691525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd831d3-fb0a-48f5-9166-5a01bba46b9e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:08.704586 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 317/647] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:17:08.704586 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8f384-f92a-4dfa-aa75-4de87e7a5639 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:08.804698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd831d3-fb0a-48f5-9166-5a01bba46b9e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:08.811325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c8f384-f92a-4dfa-aa75-4de87e7a5639 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:08.844334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328719c-4e61-414c-bed2-1c1c8cd81cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:08.844957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328719c-4e61-414c-bed2-1c1c8cd81cbb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:08.845241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328719c-4e61-414c-bed2-1c1c8cd81cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:08.845514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328719c-4e61-414c-bed2-1c1c8cd81cbb None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:08.846234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328719c-4e61-414c-bed2-1c1c8cd81cbb None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:08.846536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328719c-4e61-414c-bed2-1c1c8cd81cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:08.847911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328719c-4e61-414c-bed2-1c1c8cd81cbb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:08.854828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faea11a-f28e-44dd-8ac0-3a560ebb4506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:08.855535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faea11a-f28e-44dd-8ac0-3a560ebb4506 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:08.855816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faea11a-f28e-44dd-8ac0-3a560ebb4506 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:08.856089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faea11a-f28e-44dd-8ac0-3a560ebb4506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:08.857568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 331/648] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:17:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:08.858585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328719c-4e61-414c-bed2-1c1c8cd81cbb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:08.877425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:08.885639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:08.935640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faea11a-f28e-44dd-8ac0-3a560ebb4506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:08.937082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faea11a-f28e-44dd-8ac0-3a560ebb4506 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:08.966535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328719c-4e61-414c-bed2-1c1c8cd81cbb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:09.007567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c924ccc-720e-477f-9325-dfaa181735a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:09.008286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c924ccc-720e-477f-9325-dfaa181735a8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.008711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c924ccc-720e-477f-9325-dfaa181735a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.008908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c924ccc-720e-477f-9325-dfaa181735a8 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:09.009663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c924ccc-720e-477f-9325-dfaa181735a8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:09.010271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c924ccc-720e-477f-9325-dfaa181735a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:09.011475 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c924ccc-720e-477f-9325-dfaa181735a8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:09.036384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 332/649] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Sep 1 16:17:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:09.036384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c924ccc-720e-477f-9325-dfaa181735a8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:09.060279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 318/650] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:17:09.061321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faea11a-f28e-44dd-8ac0-3a560ebb4506 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:09.128329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:09.145816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:09.164891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c924ccc-720e-477f-9325-dfaa181735a8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:09.200112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebd252-68a6-4d6f-be12-34252d935e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:09.200752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebd252-68a6-4d6f-be12-34252d935e3a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.201022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebd252-68a6-4d6f-be12-34252d935e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.201288 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ebd252-68a6-4d6f-be12-34252d935e3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:09.212215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faea11a-f28e-44dd-8ac0-3a560ebb4506 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:09.212380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebd252-68a6-4d6f-be12-34252d935e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:09.213704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ebd252-68a6-4d6f-be12-34252d935e3a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-64ebd252-68a6-4d6f-be12-34252d935e3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:09.228693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:09.230082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:09.231140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:09.231140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:09.231140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:09.231140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 333/651] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:09.231140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebd252-68a6-4d6f-be12-34252d935e3a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:09.251003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14404-b081-41b1-bf60-c2aa984fd116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:09.251649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14404-b081-41b1-bf60-c2aa984fd116 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.251927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14404-b081-41b1-bf60-c2aa984fd116 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.252194 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b14404-b081-41b1-bf60-c2aa984fd116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:09.263899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b14404-b081-41b1-bf60-c2aa984fd116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:09.265356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b14404-b081-41b1-bf60-c2aa984fd116 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-73b14404-b081-41b1-bf60-c2aa984fd116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:09.281126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:09.282405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:09.283801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:09.283801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:09.283801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:09.286068 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 319/652] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:09.287541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14404-b081-41b1-bf60-c2aa984fd116 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:09.341104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ebd252-68a6-4d6f-be12-34252d935e3a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:09.374455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:09.379551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f369d85-5c02-4bda-b938-824a9fc666da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:09.380131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369d85-5c02-4bda-b938-824a9fc666da None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.380414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369d85-5c02-4bda-b938-824a9fc666da None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.381329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369d85-5c02-4bda-b938-824a9fc666da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:09.392318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:09.402895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b14404-b081-41b1-bf60-c2aa984fd116 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:09.437817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22284f0b-5fa1-4668-a590-eddad967ee61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:09.438471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22284f0b-5fa1-4668-a590-eddad967ee61 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.438748 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22284f0b-5fa1-4668-a590-eddad967ee61 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.439014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22284f0b-5fa1-4668-a590-eddad967ee61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:09.450131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22284f0b-5fa1-4668-a590-eddad967ee61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:09.451545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22284f0b-5fa1-4668-a590-eddad967ee61 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:09.454734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f369d85-5c02-4bda-b938-824a9fc666da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:09.456175 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f369d85-5c02-4bda-b938-824a9fc666da None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-22284f0b-5fa1-4668-a590-eddad967ee61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:09.465493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:09.466648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:09.467621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:09.467621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:09.467621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:09.467621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 320/653] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:09.467895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5af77a-dab1-406f-805c-b3cee5fe2edf None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.468010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5af77a-dab1-406f-805c-b3cee5fe2edf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.468280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5af77a-dab1-406f-805c-b3cee5fe2edf None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:09.469704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 321/654] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:09.470344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5af77a-dab1-406f-805c-b3cee5fe2edf None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:09.566030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 334/655] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:17:09.566826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f369d85-5c02-4bda-b938-824a9fc666da None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:09.574883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5af77a-dab1-406f-805c-b3cee5fe2edf None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:09.598649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:09.612555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b281525-c400-4c95-8cf3-1b30b974ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:09.613159 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b281525-c400-4c95-8cf3-1b30b974ced2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.613435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b281525-c400-4c95-8cf3-1b30b974ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.613703 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b281525-c400-4c95-8cf3-1b30b974ced2 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:09.614385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b281525-c400-4c95-8cf3-1b30b974ced2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:09.614666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b281525-c400-4c95-8cf3-1b30b974ced2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:09.616132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b281525-c400-4c95-8cf3-1b30b974ced2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:09.627631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 322/656] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:09.628412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b281525-c400-4c95-8cf3-1b30b974ced2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:09.638728 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:09.672685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f369d85-5c02-4bda-b938-824a9fc666da None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:09.707274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bf0d0-e7b0-44c8-a703-b3426c23edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:09.707909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bf0d0-e7b0-44c8-a703-b3426c23edf1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.708185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bf0d0-e7b0-44c8-a703-b3426c23edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.708452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bf0d0-e7b0-44c8-a703-b3426c23edf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:09.710058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bf0d0-e7b0-44c8-a703-b3426c23edf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:09.710412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bf0d0-e7b0-44c8-a703-b3426c23edf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:09.711770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bf0d0-e7b0-44c8-a703-b3426c23edf1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:09.722878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 335/657] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:09.724080 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857f41e-e407-4196-a216-0ebde190d7bf None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.724409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857f41e-e407-4196-a216-0ebde190d7bf None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.724697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857f41e-e407-4196-a216-0ebde190d7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:09.741308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b281525-c400-4c95-8cf3-1b30b974ced2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:09.744105 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4857f41e-e407-4196-a216-0ebde190d7bf None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:09.745316 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4857f41e-e407-4196-a216-0ebde190d7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:09.781042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfcbae-61f6-4367-8539-e7c6f874bf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:09.781851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfcbae-61f6-4367-8539-e7c6f874bf75 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.782330 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfcbae-61f6-4367-8539-e7c6f874bf75 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.782761 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfcbae-61f6-4367-8539-e7c6f874bf75 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:09.783494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfcbae-61f6-4367-8539-e7c6f874bf75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:09.783884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfcbae-61f6-4367-8539-e7c6f874bf75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:09.785370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfcbae-61f6-4367-8539-e7c6f874bf75 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:09.801147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 323/658] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:09.802037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfcbae-61f6-4367-8539-e7c6f874bf75 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:09.829494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 336/659] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:09.830375 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857f41e-e407-4196-a216-0ebde190d7bf None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:09.860764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:09.895506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:09.938277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfcbae-61f6-4367-8539-e7c6f874bf75 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:09.954809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857f41e-e407-4196-a216-0ebde190d7bf None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:09.977719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70521b0-7ae3-481b-b328-4889a11775e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:09.978747 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70521b0-7ae3-481b-b328-4889a11775e8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.979025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70521b0-7ae3-481b-b328-4889a11775e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.979297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70521b0-7ae3-481b-b328-4889a11775e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:09.991825 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70521b0-7ae3-481b-b328-4889a11775e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:09.993278 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70521b0-7ae3-481b-b328-4889a11775e8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:09.997755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e543224-1740-43a3-9498-7a4d4f2e37a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:09.998714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e543224-1740-43a3-9498-7a4d4f2e37a3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:09.999180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e543224-1740-43a3-9498-7a4d4f2e37a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:09.999634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e543224-1740-43a3-9498-7a4d4f2e37a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:10.011779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e543224-1740-43a3-9498-7a4d4f2e37a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:10.014270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e543224-1740-43a3-9498-7a4d4f2e37a3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f70521b0-7ae3-481b-b328-4889a11775e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:10.017149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:10.018296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:10.019241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:10.019241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:10.019241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:10.019241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 324/660] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:10.019479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70521b0-7ae3-481b-b328-4889a11775e8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4e543224-1740-43a3-9498-7a4d4f2e37a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:10.048497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:10.049728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:10.052439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:10.052439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:10.052439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:10.052439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:10.052439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:10.052439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:10.052439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:10.052439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:10.052439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 337/661] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:10.052439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e543224-1740-43a3-9498-7a4d4f2e37a3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:10.184139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:10.198736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70521b0-7ae3-481b-b328-4889a11775e8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:10.205314 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e543224-1740-43a3-9498-7a4d4f2e37a3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:10.226175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:10.245966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd0843-3718-41c2-9047-58201d933727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:10.247060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd0843-3718-41c2-9047-58201d933727 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:10.247549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd0843-3718-41c2-9047-58201d933727 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:10.247999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd0843-3718-41c2-9047-58201d933727 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:10.253681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6868c-728c-4e1d-a480-49ae45a81787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:10.254385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6868c-728c-4e1d-a480-49ae45a81787 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:10.254700 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6868c-728c-4e1d-a480-49ae45a81787 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:10.255004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6868c-728c-4e1d-a480-49ae45a81787 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:10.258464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd0843-3718-41c2-9047-58201d933727 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:10.260044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd0843-3718-41c2-9047-58201d933727 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:10.264177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6868c-728c-4e1d-a480-49ae45a81787 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:10.265698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6868c-728c-4e1d-a480-49ae45a81787 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-85bd0843-3718-41c2-9047-58201d933727 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:10.279263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:10.280418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:10.286686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:10.286686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:10.286686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:10.286686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:10.286686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:10.286686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:10.286686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:10.286686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:10.286686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 16:17:10.286686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-fdb6868c-728c-4e1d-a480-49ae45a81787 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:10.287418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:10.288361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:10.289580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:10.289580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:10.289580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:10.289580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:10.289580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:10.289580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:10.289580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:10.289580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:10.289580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 338/662] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:10.289580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6868c-728c-4e1d-a480-49ae45a81787 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:10.293040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 325/663] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:10 2022] GET /identity/v3/users/neutron => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:10.293040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd0843-3718-41c2-9047-58201d933727 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:10.424060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd0843-3718-41c2-9047-58201d933727 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:10.429593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6868c-728c-4e1d-a480-49ae45a81787 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:10.468301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb52249-1bfa-4f11-84d3-fa621827741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:10.468838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb52249-1bfa-4f11-84d3-fa621827741c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:10.469115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb52249-1bfa-4f11-84d3-fa621827741c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:10.469441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb52249-1bfa-4f11-84d3-fa621827741c None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:10.470115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb52249-1bfa-4f11-84d3-fa621827741c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:10.470414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb52249-1bfa-4f11-84d3-fa621827741c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:10.472732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb52249-1bfa-4f11-84d3-fa621827741c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:10.484425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a4a1f-c691-4abc-a826-cef7462cbda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:10.485069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a4a1f-c691-4abc-a826-cef7462cbda0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:10.485553 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a4a1f-c691-4abc-a826-cef7462cbda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:10.486116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a4a1f-c691-4abc-a826-cef7462cbda0 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:10.487298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a4a1f-c691-4abc-a826-cef7462cbda0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:10.487784 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a4a1f-c691-4abc-a826-cef7462cbda0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:10.489238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a4a1f-c691-4abc-a826-cef7462cbda0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:10.489820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 339/664] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:10.491258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb52249-1bfa-4f11-84d3-fa621827741c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:10.494381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:10.509908 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 326/665] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:10.509908 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a4a1f-c691-4abc-a826-cef7462cbda0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:10.571430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:10.614627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb52249-1bfa-4f11-84d3-fa621827741c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:10.641069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a4a1f-c691-4abc-a826-cef7462cbda0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:10.652175 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aa6ad-ee5a-4c86-80fa-8421c278ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:10.652823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aa6ad-ee5a-4c86-80fa-8421c278ba66 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:10.653105 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aa6ad-ee5a-4c86-80fa-8421c278ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:10.653377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aa6ad-ee5a-4c86-80fa-8421c278ba66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:10.664926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1aa6ad-ee5a-4c86-80fa-8421c278ba66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-bc1aa6ad-ee5a-4c86-80fa-8421c278ba66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:10.672949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:10.674267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:10.675504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 340/666] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:10.677375 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aa6ad-ee5a-4c86-80fa-8421c278ba66 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:10.685537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8bbab-300d-45c1-8ee6-008876a392ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:10.686161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8bbab-300d-45c1-8ee6-008876a392ca None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:10.686441 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8bbab-300d-45c1-8ee6-008876a392ca None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:10.686713 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8bbab-300d-45c1-8ee6-008876a392ca None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:10.687405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8bbab-300d-45c1-8ee6-008876a392ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:10.687711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8bbab-300d-45c1-8ee6-008876a392ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:10.689244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8bbab-300d-45c1-8ee6-008876a392ca None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:10.708530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 327/667] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:10.708530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8bbab-300d-45c1-8ee6-008876a392ca None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:10.765638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:10.816335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aa6ad-ee5a-4c86-80fa-8421c278ba66 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:10.830855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:10.834974 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8bbab-300d-45c1-8ee6-008876a392ca None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:10.864665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade22e94-8882-4474-8f60-27183980675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:10.866469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade22e94-8882-4474-8f60-27183980675a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:10.866752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade22e94-8882-4474-8f60-27183980675a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:10.867027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade22e94-8882-4474-8f60-27183980675a None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:10.867766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade22e94-8882-4474-8f60-27183980675a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:10.868064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade22e94-8882-4474-8f60-27183980675a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:10.869566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade22e94-8882-4474-8f60-27183980675a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:10.878276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b198a69-f74a-409e-a047-7f7a89b01b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:10.878986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b198a69-f74a-409e-a047-7f7a89b01b6f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:10.879822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b198a69-f74a-409e-a047-7f7a89b01b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:10.880096 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b198a69-f74a-409e-a047-7f7a89b01b6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:10.891860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b198a69-f74a-409e-a047-7f7a89b01b6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:10.893355 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b198a69-f74a-409e-a047-7f7a89b01b6f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:10.899358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 341/668] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Sep 1 16:17:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:10.899358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade22e94-8882-4474-8f60-27183980675a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-9b198a69-f74a-409e-a047-7f7a89b01b6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:10.907337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:10.908473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:10.909380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:10.909380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:10.909380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:10.909380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:10.909380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:10.909380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:10.909380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:10.909380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:10.909380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 328/669] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:10.909938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b198a69-f74a-409e-a047-7f7a89b01b6f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:11.028623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade22e94-8882-4474-8f60-27183980675a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:11.057161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b198a69-f74a-409e-a047-7f7a89b01b6f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:11.063266 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:11.081563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef48d4-15c9-415d-a99a-16742146df96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:11.082206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef48d4-15c9-415d-a99a-16742146df96 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:11.082476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef48d4-15c9-415d-a99a-16742146df96 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:11.082759 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef48d4-15c9-415d-a99a-16742146df96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:11.083483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef48d4-15c9-415d-a99a-16742146df96 None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=060b6347b13b4f67bf47169f5668b205) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:11.083780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef48d4-15c9-415d-a99a-16742146df96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:11.085899 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef48d4-15c9-415d-a99a-16742146df96 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:11.096409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 342/670] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:10 2022] GET /identity/v3/role_assignments?user.id=060b6347b13b4f67bf47169f5668b205&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:11.096409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef48d4-15c9-415d-a99a-16742146df96 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:11.121356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e1ab2-e6e0-41b0-b42f-1b462857df0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:11.122038 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e1ab2-e6e0-41b0-b42f-1b462857df0d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:11.122323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e1ab2-e6e0-41b0-b42f-1b462857df0d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:11.122593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e1ab2-e6e0-41b0-b42f-1b462857df0d None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:11.123304 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e1ab2-e6e0-41b0-b42f-1b462857df0d None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:11.123623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e1ab2-e6e0-41b0-b42f-1b462857df0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:11.129075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e1ab2-e6e0-41b0-b42f-1b462857df0d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:11.140589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 329/671] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:17:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:11.146028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e1ab2-e6e0-41b0-b42f-1b462857df0d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:11.181260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:11.254224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef48d4-15c9-415d-a99a-16742146df96 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:11.297159 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e1ab2-e6e0-41b0-b42f-1b462857df0d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:11.300226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3d2cf-96d7-47bd-aab8-e9d49d259a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:11.301954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3d2cf-96d7-47bd-aab8-e9d49d259a08 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:11.302239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3d2cf-96d7-47bd-aab8-e9d49d259a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:11.302514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3d2cf-96d7-47bd-aab8-e9d49d259a08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:11.303973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3d2cf-96d7-47bd-aab8-e9d49d259a08 None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=1947d85a08e944f3a1e7451ee7847b74) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:11.304285 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3d2cf-96d7-47bd-aab8-e9d49d259a08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:11.306337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3d2cf-96d7-47bd-aab8-e9d49d259a08 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:11.314268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 343/672] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:11 2022] GET /identity/v3/role_assignments?user.id=1947d85a08e944f3a1e7451ee7847b74&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:11.315274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3d2cf-96d7-47bd-aab8-e9d49d259a08 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:11.353634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87196e0-98de-4340-9a04-97e4f96ab9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:11.354737 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87196e0-98de-4340-9a04-97e4f96ab9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:11.355395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87196e0-98de-4340-9a04-97e4f96ab9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:11.355899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87196e0-98de-4340-9a04-97e4f96ab9c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:11.407442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:11.457837 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87196e0-98de-4340-9a04-97e4f96ab9c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:11.459856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87196e0-98de-4340-9a04-97e4f96ab9c2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:11.488324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3d2cf-96d7-47bd-aab8-e9d49d259a08 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:11.501094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:11.532683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5700490-0218-41ff-bc4e-737f62493289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:11.533352 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5700490-0218-41ff-bc4e-737f62493289 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:11.533652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5700490-0218-41ff-bc4e-737f62493289 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:11.533914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5700490-0218-41ff-bc4e-737f62493289 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:11.534632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5700490-0218-41ff-bc4e-737f62493289 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:11.534941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5700490-0218-41ff-bc4e-737f62493289 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:11.536394 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5700490-0218-41ff-bc4e-737f62493289 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:11.553710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 344/673] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:11.554750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5700490-0218-41ff-bc4e-737f62493289 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:11.607062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 330/674] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:17:11.608018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87196e0-98de-4340-9a04-97e4f96ab9c2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:11.705913 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5700490-0218-41ff-bc4e-737f62493289 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:11.719123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:11.738407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87196e0-98de-4340-9a04-97e4f96ab9c2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:11.758394 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b31b9-18ba-429a-be5b-e2d3fb75ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:11.759744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b31b9-18ba-429a-be5b-e2d3fb75ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:11.760408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b31b9-18ba-429a-be5b-e2d3fb75ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:11.760827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b31b9-18ba-429a-be5b-e2d3fb75ecb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:11.771445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:11.777030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b31b9-18ba-429a-be5b-e2d3fb75ecb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:11.779441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b31b9-18ba-429a-be5b-e2d3fb75ecb1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:11.790482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3604d4-8dcf-45a6-aff4-37a3ea28fc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:11.792063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3604d4-8dcf-45a6-aff4-37a3ea28fc50 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:11.792722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3604d4-8dcf-45a6-aff4-37a3ea28fc50 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:11.793135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3604d4-8dcf-45a6-aff4-37a3ea28fc50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:11.794076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3604d4-8dcf-45a6-aff4-37a3ea28fc50 None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=18a16e6246fb4693b044bf939bce8244) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:11.794493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3604d4-8dcf-45a6-aff4-37a3ea28fc50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:11.796368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3604d4-8dcf-45a6-aff4-37a3ea28fc50 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-8c6b31b9-18ba-429a-be5b-e2d3fb75ecb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:11.799542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:11.800677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:11.801605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:11.801605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:11.801605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:11.805304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 345/675] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:11.806415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b31b9-18ba-429a-be5b-e2d3fb75ecb1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:11.813917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 331/676] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:11 2022] GET /identity/v3/role_assignments?user.id=18a16e6246fb4693b044bf939bce8244&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:11.813917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3604d4-8dcf-45a6-aff4-37a3ea28fc50 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:12.020016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b31b9-18ba-429a-be5b-e2d3fb75ecb1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:12.045306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3604d4-8dcf-45a6-aff4-37a3ea28fc50 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:12.075873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf396e-15c6-4807-97bb-085892d82b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:12.076449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf396e-15c6-4807-97bb-085892d82b91 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:12.076731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf396e-15c6-4807-97bb-085892d82b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:12.077003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf396e-15c6-4807-97bb-085892d82b91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:12.087364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24de25d-d876-4690-ab9a-b1f5dcb9d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:12.088251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24de25d-d876-4690-ab9a-b1f5dcb9d2aa None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:12.088682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24de25d-d876-4690-ab9a-b1f5dcb9d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:12.089181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24de25d-d876-4690-ab9a-b1f5dcb9d2aa None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:12.090023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24de25d-d876-4690-ab9a-b1f5dcb9d2aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:12.090493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24de25d-d876-4690-ab9a-b1f5dcb9d2aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:12.092599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24de25d-d876-4690-ab9a-b1f5dcb9d2aa None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:12.104941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf396e-15c6-4807-97bb-085892d82b91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:12.107975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf396e-15c6-4807-97bb-085892d82b91 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:12.111335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 332/677] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:12.117317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24de25d-d876-4690-ab9a-b1f5dcb9d2aa None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-69cf396e-15c6-4807-97bb-085892d82b91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:12.138270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:12.139317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:12.140885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:12.140885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:12.140885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:12.140885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 346/678] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:12.147119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf396e-15c6-4807-97bb-085892d82b91 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:12.169180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:12.191007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:12.266794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24de25d-d876-4690-ab9a-b1f5dcb9d2aa None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:12.283278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf396e-15c6-4807-97bb-085892d82b91 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:12.313676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf408-8ca2-4e4b-b63c-ef763c999ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:12.315321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf408-8ca2-4e4b-b63c-ef763c999ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:12.315835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf408-8ca2-4e4b-b63c-ef763c999ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:12.316516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baf408-8ca2-4e4b-b63c-ef763c999ff4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:12.333393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baf408-8ca2-4e4b-b63c-ef763c999ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:12.333393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baf408-8ca2-4e4b-b63c-ef763c999ff4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:12.339183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93066d-f359-425b-8ac0-4210b57bb70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:12.339801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93066d-f359-425b-8ac0-4210b57bb70a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:12.340149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93066d-f359-425b-8ac0-4210b57bb70a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:12.340420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93066d-f359-425b-8ac0-4210b57bb70a None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:12.341066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93066d-f359-425b-8ac0-4210b57bb70a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:12.341361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93066d-f359-425b-8ac0-4210b57bb70a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:12.342870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93066d-f359-425b-8ac0-4210b57bb70a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f3baf408-8ca2-4e4b-b63c-ef763c999ff4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:12.345888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:12.346842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:12.347809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:12.347809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:12.347809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:12.347809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:12.347809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:12.347809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:12.347809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:12.347809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:12.347809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:17:12.347809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:12.351348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 333/679] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:17:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:12.356990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf408-8ca2-4e4b-b63c-ef763c999ff4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:12.358473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 347/680] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:12.364775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93066d-f359-425b-8ac0-4210b57bb70a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:12.461209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:12.516877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93066d-f359-425b-8ac0-4210b57bb70a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:12.591672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e88074-ae18-41f4-b8a2-4f0d36a56ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:12.592647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e88074-ae18-41f4-b8a2-4f0d36a56ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:12.593190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e88074-ae18-41f4-b8a2-4f0d36a56ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:12.593604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e88074-ae18-41f4-b8a2-4f0d36a56ea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:12.608691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e88074-ae18-41f4-b8a2-4f0d36a56ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:12.610245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e88074-ae18-41f4-b8a2-4f0d36a56ea7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:12.625901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baf408-8ca2-4e4b-b63c-ef763c999ff4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-87e88074-ae18-41f4-b8a2-4f0d36a56ea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:12.634756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:12.635796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:12.636704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:12.636704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:12.636704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:12.636704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:12.636704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:12.636704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:12.636704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:12.636704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:12.640821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 348/681] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:12.641755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:12.643151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e88074-ae18-41f4-b8a2-4f0d36a56ea7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:12.704985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115a620-ea59-4c8d-b070-3d75b8328046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:12.705612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115a620-ea59-4c8d-b070-3d75b8328046 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:12.705914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115a620-ea59-4c8d-b070-3d75b8328046 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:12.706186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115a620-ea59-4c8d-b070-3d75b8328046 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:12.706924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115a620-ea59-4c8d-b070-3d75b8328046 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:12.707226 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115a620-ea59-4c8d-b070-3d75b8328046 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:12.708637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115a620-ea59-4c8d-b070-3d75b8328046 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:12.751185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 334/682] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 1 16:17:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:12.763582 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115a620-ea59-4c8d-b070-3d75b8328046 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:12.766863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e88074-ae18-41f4-b8a2-4f0d36a56ea7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:12.809902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:12.827682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344587c3-9c3e-4fc3-bc1d-165c426297fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:12.828396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344587c3-9c3e-4fc3-bc1d-165c426297fd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:12.828665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344587c3-9c3e-4fc3-bc1d-165c426297fd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:12.828935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344587c3-9c3e-4fc3-bc1d-165c426297fd None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:12.832149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344587c3-9c3e-4fc3-bc1d-165c426297fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:12.832460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344587c3-9c3e-4fc3-bc1d-165c426297fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:12.838875 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344587c3-9c3e-4fc3-bc1d-165c426297fd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:12.873390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 349/683] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:12.879756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344587c3-9c3e-4fc3-bc1d-165c426297fd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:12.899555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115a620-ea59-4c8d-b070-3d75b8328046 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:12.950549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c650019-8517-4994-a780-2edcd2d971f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:12.951172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c650019-8517-4994-a780-2edcd2d971f9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:12.951564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c650019-8517-4994-a780-2edcd2d971f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:12.951894 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c650019-8517-4994-a780-2edcd2d971f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:13.025955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:13.148233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c650019-8517-4994-a780-2edcd2d971f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:13.149641 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c650019-8517-4994-a780-2edcd2d971f9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:13.166792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344587c3-9c3e-4fc3-bc1d-165c426297fd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:13.304433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed325f6a-8fd9-4df7-92f8-7f78af22f0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:13.305388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed325f6a-8fd9-4df7-92f8-7f78af22f0e6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:13.305818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed325f6a-8fd9-4df7-92f8-7f78af22f0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:13.306265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed325f6a-8fd9-4df7-92f8-7f78af22f0e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:13.307494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed325f6a-8fd9-4df7-92f8-7f78af22f0e6 None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=02432d1312a34273813856362cada1d6) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:13.307963 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed325f6a-8fd9-4df7-92f8-7f78af22f0e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:13.310254 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed325f6a-8fd9-4df7-92f8-7f78af22f0e6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:13.334938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 350/684] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:12 2022] GET /identity/v3/role_assignments?user.id=02432d1312a34273813856362cada1d6&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 608 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:13.405414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 335/685] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:17:13.410908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed325f6a-8fd9-4df7-92f8-7f78af22f0e6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:13.492098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:13.542318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed325f6a-8fd9-4df7-92f8-7f78af22f0e6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:13.580251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed829b-2a65-4cce-a14c-a1db2d2c5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:13.580948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed829b-2a65-4cce-a14c-a1db2d2c5bec None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:13.581227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed829b-2a65-4cce-a14c-a1db2d2c5bec None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:13.581495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed829b-2a65-4cce-a14c-a1db2d2c5bec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:13.593537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed829b-2a65-4cce-a14c-a1db2d2c5bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:13.595048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed829b-2a65-4cce-a14c-a1db2d2c5bec None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-e2ed829b-2a65-4cce-a14c-a1db2d2c5bec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:13.614717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:13.615827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:13.616744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:13.616744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:13.616744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:13.616744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 351/686] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:13.621631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c650019-8517-4994-a780-2edcd2d971f9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:13.666244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd00b-ed0c-499d-9286-3e6199382040 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:13.667037 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd00b-ed0c-499d-9286-3e6199382040 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:13.667639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebd00b-ed0c-499d-9286-3e6199382040 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:13.670314 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 352/687] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:13.675753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58b823-5b1c-499f-9d6f-06cb06ea81e8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:13.676162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58b823-5b1c-499f-9d6f-06cb06ea81e8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:13.676557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58b823-5b1c-499f-9d6f-06cb06ea81e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:13.707787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6d58b823-5b1c-499f-9d6f-06cb06ea81e8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:13.709674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6d58b823-5b1c-499f-9d6f-06cb06ea81e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:13.767411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:13.853405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c650019-8517-4994-a780-2edcd2d971f9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:13.866681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 353/688] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 16:17:13.893196 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6deb-817c-4c93-a9d0-08b5a6cbf5eb None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:13.893464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6deb-817c-4c93-a9d0-08b5a6cbf5eb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:13.893734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e6deb-817c-4c93-a9d0-08b5a6cbf5eb None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:13.895377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 354/689] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:13.899986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e7e5-d690-4377-9b00-b53a7a6cb492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:13.900611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e7e5-d690-4377-9b00-b53a7a6cb492 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:13.900892 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e7e5-d690-4377-9b00-b53a7a6cb492 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:13.901164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76e7e5-d690-4377-9b00-b53a7a6cb492 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:13.902106 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76e7e5-d690-4377-9b00-b53a7a6cb492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:13.902281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76e7e5-d690-4377-9b00-b53a7a6cb492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:13.904310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76e7e5-d690-4377-9b00-b53a7a6cb492 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:13.905217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389a247-fa23-4285-b525-50f1b85128ec None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:13.905498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389a247-fa23-4285-b525-50f1b85128ec None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:13.905770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389a247-fa23-4285-b525-50f1b85128ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:13.922400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 336/690] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:13.931118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e7e5-d690-4377-9b00-b53a7a6cb492 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:13.938082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c389a247-fa23-4285-b525-50f1b85128ec None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:13.942466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c389a247-fa23-4285-b525-50f1b85128ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:14.035312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:14.087262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76e7e5-d690-4377-9b00-b53a7a6cb492 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:14.114515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 355/691] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:14.158355 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:14.168281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b8030-e463-4df0-a1fe-cbfc2db32ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:14.173306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8030-e463-4df0-a1fe-cbfc2db32ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:14.173306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8030-e463-4df0-a1fe-cbfc2db32ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:14.173306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8030-e463-4df0-a1fe-cbfc2db32ec4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:14.185410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b8030-e463-4df0-a1fe-cbfc2db32ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:14.186878 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b8030-e463-4df0-a1fe-cbfc2db32ec4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:14.207296 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389a247-fa23-4285-b525-50f1b85128ec None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d69b8030-e463-4df0-a1fe-cbfc2db32ec4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:14.207964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:14.210969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:14.212618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:14.212618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:14.212618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:14.212618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:14.212618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:14.212618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:14.212618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:14.212618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:14.212618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 337/692] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:14.214693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b8030-e463-4df0-a1fe-cbfc2db32ec4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:14.437206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b8030-e463-4df0-a1fe-cbfc2db32ec4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:14.447723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389a247-fa23-4285-b525-50f1b85128ec None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:14.485968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe37f2-e16e-45b6-acc6-03ee12429847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:14.487282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe37f2-e16e-45b6-acc6-03ee12429847 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:14.487958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe37f2-e16e-45b6-acc6-03ee12429847 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:14.488429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe37f2-e16e-45b6-acc6-03ee12429847 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:14.489294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe37f2-e16e-45b6-acc6-03ee12429847 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:14.489862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe37f2-e16e-45b6-acc6-03ee12429847 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:14.492102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe37f2-e16e-45b6-acc6-03ee12429847 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:14.492619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c53d4-18aa-4607-9a8d-a9eb71fcde5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:14.493326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c53d4-18aa-4607-9a8d-a9eb71fcde5a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:14.493678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c53d4-18aa-4607-9a8d-a9eb71fcde5a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:14.494085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c53d4-18aa-4607-9a8d-a9eb71fcde5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:14.508884 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c53d4-18aa-4607-9a8d-a9eb71fcde5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:14.509418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 338/693] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:14.510548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe37f2-e16e-45b6-acc6-03ee12429847 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-e49c53d4-18aa-4607-9a8d-a9eb71fcde5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:14.515524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:14.516533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 356/694] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:17:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:14.517383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c53d4-18aa-4607-9a8d-a9eb71fcde5a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:14.550557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:14.576269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:14.651286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c53d4-18aa-4607-9a8d-a9eb71fcde5a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:14.652125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe37f2-e16e-45b6-acc6-03ee12429847 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:14.698897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c6c25-5009-416d-bf84-38d617c0d971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:14.699436 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c6c25-5009-416d-bf84-38d617c0d971 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:14.699718 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c6c25-5009-416d-bf84-38d617c0d971 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:14.699993 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c6c25-5009-416d-bf84-38d617c0d971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:14.700730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c6c25-5009-416d-bf84-38d617c0d971 None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=589e62c8d27044eea16e7c1f803e1393) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:14.701037 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c6c25-5009-416d-bf84-38d617c0d971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:14.702729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c6c25-5009-416d-bf84-38d617c0d971 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:14.704223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc49e7-d5b7-4951-affa-b88f879cee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:14.705431 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc49e7-d5b7-4951-affa-b88f879cee37 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:14.705963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc49e7-d5b7-4951-affa-b88f879cee37 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:14.707057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc49e7-d5b7-4951-affa-b88f879cee37 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:14.708134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc49e7-d5b7-4951-affa-b88f879cee37 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:14.710374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc49e7-d5b7-4951-affa-b88f879cee37 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:14.710657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 357/695] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:14 2022] GET /identity/v3/role_assignments?user.id=589e62c8d27044eea16e7c1f803e1393&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:14.711609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c6c25-5009-416d-bf84-38d617c0d971 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-16dc49e7-d5b7-4951-affa-b88f879cee37 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:14.726544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:14.727670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:17:14.728820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:14.731742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 339/696] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Sep 1 16:17:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:14.737582 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc49e7-d5b7-4951-affa-b88f879cee37 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:14.825452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:14.837195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c6c25-5009-416d-bf84-38d617c0d971 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:14.859007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc49e7-d5b7-4951-affa-b88f879cee37 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:14.871368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:14.880062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db680a-05c9-4fd1-a5bc-9591d0d8b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:14.880964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db680a-05c9-4fd1-a5bc-9591d0d8b8b5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:14.881282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db680a-05c9-4fd1-a5bc-9591d0d8b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:14.881623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db680a-05c9-4fd1-a5bc-9591d0d8b8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:14.882751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db680a-05c9-4fd1-a5bc-9591d0d8b8b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:14.883346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db680a-05c9-4fd1-a5bc-9591d0d8b8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:14.884918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db680a-05c9-4fd1-a5bc-9591d0d8b8b5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:14.895379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 358/697] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:14.897301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b23e-7547-4d8f-b1d7-6c209f894cd4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:14.897762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b23e-7547-4d8f-b1d7-6c209f894cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:14.898397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8b23e-7547-4d8f-b1d7-6c209f894cd4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:14.900280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 359/698] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:14.901247 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8b23e-7547-4d8f-b1d7-6c209f894cd4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:14.906076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a6ca0-026e-41fa-8dd3-eb09a50b005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:14.906925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6ca0-026e-41fa-8dd3-eb09a50b005b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:14.907347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6ca0-026e-41fa-8dd3-eb09a50b005b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:14.907773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a6ca0-026e-41fa-8dd3-eb09a50b005b None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:14.908561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a6ca0-026e-41fa-8dd3-eb09a50b005b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:14.909006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a6ca0-026e-41fa-8dd3-eb09a50b005b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:14.910552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a6ca0-026e-41fa-8dd3-eb09a50b005b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:14.916740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 340/699] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 1 16:17:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:14.922915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16cfa-135c-4478-a1df-054233559a92 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:14.923515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16cfa-135c-4478-a1df-054233559a92 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:14.923972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e16cfa-135c-4478-a1df-054233559a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:14.944586 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c2e16cfa-135c-4478-a1df-054233559a92 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:14.946290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c2e16cfa-135c-4478-a1df-054233559a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:15.026092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 341/700] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:15.026710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8b23e-7547-4d8f-b1d7-6c209f894cd4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:15.026878 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16cfa-135c-4478-a1df-054233559a92 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:15.074145 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc8858-b9d2-4af6-88cd-6f173f75d834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:15.075027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc8858-b9d2-4af6-88cd-6f173f75d834 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:15.075449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc8858-b9d2-4af6-88cd-6f173f75d834 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:15.075921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc8858-b9d2-4af6-88cd-6f173f75d834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:15.090609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc8858-b9d2-4af6-88cd-6f173f75d834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:15.092135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc8858-b9d2-4af6-88cd-6f173f75d834 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-83dc8858-b9d2-4af6-88cd-6f173f75d834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:15.110473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:15.111480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:15.112384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:15.112384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:15.112384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:15.114753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 360/701] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:15.120051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc8858-b9d2-4af6-88cd-6f173f75d834 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:15.130470 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:15.160622 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e16cfa-135c-4478-a1df-054233559a92 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:15.162886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:15.197773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572a7ad-b704-43ab-bd3c-d29095ae633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:15.198780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572a7ad-b704-43ab-bd3c-d29095ae633f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:15.199258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572a7ad-b704-43ab-bd3c-d29095ae633f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:15.199725 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572a7ad-b704-43ab-bd3c-d29095ae633f None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:15.200671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572a7ad-b704-43ab-bd3c-d29095ae633f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:15.201241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572a7ad-b704-43ab-bd3c-d29095ae633f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:15.202810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d572a7ad-b704-43ab-bd3c-d29095ae633f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:15.209243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 342/702] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 1 16:17:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:15.322926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc8858-b9d2-4af6-88cd-6f173f75d834 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:15.362514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5c1b-d746-4f2e-a1f4-235fdb092194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:15.363134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5c1b-d746-4f2e-a1f4-235fdb092194 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:15.363429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5c1b-d746-4f2e-a1f4-235fdb092194 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:15.363690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5c1b-d746-4f2e-a1f4-235fdb092194 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:15.364341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5c1b-d746-4f2e-a1f4-235fdb092194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:15.364645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5c1b-d746-4f2e-a1f4-235fdb092194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:15.367120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5c1b-d746-4f2e-a1f4-235fdb092194 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:15.380343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 361/703] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:15.385515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572a7ad-b704-43ab-bd3c-d29095ae633f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:15.414583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5c1b-d746-4f2e-a1f4-235fdb092194 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:15.500091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:15.515797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572a7ad-b704-43ab-bd3c-d29095ae633f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:15.538994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5c1b-d746-4f2e-a1f4-235fdb092194 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:15.554892 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11c13a-7837-49e6-ae1a-202d0b0b813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:15.555951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c13a-7837-49e6-ae1a-202d0b0b813e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:15.556519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c13a-7837-49e6-ae1a-202d0b0b813e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:15.557000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11c13a-7837-49e6-ae1a-202d0b0b813e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:15.574612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11c13a-7837-49e6-ae1a-202d0b0b813e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:15.576589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11c13a-7837-49e6-ae1a-202d0b0b813e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:15.581490 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db747ebf-6dcb-407d-937a-60bebd616b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:15.581490 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db747ebf-6dcb-407d-937a-60bebd616b61 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:15.581490 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db747ebf-6dcb-407d-937a-60bebd616b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:15.581490 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db747ebf-6dcb-407d-937a-60bebd616b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:15.591178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db747ebf-6dcb-407d-937a-60bebd616b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:15.592636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db747ebf-6dcb-407d-937a-60bebd616b61 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-eb11c13a-7837-49e6-ae1a-202d0b0b813e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:15.599041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:15.600039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:15.601202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:15.601202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:15.601202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:15.601202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:15.601202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:15.601202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:15.601202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:15.601202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:15.601202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:15.601202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:15.601202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 343/704] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 1 16:17:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:15.606577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11c13a-7837-49e6-ae1a-202d0b0b813e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-db747ebf-6dcb-407d-937a-60bebd616b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:15.609147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:15.610117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:15.611633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:15.611633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:15.611633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:15.611633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 362/705] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:15.618320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db747ebf-6dcb-407d-937a-60bebd616b61 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:15.681360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:15.795822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db747ebf-6dcb-407d-937a-60bebd616b61 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:15.829226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:15.850383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108a093-9ea2-4354-8d2e-da53147da7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:15.851588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108a093-9ea2-4354-8d2e-da53147da7ad None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:15.851867 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108a093-9ea2-4354-8d2e-da53147da7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:15.852135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108a093-9ea2-4354-8d2e-da53147da7ad None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:15.852788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108a093-9ea2-4354-8d2e-da53147da7ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:15.853343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108a093-9ea2-4354-8d2e-da53147da7ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:15.854865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108a093-9ea2-4354-8d2e-da53147da7ad None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:15.870672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 363/706] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:15.876773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108a093-9ea2-4354-8d2e-da53147da7ad None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:15.888062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11c13a-7837-49e6-ae1a-202d0b0b813e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:15.968897 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829684e9-5248-4e23-b3b3-0c76d31a2ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:15.969520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829684e9-5248-4e23-b3b3-0c76d31a2ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:15.969798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829684e9-5248-4e23-b3b3-0c76d31a2ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:15.970197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829684e9-5248-4e23-b3b3-0c76d31a2ae0 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:15.970984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829684e9-5248-4e23-b3b3-0c76d31a2ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:15.971289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829684e9-5248-4e23-b3b3-0c76d31a2ae0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:15.972871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829684e9-5248-4e23-b3b3-0c76d31a2ae0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:16.002285 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108a093-9ea2-4354-8d2e-da53147da7ad None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:16.004850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 344/707] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 1 16:17:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:16.007531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d2fdf-1097-4586-8219-5e79a3da18f8 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:16.007814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d2fdf-1097-4586-8219-5e79a3da18f8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:16.008084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d2fdf-1097-4586-8219-5e79a3da18f8 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:16.014124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 345/708] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:16.015081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d2fdf-1097-4586-8219-5e79a3da18f8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:16.050365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04f477-f4dd-477b-999e-be1bba06ba33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:16.050974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f477-f4dd-477b-999e-be1bba06ba33 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:16.051250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f477-f4dd-477b-999e-be1bba06ba33 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:16.051519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04f477-f4dd-477b-999e-be1bba06ba33 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:16.052159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04f477-f4dd-477b-999e-be1bba06ba33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:16.054007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04f477-f4dd-477b-999e-be1bba06ba33 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:16.121418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:16.150089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d2fdf-1097-4586-8219-5e79a3da18f8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:16.174356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 364/709] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:17:15 2022] POST /identity/v3/users => generated 254 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:16.178430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b366-dcb8-42fa-82d2-edd5a76ca7c1 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:16.179083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b366-dcb8-42fa-82d2-edd5a76ca7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:16.179406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0b366-dcb8-42fa-82d2-edd5a76ca7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:16.218291 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-fec0b366-dcb8-42fa-82d2-edd5a76ca7c1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:16.220531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef548c0-cbce-4b9d-8a65-ac5e516264ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:16.221167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef548c0-cbce-4b9d-8a65-ac5e516264ba None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:16.221580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef548c0-cbce-4b9d-8a65-ac5e516264ba None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:16.221858 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef548c0-cbce-4b9d-8a65-ac5e516264ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:16.223554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fec0b366-dcb8-42fa-82d2-edd5a76ca7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:16.288351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:16.375449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 365/710] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:16.378747 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef548c0-cbce-4b9d-8a65-ac5e516264ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:16.380213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef548c0-cbce-4b9d-8a65-ac5e516264ba None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:16.481603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:16.505110 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 346/711] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:17:16.511170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0b366-dcb8-42fa-82d2-edd5a76ca7c1 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:16.627477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0b366-dcb8-42fa-82d2-edd5a76ca7c1 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:16.667524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cbb14-8f5d-4996-9391-75ed5a34c4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:16.668413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cbb14-8f5d-4996-9391-75ed5a34c4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:16.668835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cbb14-8f5d-4996-9391-75ed5a34c4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:16.669245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cbb14-8f5d-4996-9391-75ed5a34c4b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:16.680817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cbb14-8f5d-4996-9391-75ed5a34c4b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:16.682573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cbb14-8f5d-4996-9391-75ed5a34c4b7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f78cbb14-8f5d-4996-9391-75ed5a34c4b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:16.699529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:16.700754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:16.701816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:16.701816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:16.701816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:16.702032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef548c0-cbce-4b9d-8a65-ac5e516264ba None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:16.702842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 366/712] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:16.709479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cbb14-8f5d-4996-9391-75ed5a34c4b7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:16.742205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:16.886803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cbb14-8f5d-4996-9391-75ed5a34c4b7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:16.924704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6a7a2-5f4f-4f4d-baee-f45bec540afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:16.925763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6a7a2-5f4f-4f4d-baee-f45bec540afb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:16.926237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6a7a2-5f4f-4f4d-baee-f45bec540afb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:16.926726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6a7a2-5f4f-4f4d-baee-f45bec540afb None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:16.927544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6a7a2-5f4f-4f4d-baee-f45bec540afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:16.928140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6a7a2-5f4f-4f4d-baee-f45bec540afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:16.929922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6a7a2-5f4f-4f4d-baee-f45bec540afb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:16.938062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef548c0-cbce-4b9d-8a65-ac5e516264ba None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:16.944709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 367/713] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:16.950339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6a7a2-5f4f-4f4d-baee-f45bec540afb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:16.997228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ead6-35d1-4606-8b4f-cfbc43837170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:16.998271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ead6-35d1-4606-8b4f-cfbc43837170 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:16.998787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ead6-35d1-4606-8b4f-cfbc43837170 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:16.999504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085ead6-35d1-4606-8b4f-cfbc43837170 None admin] PATH_INFO: `/v3/services/network` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:17.000279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ead6-35d1-4606-8b4f-cfbc43837170 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:17.002055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085ead6-35d1-4606-8b4f-cfbc43837170 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-3085ead6-35d1-4606-8b4f-cfbc43837170 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:17.013483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:17.014607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:17:17.015454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:17.018563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 347/714] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:16 2022] GET /identity/v3/services/network => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:17.029573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ead6-35d1-4606-8b4f-cfbc43837170 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:17.092988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:17.120444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6a7a2-5f4f-4f4d-baee-f45bec540afb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:17.140325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:17.174857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85cde9-f3dc-4bee-bd0b-8d2f405941a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:17.175505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85cde9-f3dc-4bee-bd0b-8d2f405941a1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:17.175827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85cde9-f3dc-4bee-bd0b-8d2f405941a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:17.176098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85cde9-f3dc-4bee-bd0b-8d2f405941a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:17.192039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85cde9-f3dc-4bee-bd0b-8d2f405941a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:17.193527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85cde9-f3dc-4bee-bd0b-8d2f405941a1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4c85cde9-f3dc-4bee-bd0b-8d2f405941a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:17.211257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:17.212226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:17.213122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:17.213122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:17.213122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:17.213122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:17.213122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:17.213122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:17.213122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:17.213122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:17.217140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 368/715] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:17.218499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebae83a-21f0-4720-92ba-b60fccc4001d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:17.218805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebae83a-21f0-4720-92ba-b60fccc4001d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:17.219056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebae83a-21f0-4720-92ba-b60fccc4001d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:17.225175 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 369/716] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:17.226506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebae83a-21f0-4720-92ba-b60fccc4001d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:17.233596 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085ead6-35d1-4606-8b4f-cfbc43837170 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:17.279252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5784bd-9dc6-455d-b082-efcdde2a7d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:17.280448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5784bd-9dc6-455d-b082-efcdde2a7d62 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:17.280920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5784bd-9dc6-455d-b082-efcdde2a7d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:17.281363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5784bd-9dc6-455d-b082-efcdde2a7d62 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:17.282282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5784bd-9dc6-455d-b082-efcdde2a7d62 None admin] RBAC: Adding query filter params (name=network) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:17.283343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5784bd-9dc6-455d-b082-efcdde2a7d62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:17.285320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5784bd-9dc6-455d-b082-efcdde2a7d62 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:17.292206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 348/717] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:17.293663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c233-1704-404a-a2be-54ba791861c1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:17.294153 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c233-1704-404a-a2be-54ba791861c1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:17.294600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301c233-1704-404a-a2be-54ba791861c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:17.318001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3301c233-1704-404a-a2be-54ba791861c1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:17.320012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3301c233-1704-404a-a2be-54ba791861c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:17.353306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebae83a-21f0-4720-92ba-b60fccc4001d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:17.392619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b47e-4a5d-4218-b38e-8afa36ecdbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:17.393990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b47e-4a5d-4218-b38e-8afa36ecdbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:17.394443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b47e-4a5d-4218-b38e-8afa36ecdbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:17.395007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4b47e-4a5d-4218-b38e-8afa36ecdbd7 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:17.395988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4b47e-4a5d-4218-b38e-8afa36ecdbd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:17.397094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4b47e-4a5d-4218-b38e-8afa36ecdbd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:17.398871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4b47e-4a5d-4218-b38e-8afa36ecdbd7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:17.402596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:17.413971 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 349/718] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:17.418086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301c233-1704-404a-a2be-54ba791861c1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:17.421203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 370/719] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:17.427010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b47e-4a5d-4218-b38e-8afa36ecdbd7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:17.508056 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:17.639946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301c233-1704-404a-a2be-54ba791861c1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:17.641866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4b47e-4a5d-4218-b38e-8afa36ecdbd7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:17.685132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c57c69-0735-4cd4-82d6-f72c3ee8d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:17.685467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0270c-996b-4f03-aba2-9af047bde61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:17.685929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c57c69-0735-4cd4-82d6-f72c3ee8d2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:17.686279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c57c69-0735-4cd4-82d6-f72c3ee8d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:17.686621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c57c69-0735-4cd4-82d6-f72c3ee8d2f7 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:17.686735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0270c-996b-4f03-aba2-9af047bde61d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:17.687138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0270c-996b-4f03-aba2-9af047bde61d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:17.687438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c57c69-0735-4cd4-82d6-f72c3ee8d2f7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:17.687722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0270c-996b-4f03-aba2-9af047bde61d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:17.687843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c57c69-0735-4cd4-82d6-f72c3ee8d2f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:17.688765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0270c-996b-4f03-aba2-9af047bde61d None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=060b6347b13b4f67bf47169f5668b205) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:17.689228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0270c-996b-4f03-aba2-9af047bde61d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:17.689404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c57c69-0735-4cd4-82d6-f72c3ee8d2f7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:17.691135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0270c-996b-4f03-aba2-9af047bde61d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:17.695168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 350/720] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:17.696238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d785a0f-1a85-4477-99a4-71b380c369f1 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:17.696562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d785a0f-1a85-4477-99a4-71b380c369f1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:17.696892 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d785a0f-1a85-4477-99a4-71b380c369f1 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:17.698567 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 351/721] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:17.699370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 371/722] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:17 2022] GET /identity/v3/role_assignments?user.id=060b6347b13b4f67bf47169f5668b205&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:17.704031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2ed7d-6274-4a7e-938a-97808ca9cc1e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:17.704542 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2ed7d-6274-4a7e-938a-97808ca9cc1e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:17.704619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2ed7d-6274-4a7e-938a-97808ca9cc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:17.725211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-63c2ed7d-6274-4a7e-938a-97808ca9cc1e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:17.727320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-63c2ed7d-6274-4a7e-938a-97808ca9cc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:17.787062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0270c-996b-4f03-aba2-9af047bde61d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:17.808326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 352/723] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:17.871748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:17.924814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0270c-996b-4f03-aba2-9af047bde61d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:17.968926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55c9bf-8338-4eda-8228-ee854f147c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:17.970402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c9bf-8338-4eda-8228-ee854f147c67 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:17.971180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c9bf-8338-4eda-8228-ee854f147c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:17.971968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55c9bf-8338-4eda-8228-ee854f147c67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:17.986454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55c9bf-8338-4eda-8228-ee854f147c67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-cc55c9bf-8338-4eda-8228-ee854f147c67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:17.993162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:17.994222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:17.995114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:17.997845 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 372/724] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:18.004065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2ed7d-6274-4a7e-938a-97808ca9cc1e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:18.047043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:18.127569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2ed7d-6274-4a7e-938a-97808ca9cc1e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:18.177870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991f998-ed30-450c-a615-f00ae22611b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:18.178589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991f998-ed30-450c-a615-f00ae22611b9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:18.178880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991f998-ed30-450c-a615-f00ae22611b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:18.179160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991f998-ed30-450c-a615-f00ae22611b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:18.179842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991f998-ed30-450c-a615-f00ae22611b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:18.180145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991f998-ed30-450c-a615-f00ae22611b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:18.181507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991f998-ed30-450c-a615-f00ae22611b9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:18.194803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 353/725] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:17:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:18.199124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55c9bf-8338-4eda-8228-ee854f147c67 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:18.216724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991f998-ed30-450c-a615-f00ae22611b9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:18.324858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55c9bf-8338-4eda-8228-ee854f147c67 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:18.347057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:18.368821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd845bd1-d528-4d40-aa83-8a8d29236556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:18.369444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd845bd1-d528-4d40-aa83-8a8d29236556 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:18.369724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd845bd1-d528-4d40-aa83-8a8d29236556 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:18.370095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd845bd1-d528-4d40-aa83-8a8d29236556 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:18.370776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd845bd1-d528-4d40-aa83-8a8d29236556 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:18.372153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd845bd1-d528-4d40-aa83-8a8d29236556 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:18.401381 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991f998-ed30-450c-a615-f00ae22611b9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:18.414563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:18.438329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633c6cd-5d2b-4728-be2d-3d90806bc459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:18.438968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633c6cd-5d2b-4728-be2d-3d90806bc459 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:18.439249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633c6cd-5d2b-4728-be2d-3d90806bc459 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:18.439524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633c6cd-5d2b-4728-be2d-3d90806bc459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:18.450922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633c6cd-5d2b-4728-be2d-3d90806bc459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:18.452506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d633c6cd-5d2b-4728-be2d-3d90806bc459 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d633c6cd-5d2b-4728-be2d-3d90806bc459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:18.468745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:18.469757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:18.470775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:18.470775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:18.470775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:18.470775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 354/726] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:18.485151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633c6cd-5d2b-4728-be2d-3d90806bc459 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:18.486929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 373/727] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:17:18 2022] POST /identity/v3/services => generated 251 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:18.638478 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633c6cd-5d2b-4728-be2d-3d90806bc459 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:18.699022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f22c38-8b2b-4da1-880c-d873b8fcaf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:18.699651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f22c38-8b2b-4da1-880c-d873b8fcaf34 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:18.699927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f22c38-8b2b-4da1-880c-d873b8fcaf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:18.700198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f22c38-8b2b-4da1-880c-d873b8fcaf34 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:18.700848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f22c38-8b2b-4da1-880c-d873b8fcaf34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:18.701151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f22c38-8b2b-4da1-880c-d873b8fcaf34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:18.702558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f22c38-8b2b-4da1-880c-d873b8fcaf34 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:18.719874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 355/728] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:18.725850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd845bd1-d528-4d40-aa83-8a8d29236556 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:18.841945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5291c9f-5cce-4e34-b56d-c7f486a4ba7b None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:18.842271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5291c9f-5cce-4e34-b56d-c7f486a4ba7b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:18.842509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5291c9f-5cce-4e34-b56d-c7f486a4ba7b None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:18.843414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd845bd1-d528-4d40-aa83-8a8d29236556 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:18.844399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 356/729] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:18.850882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22f131-cc4c-4a4a-8708-b721d78c039f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:18.851171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22f131-cc4c-4a4a-8708-b721d78c039f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:18.851432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a22f131-cc4c-4a4a-8708-b721d78c039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:18.870576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3a22f131-cc4c-4a4a-8708-b721d78c039f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:18.871779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3a22f131-cc4c-4a4a-8708-b721d78c039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:18.881694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146813a-3376-4529-b3b6-ba5145253105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:18.882349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:18.882711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146813a-3376-4529-b3b6-ba5145253105 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:18.883050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146813a-3376-4529-b3b6-ba5145253105 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:18.883336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146813a-3376-4529-b3b6-ba5145253105 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:18.891826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146813a-3376-4529-b3b6-ba5145253105 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:18.893332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146813a-3376-4529-b3b6-ba5145253105 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1146813a-3376-4529-b3b6-ba5145253105 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:18.906987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:18.918691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 374/730] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:17:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:18.920891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146813a-3376-4529-b3b6-ba5145253105 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:18.948576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 357/731] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:18.960701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:19.026315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146813a-3376-4529-b3b6-ba5145253105 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:19.063400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494031-fa5e-4b85-8d7a-5c8262aeb893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:19.064073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494031-fa5e-4b85-8d7a-5c8262aeb893 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:19.064357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494031-fa5e-4b85-8d7a-5c8262aeb893 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:19.064627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494031-fa5e-4b85-8d7a-5c8262aeb893 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:19.065357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3494031-fa5e-4b85-8d7a-5c8262aeb893 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:19.065659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3494031-fa5e-4b85-8d7a-5c8262aeb893 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:19.067136 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3494031-fa5e-4b85-8d7a-5c8262aeb893 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:19.087876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 375/732] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 1 16:17:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:19.093445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22f131-cc4c-4a4a-8708-b721d78c039f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:19.201844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a22f131-cc4c-4a4a-8708-b721d78c039f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:19.239461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5961-afc4-47ad-aa7c-28e3a9ddaca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:19.240187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5961-afc4-47ad-aa7c-28e3a9ddaca1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:19.240470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5961-afc4-47ad-aa7c-28e3a9ddaca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:19.240744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a5961-afc4-47ad-aa7c-28e3a9ddaca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:19.245588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:19.283288 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494031-fa5e-4b85-8d7a-5c8262aeb893 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:19.384309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a5961-afc4-47ad-aa7c-28e3a9ddaca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:19.386206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a5961-afc4-47ad-aa7c-28e3a9ddaca1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:19.489904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:19.495240 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494031-fa5e-4b85-8d7a-5c8262aeb893 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:19.583332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb96e15-ff7d-483a-a48a-42eef12cdd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:19.584178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb96e15-ff7d-483a-a48a-42eef12cdd1c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:19.584581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb96e15-ff7d-483a-a48a-42eef12cdd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:19.584857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb96e15-ff7d-483a-a48a-42eef12cdd1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:19.612821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 358/733] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:19 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 16:17:19.617901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5961-afc4-47ad-aa7c-28e3a9ddaca1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:19.622360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb96e15-ff7d-483a-a48a-42eef12cdd1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ceb96e15-ff7d-483a-a48a-42eef12cdd1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:19.627360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:19.628406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:19.629448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:19.634058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 376/734] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:19.651571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb96e15-ff7d-483a-a48a-42eef12cdd1c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:19.670394 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:19.750869 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a5961-afc4-47ad-aa7c-28e3a9ddaca1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:19.789367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f1508-8356-41c3-98c8-fb0020afe12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:19.790043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f1508-8356-41c3-98c8-fb0020afe12b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:19.790512 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f1508-8356-41c3-98c8-fb0020afe12b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:19.790796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f1508-8356-41c3-98c8-fb0020afe12b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:19.802962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f1508-8356-41c3-98c8-fb0020afe12b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:19.804569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f1508-8356-41c3-98c8-fb0020afe12b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-800f1508-8356-41c3-98c8-fb0020afe12b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:19.822946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:19.823988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:19.824983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:19.824983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:19.824983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:19.824983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 359/735] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:19.830238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f1508-8356-41c3-98c8-fb0020afe12b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:19.941117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:19.954875 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f1508-8356-41c3-98c8-fb0020afe12b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:19.960515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb96e15-ff7d-483a-a48a-42eef12cdd1c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:19.997044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751cc0f-2b55-4aa8-80a9-2392b1aa5d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:19.998075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751cc0f-2b55-4aa8-80a9-2392b1aa5d70 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:19.998459 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751cc0f-2b55-4aa8-80a9-2392b1aa5d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:19.998828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751cc0f-2b55-4aa8-80a9-2392b1aa5d70 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:19.999592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751cc0f-2b55-4aa8-80a9-2392b1aa5d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:19.999991 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751cc0f-2b55-4aa8-80a9-2392b1aa5d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:20.001764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751cc0f-2b55-4aa8-80a9-2392b1aa5d70 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:20.015782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 360/736] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:20.022054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751cc0f-2b55-4aa8-80a9-2392b1aa5d70 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:20.055632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d98e73-12d7-4eaf-a277-2e5d9ab5432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:20.056713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98e73-12d7-4eaf-a277-2e5d9ab5432a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:20.057153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98e73-12d7-4eaf-a277-2e5d9ab5432a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:20.057557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98e73-12d7-4eaf-a277-2e5d9ab5432a None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:20.058447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d98e73-12d7-4eaf-a277-2e5d9ab5432a None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:20.058909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d98e73-12d7-4eaf-a277-2e5d9ab5432a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:20.060466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d98e73-12d7-4eaf-a277-2e5d9ab5432a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:20.082272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 377/737] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:17:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:20.094095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d98e73-12d7-4eaf-a277-2e5d9ab5432a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:20.153815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:20.196273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751cc0f-2b55-4aa8-80a9-2392b1aa5d70 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:20.258761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d98e73-12d7-4eaf-a277-2e5d9ab5432a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:20.266418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbf977-4ac8-492e-9caf-56e35eb07347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:20.267066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf977-4ac8-492e-9caf-56e35eb07347 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:20.267373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf977-4ac8-492e-9caf-56e35eb07347 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:20.267649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbf977-4ac8-492e-9caf-56e35eb07347 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:20.275749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf977-4ac8-492e-9caf-56e35eb07347 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:20.277192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbf977-4ac8-492e-9caf-56e35eb07347 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-dbcbf977-4ac8-492e-9caf-56e35eb07347 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:20.289960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:20.296636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:20.297556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:20.297556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:20.297556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:20.297556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:20.297556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:20.297556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:20.297556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:20.297556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:20.297556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 361/738] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:20.297556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03940c68-29c3-4e2a-a4e8-5d367fab9612 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:20.297556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03940c68-29c3-4e2a-a4e8-5d367fab9612 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:20.299088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03940c68-29c3-4e2a-a4e8-5d367fab9612 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:20.299088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 362/739] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:20.299088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72381184-7222-4cee-8fe6-e6fa8fbe5852 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:20.299088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72381184-7222-4cee-8fe6-e6fa8fbe5852 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:20.299088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72381184-7222-4cee-8fe6-e6fa8fbe5852 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:20.301686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 363/740] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:20.302487 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72381184-7222-4cee-8fe6-e6fa8fbe5852 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:20.304314 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248074b-c1c3-400f-b0eb-554f0fff98fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:20.305037 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248074b-c1c3-400f-b0eb-554f0fff98fa None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:20.305393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248074b-c1c3-400f-b0eb-554f0fff98fa None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:20.305897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248074b-c1c3-400f-b0eb-554f0fff98fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:20.315779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:20.317399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248074b-c1c3-400f-b0eb-554f0fff98fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:20.319934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248074b-c1c3-400f-b0eb-554f0fff98fa None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4248074b-c1c3-400f-b0eb-554f0fff98fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:20.336331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:20.337523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:20.338569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:20.338569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:20.338569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:20.338569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 378/741] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:20.338798 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d0f10-219f-49da-8940-6700f1b34af6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:20.338912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d0f10-219f-49da-8940-6700f1b34af6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:20.339186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d0f10-219f-49da-8940-6700f1b34af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:20.359236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-452d0f10-219f-49da-8940-6700f1b34af6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:20.360434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-452d0f10-219f-49da-8940-6700f1b34af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:20.425644 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72381184-7222-4cee-8fe6-e6fa8fbe5852 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:20.442223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 379/742] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:20.444394 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63092912-d316-472b-87ff-a2a2730348f7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:20.444678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63092912-d316-472b-87ff-a2a2730348f7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:20.444972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63092912-d316-472b-87ff-a2a2730348f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:20.451468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:20.466293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-63092912-d316-472b-87ff-a2a2730348f7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:20.467473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592cec5-e9de-4494-bba6-4d59689d93a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:20.467636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-63092912-d316-472b-87ff-a2a2730348f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:20.468446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592cec5-e9de-4494-bba6-4d59689d93a2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:20.468982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592cec5-e9de-4494-bba6-4d59689d93a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:20.469455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592cec5-e9de-4494-bba6-4d59689d93a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:20.470447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592cec5-e9de-4494-bba6-4d59689d93a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:20.470988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592cec5-e9de-4494-bba6-4d59689d93a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:20.472651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592cec5-e9de-4494-bba6-4d59689d93a2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:20.487181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 364/743] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:20.488418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592cec5-e9de-4494-bba6-4d59689d93a2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:20.556730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 380/744] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 16:17:20.556730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63092912-d316-472b-87ff-a2a2730348f7 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:20.574410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:20.615834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592cec5-e9de-4494-bba6-4d59689d93a2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:20.661210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a0c55-bb99-4d3b-9abb-3a9b3e518653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:20.662312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a0c55-bb99-4d3b-9abb-3a9b3e518653 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:20.662983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a0c55-bb99-4d3b-9abb-3a9b3e518653 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:20.663467 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a0c55-bb99-4d3b-9abb-3a9b3e518653 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:20.664509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a0c55-bb99-4d3b-9abb-3a9b3e518653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:20.665913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a0c55-bb99-4d3b-9abb-3a9b3e518653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:20.668027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a0c55-bb99-4d3b-9abb-3a9b3e518653 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:20.691539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 365/745] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:20.695627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a0c55-bb99-4d3b-9abb-3a9b3e518653 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:20.742305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63092912-d316-472b-87ff-a2a2730348f7 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:20.776620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:20.784553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2bed-bef5-4841-a8c1-d5deeeb98fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:20.791388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2bed-bef5-4841-a8c1-d5deeeb98fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:20.791388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2bed-bef5-4841-a8c1-d5deeeb98fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:20.791388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2bed-bef5-4841-a8c1-d5deeeb98fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:20.791388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a2bed-bef5-4841-a8c1-d5deeeb98fb6 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=589e62c8d27044eea16e7c1f803e1393) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:20.791388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a2bed-bef5-4841-a8c1-d5deeeb98fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:20.791388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a2bed-bef5-4841-a8c1-d5deeeb98fb6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:20.797619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 381/746] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:20 2022] GET /identity/v3/role_assignments?user.id=589e62c8d27044eea16e7c1f803e1393&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:20.798865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2bed-bef5-4841-a8c1-d5deeeb98fb6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:20.820938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a0c55-bb99-4d3b-9abb-3a9b3e518653 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:20.862914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:20.873320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a1567-6b70-4c44-9f66-c1cbc36de608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:20.881010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a1567-6b70-4c44-9f66-c1cbc36de608 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:20.881010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a1567-6b70-4c44-9f66-c1cbc36de608 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:20.881010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a1567-6b70-4c44-9f66-c1cbc36de608 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:20.892547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a1567-6b70-4c44-9f66-c1cbc36de608 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:20.894199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a1567-6b70-4c44-9f66-c1cbc36de608 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-3c6a1567-6b70-4c44-9f66-c1cbc36de608 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:20.929460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:20.930548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:20.932095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:20.932095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:20.932095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:20.932095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:20.932095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:20.932095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:20.932095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:20.932095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:20.932095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:20.932095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:20.932095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 366/747] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 1 16:17:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:20.938262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a1567-6b70-4c44-9f66-c1cbc36de608 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:20.989777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2bed-bef5-4841-a8c1-d5deeeb98fb6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:21.038368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb4eb3-d9b0-4378-863d-83219451f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:21.040228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb4eb3-d9b0-4378-863d-83219451f987 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:21.040520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb4eb3-d9b0-4378-863d-83219451f987 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:21.040798 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb4eb3-d9b0-4378-863d-83219451f987 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:21.055395 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb4eb3-d9b0-4378-863d-83219451f987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f3bb4eb3-d9b0-4378-863d-83219451f987 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:21.062714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:21.063881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 382/748] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:21.064941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb4eb3-d9b0-4378-863d-83219451f987 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:21.094050 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a1567-6b70-4c44-9f66-c1cbc36de608 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:21.132806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaab1e-34a0-49f1-8059-a9d0259a56b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:21.133683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaab1e-34a0-49f1-8059-a9d0259a56b7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:21.134254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaab1e-34a0-49f1-8059-a9d0259a56b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:21.134533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eaab1e-34a0-49f1-8059-a9d0259a56b7 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:21.135300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaab1e-34a0-49f1-8059-a9d0259a56b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:21.135609 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaab1e-34a0-49f1-8059-a9d0259a56b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:21.137041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eaab1e-34a0-49f1-8059-a9d0259a56b7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:21.137493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:21.158229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 367/749] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 1 16:17:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:21.158229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaab1e-34a0-49f1-8059-a9d0259a56b7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:21.188001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb4eb3-d9b0-4378-863d-83219451f987 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:21.210346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:21.227234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb3f5b-7052-493a-a581-714f4d55b80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:21.227846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb3f5b-7052-493a-a581-714f4d55b80a None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:21.228390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb3f5b-7052-493a-a581-714f4d55b80a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:21.228661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb3f5b-7052-493a-a581-714f4d55b80a None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:21.229307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb3f5b-7052-493a-a581-714f4d55b80a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:21.230706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb3f5b-7052-493a-a581-714f4d55b80a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:21.263829 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eaab1e-34a0-49f1-8059-a9d0259a56b7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:21.298666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc47a9-078b-4548-b9fd-c254dba73cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:21.299277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc47a9-078b-4548-b9fd-c254dba73cef None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:21.301331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc47a9-078b-4548-b9fd-c254dba73cef None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:21.301331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc47a9-078b-4548-b9fd-c254dba73cef None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:21.301331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc47a9-078b-4548-b9fd-c254dba73cef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:21.301331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc47a9-078b-4548-b9fd-c254dba73cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:21.302141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc47a9-078b-4548-b9fd-c254dba73cef None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:21.307937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 383/750] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:17:21 2022] POST /identity/v3/services => generated 240 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:21.307937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8f0fd-4599-4726-a007-a0eaf45e18e4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:21.307937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8f0fd-4599-4726-a007-a0eaf45e18e4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:21.307937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8f0fd-4599-4726-a007-a0eaf45e18e4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:21.307937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 384/751] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:21.311723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8f0fd-4599-4726-a007-a0eaf45e18e4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:21.320477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 368/752] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:17:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:21.322145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8d9c2-f1ea-458b-bfdd-35a33e437797 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:21.322525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8d9c2-f1ea-458b-bfdd-35a33e437797 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:21.322730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8d9c2-f1ea-458b-bfdd-35a33e437797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:21.405602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-75f8d9c2-f1ea-458b-bfdd-35a33e437797 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:21.407340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-75f8d9c2-f1ea-458b-bfdd-35a33e437797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:21.509426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 369/753] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:21.510383 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8d9c2-f1ea-458b-bfdd-35a33e437797 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:21.512338 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8f0fd-4599-4726-a007-a0eaf45e18e4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:21.536177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:21.554263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:21.566649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906ff5f-539e-44f9-84f5-70eccc5c5227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:21.567851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ff5f-539e-44f9-84f5-70eccc5c5227 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:21.568357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ff5f-539e-44f9-84f5-70eccc5c5227 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:21.569645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906ff5f-539e-44f9-84f5-70eccc5c5227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:21.652091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8d9c2-f1ea-458b-bfdd-35a33e437797 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:21.670388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906ff5f-539e-44f9-84f5-70eccc5c5227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:21.670388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906ff5f-539e-44f9-84f5-70eccc5c5227 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:21.718344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4cd3a-05a4-4eba-a01f-231545a39bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:21.718993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4cd3a-05a4-4eba-a01f-231545a39bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:21.719271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4cd3a-05a4-4eba-a01f-231545a39bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:21.719542 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4cd3a-05a4-4eba-a01f-231545a39bb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:21.745905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4cd3a-05a4-4eba-a01f-231545a39bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:21.747618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4cd3a-05a4-4eba-a01f-231545a39bb2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-bea4cd3a-05a4-4eba-a01f-231545a39bb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:21.787125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:21.788818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:21.789976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:21.789976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:21.789976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:21.789976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 370/754] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:21.796019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4cd3a-05a4-4eba-a01f-231545a39bb2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:21.853737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 385/755] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:17:21.855574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906ff5f-539e-44f9-84f5-70eccc5c5227 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:21.890156 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:21.942284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:21.968735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4cd3a-05a4-4eba-a01f-231545a39bb2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:21.990883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906ff5f-539e-44f9-84f5-70eccc5c5227 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:22.016451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e9b09-6c09-4406-ab23-93ee51bbaa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:22.017284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e9b09-6c09-4406-ab23-93ee51bbaa4a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:22.017430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e9b09-6c09-4406-ab23-93ee51bbaa4a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:22.017607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e9b09-6c09-4406-ab23-93ee51bbaa4a None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:22.018399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e9b09-6c09-4406-ab23-93ee51bbaa4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:22.018699 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e9b09-6c09-4406-ab23-93ee51bbaa4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:22.020109 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e9b09-6c09-4406-ab23-93ee51bbaa4a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:22.036779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65f321-d997-4274-b509-8553dbaa195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:22.038068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65f321-d997-4274-b509-8553dbaa195e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:22.038250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65f321-d997-4274-b509-8553dbaa195e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:22.038618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65f321-d997-4274-b509-8553dbaa195e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:22.038776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 371/756] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:22.039095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65f321-d997-4274-b509-8553dbaa195e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:22.039990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e9b09-6c09-4406-ab23-93ee51bbaa4a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:22.040532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65f321-d997-4274-b509-8553dbaa195e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-7b65f321-d997-4274-b509-8553dbaa195e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:22.052735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:22.054053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:17:22.055116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:22.057978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 386/757] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Sep 1 16:17:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:22.058894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65f321-d997-4274-b509-8553dbaa195e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:22.163480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e9b09-6c09-4406-ab23-93ee51bbaa4a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:22.164321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:22.189208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65f321-d997-4274-b509-8553dbaa195e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:22.202474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406966ae-0609-4f45-be11-58a95e780071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:22.203097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406966ae-0609-4f45-be11-58a95e780071 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:22.203377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406966ae-0609-4f45-be11-58a95e780071 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:22.203643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406966ae-0609-4f45-be11-58a95e780071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:22.216792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406966ae-0609-4f45-be11-58a95e780071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:22.218251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406966ae-0609-4f45-be11-58a95e780071 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:22.225910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-406966ae-0609-4f45-be11-58a95e780071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:22.236151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:22.238392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:22.240911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:22.240911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:22.240911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:22.240911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 372/758] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:22.240911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406966ae-0609-4f45-be11-58a95e780071 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:22.258108 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d844-5f70-458f-adb9-ca6e36717bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:22.260289 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d844-5f70-458f-adb9-ca6e36717bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:22.260971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d844-5f70-458f-adb9-ca6e36717bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:22.261842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5d844-5f70-458f-adb9-ca6e36717bd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:22.273230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5d844-5f70-458f-adb9-ca6e36717bd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:22.275829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d5d844-5f70-458f-adb9-ca6e36717bd4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-49d5d844-5f70-458f-adb9-ca6e36717bd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:22.291069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:22.292313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:22.293466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:22.293466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:22.293466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:22.293466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:22.293466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:22.293466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:22.293466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:22.293466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:22.293466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:22.293466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:22.295688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 387/759] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 1 16:17:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:22.297123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d844-5f70-458f-adb9-ca6e36717bd4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:22.378493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406966ae-0609-4f45-be11-58a95e780071 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:22.422193 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d82ca-480f-4055-bdab-3c582c59fa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:22.423200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d82ca-480f-4055-bdab-3c582c59fa44 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:22.423684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d82ca-480f-4055-bdab-3c582c59fa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:22.424130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d82ca-480f-4055-bdab-3c582c59fa44 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:22.424955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d82ca-480f-4055-bdab-3c582c59fa44 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:22.425580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d82ca-480f-4055-bdab-3c582c59fa44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:22.428534 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d82ca-480f-4055-bdab-3c582c59fa44 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:22.434453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 373/760] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 1 16:17:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:22.435674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d82ca-480f-4055-bdab-3c582c59fa44 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:22.472524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d5d844-5f70-458f-adb9-ca6e36717bd4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:22.509656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:22.514109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1543b3-2fad-45b1-bde0-5b0f2df716b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:22.515058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1543b3-2fad-45b1-bde0-5b0f2df716b2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:22.515479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1543b3-2fad-45b1-bde0-5b0f2df716b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:22.515754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1543b3-2fad-45b1-bde0-5b0f2df716b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:22.516397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1543b3-2fad-45b1-bde0-5b0f2df716b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:22.517151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1543b3-2fad-45b1-bde0-5b0f2df716b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:22.518068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1543b3-2fad-45b1-bde0-5b0f2df716b2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:22.528691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:22.533004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 388/761] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:22.533950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1543b3-2fad-45b1-bde0-5b0f2df716b2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:22.556836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d82ca-480f-4055-bdab-3c582c59fa44 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:22.595664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b5c0a-ed3c-4abf-b1b4-2e3b4cb198a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:22.596762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b5c0a-ed3c-4abf-b1b4-2e3b4cb198a1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:22.597267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b5c0a-ed3c-4abf-b1b4-2e3b4cb198a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:22.597769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b5c0a-ed3c-4abf-b1b4-2e3b4cb198a1 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:22.598714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b5c0a-ed3c-4abf-b1b4-2e3b4cb198a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:22.599316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b5c0a-ed3c-4abf-b1b4-2e3b4cb198a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:22.602018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b5c0a-ed3c-4abf-b1b4-2e3b4cb198a1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:22.624395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 374/762] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 1 16:17:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:22.625679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b5c0a-ed3c-4abf-b1b4-2e3b4cb198a1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:22.647953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1543b3-2fad-45b1-bde0-5b0f2df716b2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:22.685899 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24ddbb-46ac-4275-ad91-d5d62a44b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:22.686562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24ddbb-46ac-4275-ad91-d5d62a44b764 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:22.687276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24ddbb-46ac-4275-ad91-d5d62a44b764 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:22.687276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24ddbb-46ac-4275-ad91-d5d62a44b764 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:22.687806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24ddbb-46ac-4275-ad91-d5d62a44b764 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:22.688104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24ddbb-46ac-4275-ad91-d5d62a44b764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:22.689463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24ddbb-46ac-4275-ad91-d5d62a44b764 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:22.701797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 389/763] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 1 16:17:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:22.702807 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24ddbb-46ac-4275-ad91-d5d62a44b764 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:22.742626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b5c0a-ed3c-4abf-b1b4-2e3b4cb198a1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:22.765975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:22.772895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:22.782414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2d3b-8c83-4257-b183-a64489cc3664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:22.783394 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2d3b-8c83-4257-b183-a64489cc3664 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:22.783870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2d3b-8c83-4257-b183-a64489cc3664 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:22.784294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2d3b-8c83-4257-b183-a64489cc3664 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:22.792611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff2d3b-8c83-4257-b183-a64489cc3664 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:22.794351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff2d3b-8c83-4257-b183-a64489cc3664 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-d4ff2d3b-8c83-4257-b183-a64489cc3664 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:22.807709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:22.808679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:22.809585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:22.809585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:22.809585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:22.809585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:22.809585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:22.809585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:22.809585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:22.809585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:22.812169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 375/764] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:22.813344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2d3b-8c83-4257-b183-a64489cc3664 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:22.827919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24ddbb-46ac-4275-ad91-d5d62a44b764 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:22.874452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3413d09-d1f9-4188-b1ca-0d7b052e66e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:22.875908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3413d09-d1f9-4188-b1ca-0d7b052e66e1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:22.876532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3413d09-d1f9-4188-b1ca-0d7b052e66e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:22.877087 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3413d09-d1f9-4188-b1ca-0d7b052e66e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:22.949918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2d3b-8c83-4257-b183-a64489cc3664 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:22.993281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6531b-548d-4e07-b764-25afa2b5ff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:22.994281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6531b-548d-4e07-b764-25afa2b5ff4f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:22.994827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6531b-548d-4e07-b764-25afa2b5ff4f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:22.995284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6531b-548d-4e07-b764-25afa2b5ff4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:22.996242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6531b-548d-4e07-b764-25afa2b5ff4f None admin] RBAC: Adding query filter params (interface=public, service_id=9411d1d9faf84ed6ac24cd78c9ced89b, region_id=RegionOne) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:22.996788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6531b-548d-4e07-b764-25afa2b5ff4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:22.998414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6531b-548d-4e07-b764-25afa2b5ff4f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:23.008137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 376/765] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 1 16:17:22 2022] GET /identity/v3/endpoints?service_id=9411d1d9faf84ed6ac24cd78c9ced89b&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:23.009313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6531b-548d-4e07-b764-25afa2b5ff4f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:23.017324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3413d09-d1f9-4188-b1ca-0d7b052e66e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:23.018825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3413d09-d1f9-4188-b1ca-0d7b052e66e1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d3413d09-d1f9-4188-b1ca-0d7b052e66e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:23.034792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:23.036083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:23.037856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:23.037856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:23.037856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:23.037856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 390/766] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:23.038597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58231bb-4cb7-4839-a06b-8e49a3ad1ff5 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:23.038597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58231bb-4cb7-4839-a06b-8e49a3ad1ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:23.038751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58231bb-4cb7-4839-a06b-8e49a3ad1ff5 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:23.044755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 391/767] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:23.044755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58231bb-4cb7-4839-a06b-8e49a3ad1ff5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:23.079796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:23.144412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6531b-548d-4e07-b764-25afa2b5ff4f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:23.163956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58231bb-4cb7-4839-a06b-8e49a3ad1ff5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:23.181473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148a976-7029-4847-8aac-53132b02683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:23.182406 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a976-7029-4847-8aac-53132b02683e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:23.182677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a976-7029-4847-8aac-53132b02683e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:23.182846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:23.182937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148a976-7029-4847-8aac-53132b02683e None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:23.183633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148a976-7029-4847-8aac-53132b02683e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:23.183920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148a976-7029-4847-8aac-53132b02683e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:23.185317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148a976-7029-4847-8aac-53132b02683e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:23.200900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 377/768] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:23.202205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bce77-129e-4de5-be6a-28c6b6c7bfb3 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:23.202483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bce77-129e-4de5-be6a-28c6b6c7bfb3 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:23.202752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bce77-129e-4de5-be6a-28c6b6c7bfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:23.211958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e2697-349c-4988-8cbc-4be805bb0d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:23.212574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e2697-349c-4988-8cbc-4be805bb0d0d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:23.212852 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e2697-349c-4988-8cbc-4be805bb0d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:23.213120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e2697-349c-4988-8cbc-4be805bb0d0d None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:23.213720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e2697-349c-4988-8cbc-4be805bb0d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:23.215129 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e2697-349c-4988-8cbc-4be805bb0d0d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:23.226070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 392/769] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 1 16:17:23 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:23.226923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-748bce77-129e-4de5-be6a-28c6b6c7bfb3 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:23.227758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e2697-349c-4988-8cbc-4be805bb0d0d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:23.228443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-748bce77-129e-4de5-be6a-28c6b6c7bfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:23.326385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 378/770] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:23.327648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bce77-129e-4de5-be6a-28c6b6c7bfb3 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:23.384702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e2697-349c-4988-8cbc-4be805bb0d0d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:23.400818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:23.428940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5b3e7-da5e-4b01-b4fe-69510f7c63d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:23.429925 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5b3e7-da5e-4b01-b4fe-69510f7c63d5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:23.430401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5b3e7-da5e-4b01-b4fe-69510f7c63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:23.430888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5b3e7-da5e-4b01-b4fe-69510f7c63d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:23.431786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5b3e7-da5e-4b01-b4fe-69510f7c63d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:23.432298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5b3e7-da5e-4b01-b4fe-69510f7c63d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:23.433890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5b3e7-da5e-4b01-b4fe-69510f7c63d5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:23.449181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 393/771] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:23.454389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5b3e7-da5e-4b01-b4fe-69510f7c63d5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:23.493157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bce77-129e-4de5-be6a-28c6b6c7bfb3 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:23.512651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:23.537522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36d9e4-3286-4373-b2f8-fd95f322b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:23.538299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d9e4-3286-4373-b2f8-fd95f322b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:23.538646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d9e4-3286-4373-b2f8-fd95f322b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:23.538916 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36d9e4-3286-4373-b2f8-fd95f322b5d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:23.540192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36d9e4-3286-4373-b2f8-fd95f322b5d1 None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=b536cb90a9d54ad29f0eb69e7a410add) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:23.540512 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36d9e4-3286-4373-b2f8-fd95f322b5d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:23.542402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36d9e4-3286-4373-b2f8-fd95f322b5d1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:23.550274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 379/772] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:23 2022] GET /identity/v3/role_assignments?user.id=b536cb90a9d54ad29f0eb69e7a410add&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:23.552228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e60590-df5e-4350-890d-215f5fe6a6c9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:23.552726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e60590-df5e-4350-890d-215f5fe6a6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:23.553006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e60590-df5e-4350-890d-215f5fe6a6c9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:23.554987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 380/773] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:23.561114 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86593a69-4efc-4664-9c9e-f02a7ef6e1e0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:23.561453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86593a69-4efc-4664-9c9e-f02a7ef6e1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:23.561662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86593a69-4efc-4664-9c9e-f02a7ef6e1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:23.587939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-86593a69-4efc-4664-9c9e-f02a7ef6e1e0 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:23.590009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-86593a69-4efc-4664-9c9e-f02a7ef6e1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:23.595406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5b3e7-da5e-4b01-b4fe-69510f7c63d5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:23.635786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aabdb1-f256-4150-909c-8a62527ad238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:23.636447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aabdb1-f256-4150-909c-8a62527ad238 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:23.636732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aabdb1-f256-4150-909c-8a62527ad238 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:23.636995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aabdb1-f256-4150-909c-8a62527ad238 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:23.655720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aabdb1-f256-4150-909c-8a62527ad238 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:23.657261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aabdb1-f256-4150-909c-8a62527ad238 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-a8aabdb1-f256-4150-909c-8a62527ad238 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:23.684239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:23.685217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:23.686802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:23.686802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:23.686802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:23.686802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:23.686802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:23.686802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:23.686802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:23.686802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:23.686802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 394/774] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:23.694218 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aabdb1-f256-4150-909c-8a62527ad238 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:23.707215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 381/775] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:23.708923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86593a69-4efc-4664-9c9e-f02a7ef6e1e0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:23.749901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:23.848390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:23.852075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86593a69-4efc-4664-9c9e-f02a7ef6e1e0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:23.852873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aabdb1-f256-4150-909c-8a62527ad238 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:23.910436 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dddb9-9706-48b2-a4a7-688b46d164df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:23.911452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dddb9-9706-48b2-a4a7-688b46d164df None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:23.912018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dddb9-9706-48b2-a4a7-688b46d164df None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:23.912583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631dddb9-9706-48b2-a4a7-688b46d164df None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:23.913471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dddb9-9706-48b2-a4a7-688b46d164df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:23.913980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dddb9-9706-48b2-a4a7-688b46d164df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:23.916364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631dddb9-9706-48b2-a4a7-688b46d164df None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:23.932739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae5c25-8af9-47c8-ae14-cc36ad5cb8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:23.933732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5c25-8af9-47c8-ae14-cc36ad5cb8c8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:23.934257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5c25-8af9-47c8-ae14-cc36ad5cb8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:23.934712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae5c25-8af9-47c8-ae14-cc36ad5cb8c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:23.943582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 395/776] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:23.950512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dddb9-9706-48b2-a4a7-688b46d164df None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:23.963234 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae5c25-8af9-47c8-ae14-cc36ad5cb8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-2cae5c25-8af9-47c8-ae14-cc36ad5cb8c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:23.974229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:23.976078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:23.976963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:23.981406 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 382/777] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:23.989278 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae5c25-8af9-47c8-ae14-cc36ad5cb8c8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:24.125282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631dddb9-9706-48b2-a4a7-688b46d164df None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:24.133905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:24.145890 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae5c25-8af9-47c8-ae14-cc36ad5cb8c8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:24.169013 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60394cee-65e4-4263-bc26-c6867d52f52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:24.169708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394cee-65e4-4263-bc26-c6867d52f52a None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:24.170012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394cee-65e4-4263-bc26-c6867d52f52a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:24.170277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60394cee-65e4-4263-bc26-c6867d52f52a None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/060b6347b13b4f67bf47169f5668b205/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:24.172185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60394cee-65e4-4263-bc26-c6867d52f52a None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=060b6347b13b4f67bf47169f5668b205, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:24.173602 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60394cee-65e4-4263-bc26-c6867d52f52a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:24.187252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc0367-319f-493c-9ace-a73b14f9e791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:24.187915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc0367-319f-493c-9ace-a73b14f9e791 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:24.188189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc0367-319f-493c-9ace-a73b14f9e791 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:24.188454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fc0367-319f-493c-9ace-a73b14f9e791 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:24.189113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc0367-319f-493c-9ace-a73b14f9e791 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:24.189412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc0367-319f-493c-9ace-a73b14f9e791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:24.190848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fc0367-319f-493c-9ace-a73b14f9e791 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:24.200183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 383/778] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:17:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:24.201067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc0367-319f-493c-9ace-a73b14f9e791 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:24.248134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 396/779] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:17:23 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/060b6347b13b4f67bf47169f5668b205/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:17:24.249043 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60394cee-65e4-4263-bc26-c6867d52f52a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:24.283149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:24.393561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60394cee-65e4-4263-bc26-c6867d52f52a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:24.394855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fc0367-319f-493c-9ace-a73b14f9e791 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:24.437633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1820b1-7eec-4d37-9ab1-9a3676fc9417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:24.438683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1820b1-7eec-4d37-9ab1-9a3676fc9417 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:24.439169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1820b1-7eec-4d37-9ab1-9a3676fc9417 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:24.439643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1820b1-7eec-4d37-9ab1-9a3676fc9417 None admin] PATH_INFO: `/v3/services/network` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:24.440437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1820b1-7eec-4d37-9ab1-9a3676fc9417 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:24.441157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e70db3-4f90-45fb-b14e-f7fa4c905a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:24.441806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70db3-4f90-45fb-b14e-f7fa4c905a8d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:24.442116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70db3-4f90-45fb-b14e-f7fa4c905a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:24.442385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70db3-4f90-45fb-b14e-f7fa4c905a8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:24.443072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1820b1-7eec-4d37-9ab1-9a3676fc9417 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ba1820b1-7eec-4d37-9ab1-9a3676fc9417 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:24.453574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:24.454675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:17:24.455531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:24.456275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e70db3-4f90-45fb-b14e-f7fa4c905a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:24.457738 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e70db3-4f90-45fb-b14e-f7fa4c905a8d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:24.459340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 384/780] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:24 2022] GET /identity/v3/services/network => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:24.465017 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1820b1-7eec-4d37-9ab1-9a3676fc9417 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-92e70db3-4f90-45fb-b14e-f7fa4c905a8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:24.494600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:24.495769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:24.496678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:24.496678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:24.496678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:24.498622 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:24.501046 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 397/781] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:24.510069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e70db3-4f90-45fb-b14e-f7fa4c905a8d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:24.602373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:24.617984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1820b1-7eec-4d37-9ab1-9a3676fc9417 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:24.640305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e70db3-4f90-45fb-b14e-f7fa4c905a8d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:24.655476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf67b1-6aac-4b02-94b1-c8fb253e98fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:24.656259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf67b1-6aac-4b02-94b1-c8fb253e98fe None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:24.656636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf67b1-6aac-4b02-94b1-c8fb253e98fe None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:24.657005 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf67b1-6aac-4b02-94b1-c8fb253e98fe None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:24.657741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf67b1-6aac-4b02-94b1-c8fb253e98fe None admin] RBAC: Adding query filter params (name=network) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:24.658157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf67b1-6aac-4b02-94b1-c8fb253e98fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:24.659693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf67b1-6aac-4b02-94b1-c8fb253e98fe None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:24.665502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 385/782] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:24.671366 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf67b1-6aac-4b02-94b1-c8fb253e98fe None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:24.683271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928afc2-7392-4eec-ad60-e9db09f3ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:24.684829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928afc2-7392-4eec-ad60-e9db09f3ad93 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:24.685253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928afc2-7392-4eec-ad60-e9db09f3ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:24.685682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928afc2-7392-4eec-ad60-e9db09f3ad93 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:24.686611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928afc2-7392-4eec-ad60-e9db09f3ad93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:24.687089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928afc2-7392-4eec-ad60-e9db09f3ad93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:24.688612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928afc2-7392-4eec-ad60-e9db09f3ad93 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:24.703413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 398/783] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:24.711394 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928afc2-7392-4eec-ad60-e9db09f3ad93 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:24.811979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:24.855435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf67b1-6aac-4b02-94b1-c8fb253e98fe None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:24.923039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928afc2-7392-4eec-ad60-e9db09f3ad93 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:24.950707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ece3b-d106-4a87-8c51-11d0b996dc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:24.951360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ece3b-d106-4a87-8c51-11d0b996dc9d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:24.951643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ece3b-d106-4a87-8c51-11d0b996dc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:24.951918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ece3b-d106-4a87-8c51-11d0b996dc9d None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:24.952581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ece3b-d106-4a87-8c51-11d0b996dc9d None admin] RBAC: Adding query filter params (type=network) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:24.952882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ece3b-d106-4a87-8c51-11d0b996dc9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:24.954336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ece3b-d106-4a87-8c51-11d0b996dc9d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:24.961851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:24.963758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 386/784] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:24.970521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ece3b-d106-4a87-8c51-11d0b996dc9d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:24.972848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0e418-7262-4e83-b550-2b9de30553d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:24.973560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0e418-7262-4e83-b550-2b9de30553d7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:24.973843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0e418-7262-4e83-b550-2b9de30553d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:24.974135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0e418-7262-4e83-b550-2b9de30553d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:24.987116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0e418-7262-4e83-b550-2b9de30553d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:24.988576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0e418-7262-4e83-b550-2b9de30553d7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-59b0e418-7262-4e83-b550-2b9de30553d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:25.014318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:25.015376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:25.016343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:25.016343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:25.016343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:25.016343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:25.016343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:25.016343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:25.016343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:25.016343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:25.016343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:17:25.016343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:25.018706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 399/785] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:17:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:25.022178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0e418-7262-4e83-b550-2b9de30553d7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:25.136840 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0e418-7262-4e83-b550-2b9de30553d7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:25.148322 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ece3b-d106-4a87-8c51-11d0b996dc9d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:25.173285 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165c8e0-e5a2-450c-8793-2c60a4b14d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:25.173827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165c8e0-e5a2-450c-8793-2c60a4b14d96 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:25.174218 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165c8e0-e5a2-450c-8793-2c60a4b14d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:25.174489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165c8e0-e5a2-450c-8793-2c60a4b14d96 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:25.175210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165c8e0-e5a2-450c-8793-2c60a4b14d96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:25.175512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165c8e0-e5a2-450c-8793-2c60a4b14d96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:25.177069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165c8e0-e5a2-450c-8793-2c60a4b14d96 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:25.196019 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 400/786] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 1 16:17:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:25.206518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5fc94-b88c-4a0f-9a70-970de9c7f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:25.207218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5fc94-b88c-4a0f-9a70-970de9c7f598 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:25.207354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165c8e0-e5a2-450c-8793-2c60a4b14d96 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:25.207558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5fc94-b88c-4a0f-9a70-970de9c7f598 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:25.207752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5fc94-b88c-4a0f-9a70-970de9c7f598 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:25.208506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5fc94-b88c-4a0f-9a70-970de9c7f598 None admin] RBAC: Adding query filter params (interface=public, service_id=5bb8a3132c2d4c45835c1c9ac48f57cf, region_id=RegionOne) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:25.209347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5fc94-b88c-4a0f-9a70-970de9c7f598 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:25.210752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5fc94-b88c-4a0f-9a70-970de9c7f598 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:25.218627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 387/787] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 1 16:17:24 2022] GET /identity/v3/endpoints?service_id=5bb8a3132c2d4c45835c1c9ac48f57cf&interface=public®ion_id=RegionOne => generated 194 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:25.227107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5fc94-b88c-4a0f-9a70-970de9c7f598 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:25.250292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:25.314092 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:25.409660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5fc94-b88c-4a0f-9a70-970de9c7f598 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:25.421813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165c8e0-e5a2-450c-8793-2c60a4b14d96 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:25.480087 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560fc40-9e8a-4fd8-8546-5f1eb7c7fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:25.480627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560fc40-9e8a-4fd8-8546-5f1eb7c7fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:25.481794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560fc40-9e8a-4fd8-8546-5f1eb7c7fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:25.482172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560fc40-9e8a-4fd8-8546-5f1eb7c7fdc8 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:25.482795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560fc40-9e8a-4fd8-8546-5f1eb7c7fdc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:25.484158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560fc40-9e8a-4fd8-8546-5f1eb7c7fdc8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:25.496699 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616f1dd-338a-43c5-9739-3602f2203d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:25.497486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616f1dd-338a-43c5-9739-3602f2203d22 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:25.497767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616f1dd-338a-43c5-9739-3602f2203d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:25.498067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616f1dd-338a-43c5-9739-3602f2203d22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:25.499108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 388/788] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 1 16:17:25 2022] GET /identity/v3/services => generated 772 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:25.523510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616f1dd-338a-43c5-9739-3602f2203d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:25.525103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616f1dd-338a-43c5-9739-3602f2203d22 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-3616f1dd-338a-43c5-9739-3602f2203d22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:25.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:25.547199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:25.548114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:25.548114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:25.548114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:25.551851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 401/789] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:25.553722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560fc40-9e8a-4fd8-8546-5f1eb7c7fdc8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:25.650329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:25.656608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614855cd-8f4e-4f54-a5d0-0668d9eca50b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:25.656895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614855cd-8f4e-4f54-a5d0-0668d9eca50b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:25.657235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614855cd-8f4e-4f54-a5d0-0668d9eca50b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:25.658595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 402/790] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:25.664411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fdfa7-8650-4e31-b4c3-34b4ece550ca None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:25.664695 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fdfa7-8650-4e31-b4c3-34b4ece550ca None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:25.665443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fdfa7-8650-4e31-b4c3-34b4ece550ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:25.689358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560fc40-9e8a-4fd8-8546-5f1eb7c7fdc8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:25.700212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-838fdfa7-8650-4e31-b4c3-34b4ece550ca None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:25.702345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-838fdfa7-8650-4e31-b4c3-34b4ece550ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:25.728941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854150c9-7868-40fe-b9ea-194d6cdaef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:25.728941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854150c9-7868-40fe-b9ea-194d6cdaef5f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:25.728941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854150c9-7868-40fe-b9ea-194d6cdaef5f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:25.729310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854150c9-7868-40fe-b9ea-194d6cdaef5f None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:25.729846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854150c9-7868-40fe-b9ea-194d6cdaef5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:25.730241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854150c9-7868-40fe-b9ea-194d6cdaef5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:25.731570 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854150c9-7868-40fe-b9ea-194d6cdaef5f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:25.745354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 389/791] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:25.756605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854150c9-7868-40fe-b9ea-194d6cdaef5f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:25.792264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 403/792] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:25.885607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854150c9-7868-40fe-b9ea-194d6cdaef5f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:25.916528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:25.923108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562adbf3-d5ff-4cd1-81c8-f9677a6f6ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:25.923756 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562adbf3-d5ff-4cd1-81c8-f9677a6f6ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:25.924256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562adbf3-d5ff-4cd1-81c8-f9677a6f6ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:25.924625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562adbf3-d5ff-4cd1-81c8-f9677a6f6ec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:25.932276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562adbf3-d5ff-4cd1-81c8-f9677a6f6ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:25.933697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562adbf3-d5ff-4cd1-81c8-f9677a6f6ec0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-562adbf3-d5ff-4cd1-81c8-f9677a6f6ec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:25.945242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:25.946188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:25.947086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:25.947086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:25.947086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:25.947086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:25.947086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:25.947086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:25.947086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:25.947086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:25.947086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 390/793] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:25.950402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0add7-4b4f-4846-baff-90936bef4d7f None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:25.950682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0add7-4b4f-4846-baff-90936bef4d7f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:25.951089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0add7-4b4f-4846-baff-90936bef4d7f None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:25.952346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562adbf3-d5ff-4cd1-81c8-f9677a6f6ec0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:25.952882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 404/794] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:25.958025 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647f7d7-8d4a-43ec-a0b0-cae6807bc573 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:25.958312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647f7d7-8d4a-43ec-a0b0-cae6807bc573 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:25.958585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647f7d7-8d4a-43ec-a0b0-cae6807bc573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:25.981601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-3647f7d7-8d4a-43ec-a0b0-cae6807bc573 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:25.983011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3647f7d7-8d4a-43ec-a0b0-cae6807bc573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:26.034898 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:26.109987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562adbf3-d5ff-4cd1-81c8-f9677a6f6ec0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:26.111847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 405/795] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:26.153834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa85e-02aa-4035-b486-ff39946dbfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:26.154767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa85e-02aa-4035-b486-ff39946dbfbe None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:26.155208 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa85e-02aa-4035-b486-ff39946dbfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:26.155620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70aa85e-02aa-4035-b486-ff39946dbfbe None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:26.156513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70aa85e-02aa-4035-b486-ff39946dbfbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:26.156958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70aa85e-02aa-4035-b486-ff39946dbfbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:26.158713 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70aa85e-02aa-4035-b486-ff39946dbfbe None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:26.171884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 391/796] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:26.178458 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647f7d7-8d4a-43ec-a0b0-cae6807bc573 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:26.188596 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa85e-02aa-4035-b486-ff39946dbfbe None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:26.298358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:26.359947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647f7d7-8d4a-43ec-a0b0-cae6807bc573 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:26.383745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70aa85e-02aa-4035-b486-ff39946dbfbe None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:26.430768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdd493-228a-4a02-bf22-bf7608c72ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:26.431442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdd493-228a-4a02-bf22-bf7608c72ef8 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:26.431721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdd493-228a-4a02-bf22-bf7608c72ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:26.431994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdd493-228a-4a02-bf22-bf7608c72ef8 None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/589e62c8d27044eea16e7c1f803e1393/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:26.434520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983ab01-6b2e-4587-b59f-f94ac07760eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:26.435211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ab01-6b2e-4587-b59f-f94ac07760eb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:26.435490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ab01-6b2e-4587-b59f-f94ac07760eb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:26.435760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983ab01-6b2e-4587-b59f-f94ac07760eb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:26.436346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983ab01-6b2e-4587-b59f-f94ac07760eb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:26.438059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983ab01-6b2e-4587-b59f-f94ac07760eb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:26.439078 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdd493-228a-4a02-bf22-bf7608c72ef8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=589e62c8d27044eea16e7c1f803e1393, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:26.440492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdd493-228a-4a02-bf22-bf7608c72ef8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f983ab01-6b2e-4587-b59f-f94ac07760eb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:26.452790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:26.453910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:26.454775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 392/797] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Sep 1 16:17:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:26.460130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983ab01-6b2e-4587-b59f-f94ac07760eb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:26.536518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 406/798] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:17:26 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/589e62c8d27044eea16e7c1f803e1393/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:17:26.536518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdd493-228a-4a02-bf22-bf7608c72ef8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:26.586756 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983ab01-6b2e-4587-b59f-f94ac07760eb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:26.605182 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:26.629950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae134a-5e24-4b92-89d1-312c6639bb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:26.631102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae134a-5e24-4b92-89d1-312c6639bb6c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:26.631532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae134a-5e24-4b92-89d1-312c6639bb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:26.632135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:26.632397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae134a-5e24-4b92-89d1-312c6639bb6c None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:26.633715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae134a-5e24-4b92-89d1-312c6639bb6c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:26.634193 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae134a-5e24-4b92-89d1-312c6639bb6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:26.635832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae134a-5e24-4b92-89d1-312c6639bb6c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:26.642137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 393/799] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 1 16:17:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:26.650642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae134a-5e24-4b92-89d1-312c6639bb6c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:26.778359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdd493-228a-4a02-bf22-bf7608c72ef8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:26.825400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b175e7-6ff7-42ea-a657-7764ff2a51c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:26.826075 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b175e7-6ff7-42ea-a657-7764ff2a51c0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:26.826357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b175e7-6ff7-42ea-a657-7764ff2a51c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:26.826630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b175e7-6ff7-42ea-a657-7764ff2a51c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:26.848385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae134a-5e24-4b92-89d1-312c6639bb6c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:26.850774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b175e7-6ff7-42ea-a657-7764ff2a51c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-b0b175e7-6ff7-42ea-a657-7764ff2a51c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:26.857555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:26.858848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:26.859903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 407/800] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:26.860783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3a681-eb82-4a0f-95da-93d7c2aff637 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:26.860783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3a681-eb82-4a0f-95da-93d7c2aff637 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:26.860943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3a681-eb82-4a0f-95da-93d7c2aff637 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:26.865568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 408/801] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:26.869739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3a681-eb82-4a0f-95da-93d7c2aff637 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:26.900587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8218eb-7347-411e-b948-4d2b00a75dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:26.901199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8218eb-7347-411e-b948-4d2b00a75dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:26.901477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8218eb-7347-411e-b948-4d2b00a75dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:26.901767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8218eb-7347-411e-b948-4d2b00a75dc5 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:26.902405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8218eb-7347-411e-b948-4d2b00a75dc5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:26.902705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8218eb-7347-411e-b948-4d2b00a75dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:26.904258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8218eb-7347-411e-b948-4d2b00a75dc5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:26.910025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 394/802] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Sep 1 16:17:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:26.911285 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b06c33-50a9-47c3-a50b-6638a66e2a7e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:26.911566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b06c33-50a9-47c3-a50b-6638a66e2a7e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:26.911863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b06c33-50a9-47c3-a50b-6638a66e2a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:26.931671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-05b06c33-50a9-47c3-a50b-6638a66e2a7e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:26.932862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-05b06c33-50a9-47c3-a50b-6638a66e2a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:26.966878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:26.973399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:26.987943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3a681-eb82-4a0f-95da-93d7c2aff637 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:27.013719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 395/803] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:27.015005 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b06c33-50a9-47c3-a50b-6638a66e2a7e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:27.037824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a552-710f-4631-998b-a8b4abc42c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:27.038684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a552-710f-4631-998b-a8b4abc42c92 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:27.039070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a552-710f-4631-998b-a8b4abc42c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:27.039479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce63a552-710f-4631-998b-a8b4abc42c92 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:27.040247 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63a552-710f-4631-998b-a8b4abc42c92 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:27.040651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63a552-710f-4631-998b-a8b4abc42c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:27.042429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce63a552-710f-4631-998b-a8b4abc42c92 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:27.051878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 409/804] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:17:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:27.057792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a552-710f-4631-998b-a8b4abc42c92 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:27.173938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce63a552-710f-4631-998b-a8b4abc42c92 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:27.211404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c83f74-295d-4b98-966b-7eacf9e62fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:27.212215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c83f74-295d-4b98-966b-7eacf9e62fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:27.212591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c83f74-295d-4b98-966b-7eacf9e62fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:27.212963 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c83f74-295d-4b98-966b-7eacf9e62fe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:27.225258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c83f74-295d-4b98-966b-7eacf9e62fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:27.226953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c83f74-295d-4b98-966b-7eacf9e62fe7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:27.230222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-b0c83f74-295d-4b98-966b-7eacf9e62fe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:27.243518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:27.244868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:27.245769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:27.245769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:27.245769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:27.245769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 410/805] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:27.250744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c83f74-295d-4b98-966b-7eacf9e62fe7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:27.277855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b06c33-50a9-47c3-a50b-6638a66e2a7e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:27.362873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd59983-2d66-47b4-a5e8-57a99246aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:27.363862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd59983-2d66-47b4-a5e8-57a99246aa1a None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:27.364146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd59983-2d66-47b4-a5e8-57a99246aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:27.364672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd59983-2d66-47b4-a5e8-57a99246aa1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:27.366061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd59983-2d66-47b4-a5e8-57a99246aa1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:27.367267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c83f74-295d-4b98-966b-7eacf9e62fe7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:27.367437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd59983-2d66-47b4-a5e8-57a99246aa1a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:27.407856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d378947-630f-49d5-b52f-c091473d9b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:27.408514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d378947-630f-49d5-b52f-c091473d9b63 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:27.408791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d378947-630f-49d5-b52f-c091473d9b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:27.409127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d378947-630f-49d5-b52f-c091473d9b63 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:27.409940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d378947-630f-49d5-b52f-c091473d9b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:27.410246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d378947-630f-49d5-b52f-c091473d9b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:27.411618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d378947-630f-49d5-b52f-c091473d9b63 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:27.425105 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 411/806] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:27.426340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d378947-630f-49d5-b52f-c091473d9b63 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:27.453161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 396/807] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:17:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:27.454387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd59983-2d66-47b4-a5e8-57a99246aa1a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:27.496979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:27.518985 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:27.603001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd59983-2d66-47b4-a5e8-57a99246aa1a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:27.609641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d378947-630f-49d5-b52f-c091473d9b63 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:27.647200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57880c44-77ab-4bf3-badc-bb2f16668861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:27.648806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880c44-77ab-4bf3-badc-bb2f16668861 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:27.649296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880c44-77ab-4bf3-badc-bb2f16668861 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:27.649771 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57880c44-77ab-4bf3-badc-bb2f16668861 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:27.659847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57880c44-77ab-4bf3-badc-bb2f16668861 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:27.661659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57880c44-77ab-4bf3-badc-bb2f16668861 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-57880c44-77ab-4bf3-badc-bb2f16668861 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:27.676362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:27.677393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:27.679545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:27.679545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:27.679545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:27.679545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:27.679545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:27.679545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:27.679545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:27.679545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:27.679545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:27.679545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:27.687166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 397/808] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 1 16:17:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:27.689284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57880c44-77ab-4bf3-badc-bb2f16668861 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:27.710242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524036a3-7e23-405b-b6c4-ff6195044c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:27.710966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524036a3-7e23-405b-b6c4-ff6195044c03 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:27.711255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524036a3-7e23-405b-b6c4-ff6195044c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:27.711529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524036a3-7e23-405b-b6c4-ff6195044c03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:27.742571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524036a3-7e23-405b-b6c4-ff6195044c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-524036a3-7e23-405b-b6c4-ff6195044c03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:27.747620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:27.748589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:27.750054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 412/809] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:17:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:27.754775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524036a3-7e23-405b-b6c4-ff6195044c03 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:27.806327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:27.832973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57880c44-77ab-4bf3-badc-bb2f16668861 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:27.882661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b99ab-fff3-424a-a254-49485aa6e7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:27.883306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b99ab-fff3-424a-a254-49485aa6e7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:27.883894 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b99ab-fff3-424a-a254-49485aa6e7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:27.884179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b99ab-fff3-424a-a254-49485aa6e7d7 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:27.885539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b99ab-fff3-424a-a254-49485aa6e7d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:27.886184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b99ab-fff3-424a-a254-49485aa6e7d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:27.888636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b99ab-fff3-424a-a254-49485aa6e7d7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:27.891469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524036a3-7e23-405b-b6c4-ff6195044c03 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:27.913239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 398/810] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 1 16:17:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:27.914536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059df70-2abc-49bd-8eb2-456cd1c2c99f None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:27.914754 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059df70-2abc-49bd-8eb2-456cd1c2c99f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:27.915027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059df70-2abc-49bd-8eb2-456cd1c2c99f None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:27.916532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 399/811] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:27.919854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059df70-2abc-49bd-8eb2-456cd1c2c99f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:27.942260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:27.961748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd14a51-c176-47b5-a308-69c5dcd43555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:27.962813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd14a51-c176-47b5-a308-69c5dcd43555 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:27.963413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd14a51-c176-47b5-a308-69c5dcd43555 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:27.963852 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd14a51-c176-47b5-a308-69c5dcd43555 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:27.965118 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd14a51-c176-47b5-a308-69c5dcd43555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:27.965653 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd14a51-c176-47b5-a308-69c5dcd43555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:27.968192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd14a51-c176-47b5-a308-69c5dcd43555 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:27.985446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 413/812] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:17:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:27.992264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfdf5e-a469-4f28-9c88-b6fbf8c5dbd0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:27.992753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfdf5e-a469-4f28-9c88-b6fbf8c5dbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:27.993214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfdf5e-a469-4f28-9c88-b6fbf8c5dbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:28.020327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f9cfdf5e-a469-4f28-9c88-b6fbf8c5dbd0 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:28.022403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f9cfdf5e-a469-4f28-9c88-b6fbf8c5dbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:28.105639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 414/813] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:28.106800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfdf5e-a469-4f28-9c88-b6fbf8c5dbd0 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:28.227042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfdf5e-a469-4f28-9c88-b6fbf8c5dbd0 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:28.241318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:28.268386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0fd71-3aa8-4070-824a-6b41af188675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:28.279526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0fd71-3aa8-4070-824a-6b41af188675 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:28.279526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0fd71-3aa8-4070-824a-6b41af188675 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:28.279526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0fd71-3aa8-4070-824a-6b41af188675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:28.286248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0fd71-3aa8-4070-824a-6b41af188675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:28.288564 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0fd71-3aa8-4070-824a-6b41af188675 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d2f0fd71-3aa8-4070-824a-6b41af188675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:28.318630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:28.319753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:28.321062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:28.321062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:28.321062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:28.321062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 415/814] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:28.328365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0fd71-3aa8-4070-824a-6b41af188675 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:28.352613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059df70-2abc-49bd-8eb2-456cd1c2c99f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:28.424829 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b494e2f-480c-45c1-a434-b9268e20e78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:28.426891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b494e2f-480c-45c1-a434-b9268e20e78c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:28.428153 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b494e2f-480c-45c1-a434-b9268e20e78c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:28.429644 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b494e2f-480c-45c1-a434-b9268e20e78c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:28.448753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b494e2f-480c-45c1-a434-b9268e20e78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:28.451729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b494e2f-480c-45c1-a434-b9268e20e78c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:28.459701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0b494e2f-480c-45c1-a434-b9268e20e78c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:28.486430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:28.487806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:28.488730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:28.488730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:28.488730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:28.493261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 400/815] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 568 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:28.494644 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b494e2f-480c-45c1-a434-b9268e20e78c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:28.506589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0fd71-3aa8-4070-824a-6b41af188675 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:28.551011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536ea4a-4630-4ded-aac5-aa0174eda494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:28.551982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536ea4a-4630-4ded-aac5-aa0174eda494 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:28.552829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536ea4a-4630-4ded-aac5-aa0174eda494 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:28.554323 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4536ea4a-4630-4ded-aac5-aa0174eda494 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:28.555190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536ea4a-4630-4ded-aac5-aa0174eda494 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:28.555869 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536ea4a-4630-4ded-aac5-aa0174eda494 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:28.558573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4536ea4a-4630-4ded-aac5-aa0174eda494 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:28.579455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 416/816] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:28.586862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536ea4a-4630-4ded-aac5-aa0174eda494 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:28.629900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:28.695462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b494e2f-480c-45c1-a434-b9268e20e78c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:28.729228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4536ea4a-4630-4ded-aac5-aa0174eda494 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:28.742493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be6361-6a8b-4fc4-b5dc-c02370399725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:28.743060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be6361-6a8b-4fc4-b5dc-c02370399725 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:28.743338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be6361-6a8b-4fc4-b5dc-c02370399725 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:28.743607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be6361-6a8b-4fc4-b5dc-c02370399725 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:28.744598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be6361-6a8b-4fc4-b5dc-c02370399725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:28.744898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be6361-6a8b-4fc4-b5dc-c02370399725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:28.747419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be6361-6a8b-4fc4-b5dc-c02370399725 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:28.776047 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 401/817] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:28.776047 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be6361-6a8b-4fc4-b5dc-c02370399725 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:28.779333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd28d1d-9289-4eaa-b948-d23bbcf11454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:28.779979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28d1d-9289-4eaa-b948-d23bbcf11454 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:28.780291 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28d1d-9289-4eaa-b948-d23bbcf11454 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:28.780561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28d1d-9289-4eaa-b948-d23bbcf11454 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:28.788331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd28d1d-9289-4eaa-b948-d23bbcf11454 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:28.789764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd28d1d-9289-4eaa-b948-d23bbcf11454 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-afd28d1d-9289-4eaa-b948-d23bbcf11454 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:28.801599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:28.802825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 417/818] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 1 16:17:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5a406-df8a-49f8-936a-fe46e3df4f30 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:28.804624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5a406-df8a-49f8-936a-fe46e3df4f30 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:28.805486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5a406-df8a-49f8-936a-fe46e3df4f30 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:28.810438 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 418/819] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:28.811483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5a406-df8a-49f8-936a-fe46e3df4f30 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:28.859575 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:28.916118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be6361-6a8b-4fc4-b5dc-c02370399725 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:28.918356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:28.950370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5a406-df8a-49f8-936a-fe46e3df4f30 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:28.957140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391860f-0d9a-40c0-ae87-4a42d58a9f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:28.957789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391860f-0d9a-40c0-ae87-4a42d58a9f36 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:28.958171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391860f-0d9a-40c0-ae87-4a42d58a9f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:28.958443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391860f-0d9a-40c0-ae87-4a42d58a9f36 None admin] PATH_INFO: `/v3/services/network` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:28.959187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391860f-0d9a-40c0-ae87-4a42d58a9f36 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:28.960937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391860f-0d9a-40c0-ae87-4a42d58a9f36 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-5391860f-0d9a-40c0-ae87-4a42d58a9f36 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:28.970867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:28.971973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:28.972836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 402/820] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:28 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:28.973639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccb99-8ac6-463c-8162-1438ea8b0d78 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:28.974331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccb99-8ac6-463c-8162-1438ea8b0d78 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:28.974331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ccb99-8ac6-463c-8162-1438ea8b0d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:28.994845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-106ccb99-8ac6-463c-8162-1438ea8b0d78 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:28.995798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-106ccb99-8ac6-463c-8162-1438ea8b0d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:29.010733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603c111-e39b-440e-8ad8-0190f1281419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:29.011623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603c111-e39b-440e-8ad8-0190f1281419 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:29.011902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603c111-e39b-440e-8ad8-0190f1281419 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:29.012170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5603c111-e39b-440e-8ad8-0190f1281419 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:29.019797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603c111-e39b-440e-8ad8-0190f1281419 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:29.021629 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5603c111-e39b-440e-8ad8-0190f1281419 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-5603c111-e39b-440e-8ad8-0190f1281419 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:29.034731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:29.035679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:29.036571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:29.036571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:29.036571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:29.036571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:29.036571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:29.036571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:29.036571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:29.036571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:29.040922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 419/821] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:29.041944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603c111-e39b-440e-8ad8-0190f1281419 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:29.076872 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 403/822] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:29.086889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ccb99-8ac6-463c-8162-1438ea8b0d78 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:29.163335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:29.192857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5603c111-e39b-440e-8ad8-0190f1281419 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:29.233310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ccb99-8ac6-463c-8162-1438ea8b0d78 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:29.234041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69691707-d476-41ca-a4f6-19483d9884a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:29.234719 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69691707-d476-41ca-a4f6-19483d9884a0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:29.235005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69691707-d476-41ca-a4f6-19483d9884a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:29.235277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69691707-d476-41ca-a4f6-19483d9884a0 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:29.236023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69691707-d476-41ca-a4f6-19483d9884a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:29.236455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69691707-d476-41ca-a4f6-19483d9884a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:29.238340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69691707-d476-41ca-a4f6-19483d9884a0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:29.251121 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:29.260743 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 420/823] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 1 16:17:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:29.264264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69691707-d476-41ca-a4f6-19483d9884a0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:29.283757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556715ff-d90c-4f97-bde0-601df9f26ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:29.284633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556715ff-d90c-4f97-bde0-601df9f26ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:29.285066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556715ff-d90c-4f97-bde0-601df9f26ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:29.286016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556715ff-d90c-4f97-bde0-601df9f26ce1 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:29.287097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556715ff-d90c-4f97-bde0-601df9f26ce1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:29.287676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556715ff-d90c-4f97-bde0-601df9f26ce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:29.289649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556715ff-d90c-4f97-bde0-601df9f26ce1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:29.301437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 404/824] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:29.301437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556715ff-d90c-4f97-bde0-601df9f26ce1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:29.382737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69691707-d476-41ca-a4f6-19483d9884a0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:29.424106 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcce48-8c13-4ca9-aee2-d60604a7db82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:29.424731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcce48-8c13-4ca9-aee2-d60604a7db82 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:29.425011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcce48-8c13-4ca9-aee2-d60604a7db82 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:29.425280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcce48-8c13-4ca9-aee2-d60604a7db82 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:29.426017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dcce48-8c13-4ca9-aee2-d60604a7db82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:29.426327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dcce48-8c13-4ca9-aee2-d60604a7db82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:29.427817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dcce48-8c13-4ca9-aee2-d60604a7db82 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:29.429571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556715ff-d90c-4f97-bde0-601df9f26ce1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:29.444249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 421/825] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:29.447039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcce48-8c13-4ca9-aee2-d60604a7db82 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:29.452650 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:29.485829 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389099d-5a60-48d4-a99f-954acad4fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:29.486427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389099d-5a60-48d4-a99f-954acad4fa04 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:29.486706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389099d-5a60-48d4-a99f-954acad4fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:29.487138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389099d-5a60-48d4-a99f-954acad4fa04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:29.518173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:29.562902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcce48-8c13-4ca9-aee2-d60604a7db82 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:29.563212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389099d-5a60-48d4-a99f-954acad4fa04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:29.564913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389099d-5a60-48d4-a99f-954acad4fa04 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:29.600265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4258b90-369b-4aff-84a8-ff233a136e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:29.600905 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258b90-369b-4aff-84a8-ff233a136e01 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:29.601320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258b90-369b-4aff-84a8-ff233a136e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:29.601593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258b90-369b-4aff-84a8-ff233a136e01 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:29.602264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4258b90-369b-4aff-84a8-ff233a136e01 None admin] RBAC: Adding query filter params (type=network) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:29.602566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4258b90-369b-4aff-84a8-ff233a136e01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:29.604285 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4258b90-369b-4aff-84a8-ff233a136e01 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:29.609442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 422/826] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:29.610254 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4258b90-369b-4aff-84a8-ff233a136e01 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:29.678896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 405/827] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:17:29.680218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389099d-5a60-48d4-a99f-954acad4fa04 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:29.696498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:29.724112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4258b90-369b-4aff-84a8-ff233a136e01 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:29.750741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:29.763843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8347a04-7064-48aa-b169-d17b06d4a9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:29.764488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8347a04-7064-48aa-b169-d17b06d4a9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:29.764765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8347a04-7064-48aa-b169-d17b06d4a9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:29.765034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8347a04-7064-48aa-b169-d17b06d4a9e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:29.776293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8347a04-7064-48aa-b169-d17b06d4a9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f8347a04-7064-48aa-b169-d17b06d4a9e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:29.781146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:29.782222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:29.783098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 423/828] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:17:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:29.783791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8347a04-7064-48aa-b169-d17b06d4a9e6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:29.799519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389099d-5a60-48d4-a99f-954acad4fa04 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:29.839464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e8832-df20-4125-b5e2-40292944b925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:29.840128 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8832-df20-4125-b5e2-40292944b925 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:29.840407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8832-df20-4125-b5e2-40292944b925 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:29.840681 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8832-df20-4125-b5e2-40292944b925 None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/b536cb90a9d54ad29f0eb69e7a410add/roles/a5689ba8062a40f38b7a985af27c2f5c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:29.858588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e8832-df20-4125-b5e2-40292944b925 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=b536cb90a9d54ad29f0eb69e7a410add, role_id=a5689ba8062a40f38b7a985af27c2f5c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:29.860025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e8832-df20-4125-b5e2-40292944b925 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:29.897717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8347a04-7064-48aa-b169-d17b06d4a9e6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:29.931685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088b542-2fd2-47d6-8195-084432baa768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:29.932373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b542-2fd2-47d6-8195-084432baa768 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:29.932554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b542-2fd2-47d6-8195-084432baa768 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:29.932821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b542-2fd2-47d6-8195-084432baa768 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:29.933574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088b542-2fd2-47d6-8195-084432baa768 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:29.934984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088b542-2fd2-47d6-8195-084432baa768 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:29.940337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 406/829] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:17:29 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/b536cb90a9d54ad29f0eb69e7a410add/roles/a5689ba8062a40f38b7a985af27c2f5c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:17:29.941187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e8832-df20-4125-b5e2-40292944b925 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:30.024931 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:30.042029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 424/830] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:17:29 2022] POST /identity/v3/endpoints => generated 337 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:30.042029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088b542-2fd2-47d6-8195-084432baa768 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:30.085173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e8832-df20-4125-b5e2-40292944b925 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:30.109993 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:30.186150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a714a35-857b-4ef9-a35b-5a3a422be648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:30.187284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a714a35-857b-4ef9-a35b-5a3a422be648 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:30.187563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a714a35-857b-4ef9-a35b-5a3a422be648 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:30.188419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a714a35-857b-4ef9-a35b-5a3a422be648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:30.207592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a714a35-857b-4ef9-a35b-5a3a422be648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:30.209676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a714a35-857b-4ef9-a35b-5a3a422be648 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:30.212688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088b542-2fd2-47d6-8195-084432baa768 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0a714a35-857b-4ef9-a35b-5a3a422be648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:30.232293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:30.233334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:30.234693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:30.234693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:30.234693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:30.234693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 407/831] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:30.234693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04396-e04c-46ee-ae83-c916628eb0ff None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:30.234979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04396-e04c-46ee-ae83-c916628eb0ff None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:30.235224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04396-e04c-46ee-ae83-c916628eb0ff None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:30.237756 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 408/832] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:30.239250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c04396-e04c-46ee-ae83-c916628eb0ff None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:30.269562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafdb5d4-8c6e-4b21-b1df-d6c81d3dfd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:30.270358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdb5d4-8c6e-4b21-b1df-d6c81d3dfd1f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:30.270703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdb5d4-8c6e-4b21-b1df-d6c81d3dfd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:30.271050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafdb5d4-8c6e-4b21-b1df-d6c81d3dfd1f None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:30.271873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdb5d4-8c6e-4b21-b1df-d6c81d3dfd1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:30.272239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdb5d4-8c6e-4b21-b1df-d6c81d3dfd1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:30.274545 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafdb5d4-8c6e-4b21-b1df-d6c81d3dfd1f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:30.290307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 425/833] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:17:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:30.291938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8ac05-bf2d-44ff-a487-19ff853c3765 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:30.292539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8ac05-bf2d-44ff-a487-19ff853c3765 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:30.293022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8ac05-bf2d-44ff-a487-19ff853c3765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:30.325808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-75d8ac05-bf2d-44ff-a487-19ff853c3765 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:30.327390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-75d8ac05-bf2d-44ff-a487-19ff853c3765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:30.382795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c04396-e04c-46ee-ae83-c916628eb0ff None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:30.395517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:30.421824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccfaef-4b6d-4919-aaf7-900579ff05eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:30.422454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccfaef-4b6d-4919-aaf7-900579ff05eb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:30.422732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccfaef-4b6d-4919-aaf7-900579ff05eb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:30.423007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccfaef-4b6d-4919-aaf7-900579ff05eb None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:30.423637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccfaef-4b6d-4919-aaf7-900579ff05eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:30.423933 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccfaef-4b6d-4919-aaf7-900579ff05eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:30.430443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 426/834] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:30.430950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccfaef-4b6d-4919-aaf7-900579ff05eb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:30.432610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8ac05-bf2d-44ff-a487-19ff853c3765 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:30.446741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 409/835] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:30.452484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccfaef-4b6d-4919-aaf7-900579ff05eb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:30.476320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:30.566003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8ac05-bf2d-44ff-a487-19ff853c3765 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:30.587075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccfaef-4b6d-4919-aaf7-900579ff05eb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:30.620336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ac4c-9464-4418-9ae3-2a761542aba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:30.621619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ac4c-9464-4418-9ae3-2a761542aba7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:30.622081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ac4c-9464-4418-9ae3-2a761542aba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:30.622501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296ac4c-9464-4418-9ae3-2a761542aba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:30.624823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed183e2-05b1-4ba2-a4b7-a4aea413e1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:30.625374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed183e2-05b1-4ba2-a4b7-a4aea413e1fb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:30.625652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed183e2-05b1-4ba2-a4b7-a4aea413e1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:30.626006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed183e2-05b1-4ba2-a4b7-a4aea413e1fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:30.633511 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed183e2-05b1-4ba2-a4b7-a4aea413e1fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:30.634979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed183e2-05b1-4ba2-a4b7-a4aea413e1fb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:30.636262 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296ac4c-9464-4418-9ae3-2a761542aba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:30.638597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296ac4c-9464-4418-9ae3-2a761542aba7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-2ed183e2-05b1-4ba2-a4b7-a4aea413e1fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:30.647740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:30.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:30.649856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:30.649856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:30.649856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:30.649856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:30.649856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:30.649856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:30.649856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:30.649856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:30.653745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 410/836] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:30.654693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed183e2-05b1-4ba2-a4b7-a4aea413e1fb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-d296ac4c-9464-4418-9ae3-2a761542aba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:30.660841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:30.662074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:30.663147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:30.663147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:30.663147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:30.668021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 427/837] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:30.671572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ac4c-9464-4418-9ae3-2a761542aba7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:30.690024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:30.764356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed183e2-05b1-4ba2-a4b7-a4aea413e1fb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:30.767791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:30.788846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296ac4c-9464-4418-9ae3-2a761542aba7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:30.804944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc650528-205a-428d-89a6-9225c4ae3992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:30.805805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc650528-205a-428d-89a6-9225c4ae3992 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:30.806128 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc650528-205a-428d-89a6-9225c4ae3992 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:30.806402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc650528-205a-428d-89a6-9225c4ae3992 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:30.807094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc650528-205a-428d-89a6-9225c4ae3992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:30.807396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc650528-205a-428d-89a6-9225c4ae3992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:30.808809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc650528-205a-428d-89a6-9225c4ae3992 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:30.825831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 411/838] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:30.825831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc650528-205a-428d-89a6-9225c4ae3992 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:30.834333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152fe8c-b649-4dd6-93dd-845d3d9dbad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:30.837134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152fe8c-b649-4dd6-93dd-845d3d9dbad5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:30.837134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152fe8c-b649-4dd6-93dd-845d3d9dbad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:30.837134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152fe8c-b649-4dd6-93dd-845d3d9dbad5 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:30.837895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152fe8c-b649-4dd6-93dd-845d3d9dbad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:30.839461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152fe8c-b649-4dd6-93dd-845d3d9dbad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:30.839600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152fe8c-b649-4dd6-93dd-845d3d9dbad5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:30.860909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 428/839] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:30.861921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152fe8c-b649-4dd6-93dd-845d3d9dbad5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:30.929583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:30.941350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc650528-205a-428d-89a6-9225c4ae3992 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:30.977937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152fe8c-b649-4dd6-93dd-845d3d9dbad5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:30.979324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011013cd-f3ff-462a-a696-289f1ad53bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:30.979967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011013cd-f3ff-462a-a696-289f1ad53bfb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:30.980247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011013cd-f3ff-462a-a696-289f1ad53bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:30.980519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011013cd-f3ff-462a-a696-289f1ad53bfb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:30.981101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011013cd-f3ff-462a-a696-289f1ad53bfb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:30.982490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011013cd-f3ff-462a-a696-289f1ad53bfb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-011013cd-f3ff-462a-a696-289f1ad53bfb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:30.993377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:30.994460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:30.995306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 412/840] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:17:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:30.996187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011013cd-f3ff-462a-a696-289f1ad53bfb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:31.018936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0728da-36c9-4ee3-a94b-a5b15eb17de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:31.019600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0728da-36c9-4ee3-a94b-a5b15eb17de7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:31.019876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0728da-36c9-4ee3-a94b-a5b15eb17de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:31.020146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0728da-36c9-4ee3-a94b-a5b15eb17de7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:31.021287 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0728da-36c9-4ee3-a94b-a5b15eb17de7 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=060b6347b13b4f67bf47169f5668b205) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:31.021424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0728da-36c9-4ee3-a94b-a5b15eb17de7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:31.022932 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0728da-36c9-4ee3-a94b-a5b15eb17de7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:31.038383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 429/841] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:30 2022] GET /identity/v3/role_assignments?user.id=060b6347b13b4f67bf47169f5668b205&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:31.038383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0728da-36c9-4ee3-a94b-a5b15eb17de7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:31.047790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:31.149859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011013cd-f3ff-462a-a696-289f1ad53bfb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:31.197071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59eb244-084e-4052-b8c8-84a6effe828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:31.198663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eb244-084e-4052-b8c8-84a6effe828e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:31.199104 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eb244-084e-4052-b8c8-84a6effe828e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:31.199830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59eb244-084e-4052-b8c8-84a6effe828e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:31.211157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59eb244-084e-4052-b8c8-84a6effe828e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:31.213043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59eb244-084e-4052-b8c8-84a6effe828e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:31.225492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0728da-36c9-4ee3-a94b-a5b15eb17de7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-e59eb244-084e-4052-b8c8-84a6effe828e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:31.227312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:31.228537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:31.229525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:31.229525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:31.229525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:31.229525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:31.229525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:31.229525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:31.229525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:31.229525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:31.229525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 16:17:31.229525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:31.232346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 413/842] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:17:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:31.238335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59eb244-084e-4052-b8c8-84a6effe828e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:31.257443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:31.276260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd0cf0-b4a7-47b1-ac24-f9e3d5b26f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:31.277280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0cf0-b4a7-47b1-ac24-f9e3d5b26f31 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:31.277788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0cf0-b4a7-47b1-ac24-f9e3d5b26f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:31.277923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd0cf0-b4a7-47b1-ac24-f9e3d5b26f31 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:31.278519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd0cf0-b4a7-47b1-ac24-f9e3d5b26f31 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:31.278818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd0cf0-b4a7-47b1-ac24-f9e3d5b26f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:31.280227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd0cf0-b4a7-47b1-ac24-f9e3d5b26f31 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:31.286783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 430/843] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:17:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:31.292583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd0cf0-b4a7-47b1-ac24-f9e3d5b26f31 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:31.357994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59eb244-084e-4052-b8c8-84a6effe828e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:31.365656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:31.396807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a16847-9121-4af3-a606-c4af64b30abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:31.398065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a16847-9121-4af3-a606-c4af64b30abc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:31.398275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd0cf0-b4a7-47b1-ac24-f9e3d5b26f31 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:31.398704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a16847-9121-4af3-a606-c4af64b30abc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:31.399126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a16847-9121-4af3-a606-c4af64b30abc None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:31.400006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a16847-9121-4af3-a606-c4af64b30abc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:31.400474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a16847-9121-4af3-a606-c4af64b30abc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:31.402062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a16847-9121-4af3-a606-c4af64b30abc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:31.423895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 414/844] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Sep 1 16:17:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:31.431170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a16847-9121-4af3-a606-c4af64b30abc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:31.442511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bfd6e-077a-42d7-8a96-0b341dcd1a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:31.443550 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bfd6e-077a-42d7-8a96-0b341dcd1a38 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:31.444371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bfd6e-077a-42d7-8a96-0b341dcd1a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:31.444800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474bfd6e-077a-42d7-8a96-0b341dcd1a38 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:31.445922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bfd6e-077a-42d7-8a96-0b341dcd1a38 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:31.446549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bfd6e-077a-42d7-8a96-0b341dcd1a38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:31.448355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474bfd6e-077a-42d7-8a96-0b341dcd1a38 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:31.455069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 431/845] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:17:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:31.542566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:31.569537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a16847-9121-4af3-a606-c4af64b30abc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:31.610657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4488c-71e9-4753-8e58-901e3bcab878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:31.611525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4488c-71e9-4753-8e58-901e3bcab878 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:31.611959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4488c-71e9-4753-8e58-901e3bcab878 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:31.612375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4488c-71e9-4753-8e58-901e3bcab878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:31.685251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4488c-71e9-4753-8e58-901e3bcab878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:31.687015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4488c-71e9-4753-8e58-901e3bcab878 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:31.765677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:31.797429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 415/846] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:17:31.804295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bfd6e-077a-42d7-8a96-0b341dcd1a38 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:31.934768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474bfd6e-077a-42d7-8a96-0b341dcd1a38 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:31.972011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccfaf4-2e0d-4975-98d7-554b46dbddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:31.972646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccfaf4-2e0d-4975-98d7-554b46dbddec None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:31.972921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccfaf4-2e0d-4975-98d7-554b46dbddec None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:31.973192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccfaf4-2e0d-4975-98d7-554b46dbddec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:31.975493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:31.987981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccfaf4-2e0d-4975-98d7-554b46dbddec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:31.991401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccfaf4-2e0d-4975-98d7-554b46dbddec None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:31.999287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5acc26-60a3-4a05-af44-c8af320f5b79 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:31.999611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5acc26-60a3-4a05-af44-c8af320f5b79 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:31.999828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5acc26-60a3-4a05-af44-c8af320f5b79 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:32.001314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 416/847] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:32.007204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441281f5-d911-48da-89af-751ae7f6e95b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:32.007494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441281f5-d911-48da-89af-751ae7f6e95b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:32.007759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441281f5-d911-48da-89af-751ae7f6e95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-a7ccfaf4-2e0d-4975-98d7-554b46dbddec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:32.016178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:32.017154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:32.018099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:32.018099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:32.018099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:32.020150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 432/848] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:32.026358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccfaf4-2e0d-4975-98d7-554b46dbddec None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:32.031922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-441281f5-d911-48da-89af-751ae7f6e95b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:32.033114 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-441281f5-d911-48da-89af-751ae7f6e95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:32.136255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 417/849] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:32.145728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccfaf4-2e0d-4975-98d7-554b46dbddec None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:32.193981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cff93-27ac-4dda-a27d-291a50aaeb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:32.194803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cff93-27ac-4dda-a27d-291a50aaeb2a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:32.195782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cff93-27ac-4dda-a27d-291a50aaeb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:32.195782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cff93-27ac-4dda-a27d-291a50aaeb2a None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:32.196484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cff93-27ac-4dda-a27d-291a50aaeb2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:32.196946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cff93-27ac-4dda-a27d-291a50aaeb2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:32.199140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cff93-27ac-4dda-a27d-291a50aaeb2a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:32.216776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 433/850] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:32.222519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441281f5-d911-48da-89af-751ae7f6e95b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:32.332641 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441281f5-d911-48da-89af-751ae7f6e95b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:32.334414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:32.369926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb80dc-0436-437c-8833-5dadb807f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:32.370572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb80dc-0436-437c-8833-5dadb807f585 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:32.370848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb80dc-0436-437c-8833-5dadb807f585 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:32.371114 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb80dc-0436-437c-8833-5dadb807f585 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:32.378930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb80dc-0436-437c-8833-5dadb807f585 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:32.380415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb80dc-0436-437c-8833-5dadb807f585 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-2dcb80dc-0436-437c-8833-5dadb807f585 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:32.392848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:32.393802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:32.394758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:32.394758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:32.394758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:32.394758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:32.394758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:32.394758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:32.394758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:32.394758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:32.394758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 418/851] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:32.400641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cff93-27ac-4dda-a27d-291a50aaeb2a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:32.454378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:32.456557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb80dc-0436-437c-8833-5dadb807f585 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:32.525091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cff93-27ac-4dda-a27d-291a50aaeb2a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:32.570351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed012f1-088c-4af8-9def-dc517fd4e3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:32.571602 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed012f1-088c-4af8-9def-dc517fd4e3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:32.572123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed012f1-088c-4af8-9def-dc517fd4e3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:32.572622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed012f1-088c-4af8-9def-dc517fd4e3f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:32.573516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed012f1-088c-4af8-9def-dc517fd4e3f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:32.574085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed012f1-088c-4af8-9def-dc517fd4e3f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:32.575942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed012f1-088c-4af8-9def-dc517fd4e3f0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:32.592414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 434/852] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:32.601379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed012f1-088c-4af8-9def-dc517fd4e3f0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:32.625348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb80dc-0436-437c-8833-5dadb807f585 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:32.666452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0945ac-b344-467d-a5ae-05c39d1a8575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:32.667477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0945ac-b344-467d-a5ae-05c39d1a8575 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:32.668219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0945ac-b344-467d-a5ae-05c39d1a8575 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:32.668715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0945ac-b344-467d-a5ae-05c39d1a8575 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:32.682368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0945ac-b344-467d-a5ae-05c39d1a8575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ad0945ac-b344-467d-a5ae-05c39d1a8575 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:32.687932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:32.688907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:17:32.689783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:32.698801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 419/853] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:17:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:32.699600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0945ac-b344-467d-a5ae-05c39d1a8575 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:32.719303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed012f1-088c-4af8-9def-dc517fd4e3f0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:32.726856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:32.732566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:32.756027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220e9b7-3245-4d02-bc60-9642df9b8108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:32.756643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e9b7-3245-4d02-bc60-9642df9b8108 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:32.756919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e9b7-3245-4d02-bc60-9642df9b8108 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:32.757189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220e9b7-3245-4d02-bc60-9642df9b8108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:32.757941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220e9b7-3245-4d02-bc60-9642df9b8108 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=589e62c8d27044eea16e7c1f803e1393) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:32.758248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220e9b7-3245-4d02-bc60-9642df9b8108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:32.759680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220e9b7-3245-4d02-bc60-9642df9b8108 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:32.771826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 435/854] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:32 2022] GET /identity/v3/role_assignments?user.id=589e62c8d27044eea16e7c1f803e1393&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:32.828003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0945ac-b344-467d-a5ae-05c39d1a8575 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:32.871172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bf993-943d-4809-ae94-05fa95a23fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:32.872207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf993-943d-4809-ae94-05fa95a23fbd None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:32.872764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf993-943d-4809-ae94-05fa95a23fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:32.873244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bf993-943d-4809-ae94-05fa95a23fbd None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:32.874236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bf993-943d-4809-ae94-05fa95a23fbd None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:32.874763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bf993-943d-4809-ae94-05fa95a23fbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:32.876358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bf993-943d-4809-ae94-05fa95a23fbd None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:32.887074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 420/855] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:17:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:32.898803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220e9b7-3245-4d02-bc60-9642df9b8108 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:33.040307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220e9b7-3245-4d02-bc60-9642df9b8108 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:33.077095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaef3c-6865-4850-aeaa-c1ffe2041769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:33.077739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaef3c-6865-4850-aeaa-c1ffe2041769 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:33.078044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaef3c-6865-4850-aeaa-c1ffe2041769 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:33.078311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaef3c-6865-4850-aeaa-c1ffe2041769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:33.090090 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaef3c-6865-4850-aeaa-c1ffe2041769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:33.091547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaef3c-6865-4850-aeaa-c1ffe2041769 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-eecaef3c-6865-4850-aeaa-c1ffe2041769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:33.113617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:33.114687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:33.115907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:33.115907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:33.115907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:33.115907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 436/856] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:33.122451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaef3c-6865-4850-aeaa-c1ffe2041769 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:33.123332 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54add5-7d1b-4ec6-ae76-9f4e29d80bfb None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:33.123825 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54add5-7d1b-4ec6-ae76-9f4e29d80bfb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:33.124326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54add5-7d1b-4ec6-ae76-9f4e29d80bfb None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:33.125898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 421/857] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:33.132328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed865d-01eb-486f-b830-15cacc189162 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:33.132735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed865d-01eb-486f-b830-15cacc189162 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:33.134327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed865d-01eb-486f-b830-15cacc189162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:33.159973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e6ed865d-01eb-486f-b830-15cacc189162 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:33.161172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e6ed865d-01eb-486f-b830-15cacc189162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:33.174259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:33.240065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 422/858] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:33.258338 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaef3c-6865-4850-aeaa-c1ffe2041769 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:33.300558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469e00b-c0da-480f-a303-4e4902efe667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:33.301449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469e00b-c0da-480f-a303-4e4902efe667 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:33.301901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469e00b-c0da-480f-a303-4e4902efe667 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:33.303046 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469e00b-c0da-480f-a303-4e4902efe667 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:33.304064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469e00b-c0da-480f-a303-4e4902efe667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:33.304533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469e00b-c0da-480f-a303-4e4902efe667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:33.306090 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469e00b-c0da-480f-a303-4e4902efe667 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:33.321198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 437/859] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:33.331431 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed865d-01eb-486f-b830-15cacc189162 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:33.349730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:33.449373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed865d-01eb-486f-b830-15cacc189162 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:33.491090 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b6f33-ebdf-4e49-a499-18cf6f57c3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:33.492792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b6f33-ebdf-4e49-a499-18cf6f57c3ea None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:33.493285 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b6f33-ebdf-4e49-a499-18cf6f57c3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:33.493790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b6f33-ebdf-4e49-a499-18cf6f57c3ea None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:33.501818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b6f33-ebdf-4e49-a499-18cf6f57c3ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:33.503630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b6f33-ebdf-4e49-a499-18cf6f57c3ea None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:33.512843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469e00b-c0da-480f-a303-4e4902efe667 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-db5b6f33-ebdf-4e49-a499-18cf6f57c3ea None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:33.519287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:33.520252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:33.521255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:33.521255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:33.521255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:33.521255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:33.521255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:33.521255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:33.521255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:33.521255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:33.521255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:33.521255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:33.523977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 423/860] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 1 16:17:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:33.529828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b6f33-ebdf-4e49-a499-18cf6f57c3ea None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:33.618159 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:33.618926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:33.637798 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469e00b-c0da-480f-a303-4e4902efe667 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:33.653150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b6f33-ebdf-4e49-a499-18cf6f57c3ea None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:33.684546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed0fc8-23c1-46cc-a068-300f7fb43190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:33.685185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed0fc8-23c1-46cc-a068-300f7fb43190 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:33.685459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed0fc8-23c1-46cc-a068-300f7fb43190 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:33.685729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed0fc8-23c1-46cc-a068-300f7fb43190 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:33.686335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed0fc8-23c1-46cc-a068-300f7fb43190 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:33.687691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed0fc8-23c1-46cc-a068-300f7fb43190 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:33.692185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52228c7a-e022-4e4d-8236-dae0a1995599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:33.692798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228c7a-e022-4e4d-8236-dae0a1995599 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:33.693137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228c7a-e022-4e4d-8236-dae0a1995599 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:33.693405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228c7a-e022-4e4d-8236-dae0a1995599 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:33.694175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52228c7a-e022-4e4d-8236-dae0a1995599 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:33.694481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52228c7a-e022-4e4d-8236-dae0a1995599 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:33.695916 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52228c7a-e022-4e4d-8236-dae0a1995599 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-22ed0fc8-23c1-46cc-a068-300f7fb43190 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:33.696711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:33.697635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:33.699267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 438/861] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Sep 1 16:17:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:33.700404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d0b51-2f54-4694-a9e4-d00c45a1c0ef None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:33.700404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d0b51-2f54-4694-a9e4-d00c45a1c0ef None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:33.700404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d0b51-2f54-4694-a9e4-d00c45a1c0ef None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:33.706144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 439/862] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:33.706144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d0b51-2f54-4694-a9e4-d00c45a1c0ef None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:33.722383 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 424/863] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 1 16:17:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:33.723487 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706122af-2c57-471d-96ce-2ade954970c6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:33.723776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706122af-2c57-471d-96ce-2ade954970c6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:33.724048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706122af-2c57-471d-96ce-2ade954970c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:33.743964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-706122af-2c57-471d-96ce-2ade954970c6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:33.745153 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-706122af-2c57-471d-96ce-2ade954970c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:33.822713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d0b51-2f54-4694-a9e4-d00c45a1c0ef None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:33.825959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 425/864] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:33.825959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706122af-2c57-471d-96ce-2ade954970c6 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:33.870582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bf9ee-3d7a-4e5e-986d-47ef9bf63dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:33.872088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bf9ee-3d7a-4e5e-986d-47ef9bf63dab None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:33.872677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bf9ee-3d7a-4e5e-986d-47ef9bf63dab None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:33.874132 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bf9ee-3d7a-4e5e-986d-47ef9bf63dab None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:33.875101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bf9ee-3d7a-4e5e-986d-47ef9bf63dab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:33.876216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bf9ee-3d7a-4e5e-986d-47ef9bf63dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:33.877860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bf9ee-3d7a-4e5e-986d-47ef9bf63dab None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:33.885863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 440/865] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 1 16:17:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:33.891399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bf9ee-3d7a-4e5e-986d-47ef9bf63dab None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:33.922238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:33.926306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:33.980394 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706122af-2c57-471d-96ce-2ade954970c6 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:34.030010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bf9ee-3d7a-4e5e-986d-47ef9bf63dab None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:34.034280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790b264-664e-4d88-9779-8ebec9254df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:34.035016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790b264-664e-4d88-9779-8ebec9254df9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:34.035398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790b264-664e-4d88-9779-8ebec9254df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:34.035767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790b264-664e-4d88-9779-8ebec9254df9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:34.071519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c8834-f600-4168-b7ad-5840179918e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:34.072901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8834-f600-4168-b7ad-5840179918e3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:34.073429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8834-f600-4168-b7ad-5840179918e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:34.073943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8834-f600-4168-b7ad-5840179918e3 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:34.074755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c8834-f600-4168-b7ad-5840179918e3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:34.075299 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c8834-f600-4168-b7ad-5840179918e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:34.077158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c8834-f600-4168-b7ad-5840179918e3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:34.082819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 441/866] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 1 16:17:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:34.127276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c8834-f600-4168-b7ad-5840179918e3 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:34.128531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790b264-664e-4d88-9779-8ebec9254df9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:34.130216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790b264-664e-4d88-9779-8ebec9254df9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:34.218586 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:34.221659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:34.255311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c8834-f600-4168-b7ad-5840179918e3 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:34.266225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 426/867] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:17:34.273411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790b264-664e-4d88-9779-8ebec9254df9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:34.297567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df72981-4635-48db-8aa2-6fb3b54b0f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:34.298215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df72981-4635-48db-8aa2-6fb3b54b0f5b None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:34.298491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df72981-4635-48db-8aa2-6fb3b54b0f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:34.298763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df72981-4635-48db-8aa2-6fb3b54b0f5b None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:34.299413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df72981-4635-48db-8aa2-6fb3b54b0f5b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:34.300770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df72981-4635-48db-8aa2-6fb3b54b0f5b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:34.383070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 442/868] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:17:34 2022] POST /identity/v3/services => generated 251 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:17:34.390980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790b264-664e-4d88-9779-8ebec9254df9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:34.445812 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf1f4c-c001-4e79-95e7-310e4213f4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:34.446501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1f4c-c001-4e79-95e7-310e4213f4aa None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:34.446777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1f4c-c001-4e79-95e7-310e4213f4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:34.447048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf1f4c-c001-4e79-95e7-310e4213f4aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:34.460709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf1f4c-c001-4e79-95e7-310e4213f4aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:34.462294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cf1f4c-c001-4e79-95e7-310e4213f4aa None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-57cf1f4c-c001-4e79-95e7-310e4213f4aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:34.480331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:34.481404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:34.482950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:34.482950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:34.482950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:34.482950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 427/869] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:34.487624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df72981-4635-48db-8aa2-6fb3b54b0f5b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:34.614735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df72981-4635-48db-8aa2-6fb3b54b0f5b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:34.652774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5515968-8f6e-4e4f-874e-5cd3f3b1aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:34.653769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515968-8f6e-4e4f-874e-5cd3f3b1aa55 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:34.654281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515968-8f6e-4e4f-874e-5cd3f3b1aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:34.654753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5515968-8f6e-4e4f-874e-5cd3f3b1aa55 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:34.655596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5515968-8f6e-4e4f-874e-5cd3f3b1aa55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:34.656117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5515968-8f6e-4e4f-874e-5cd3f3b1aa55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:34.657740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5515968-8f6e-4e4f-874e-5cd3f3b1aa55 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:34.659669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:34.672306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 443/870] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:34.677665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf1f4c-c001-4e79-95e7-310e4213f4aa None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:34.691699 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:34.789658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf1f4c-c001-4e79-95e7-310e4213f4aa None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:34.826204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e6d8d-3c1a-42ef-8697-27626cc49d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:34.827199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e6d8d-3c1a-42ef-8697-27626cc49d93 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:34.827673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e6d8d-3c1a-42ef-8697-27626cc49d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:34.828137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e6d8d-3c1a-42ef-8697-27626cc49d93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:34.835599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e6d8d-3c1a-42ef-8697-27626cc49d93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:34.837293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e6d8d-3c1a-42ef-8697-27626cc49d93 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-251e6d8d-3c1a-42ef-8697-27626cc49d93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:34.849084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:34.850544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:34.851619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:34.851619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:34.851619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:34.851619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:34.851619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:34.851619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:34.851619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:34.851619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:34.854254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 428/871] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:34.860283 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5515968-8f6e-4e4f-874e-5cd3f3b1aa55 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:34.940851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b5ea5-3c4d-41b3-9e45-29c151cd704e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:34.941207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b5ea5-3c4d-41b3-9e45-29c151cd704e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:34.941399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b5ea5-3c4d-41b3-9e45-29c151cd704e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:34.943077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 429/872] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:34.948247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6092c6a-5b7b-4e75-abca-3d6bdeb66770 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:34.948532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6092c6a-5b7b-4e75-abca-3d6bdeb66770 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:34.948810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6092c6a-5b7b-4e75-abca-3d6bdeb66770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:34.968399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e6092c6a-5b7b-4e75-abca-3d6bdeb66770 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:34.969667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e6092c6a-5b7b-4e75-abca-3d6bdeb66770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:34.977716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5515968-8f6e-4e4f-874e-5cd3f3b1aa55 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:35.034975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ac7f6-cebf-43e0-a1db-f57632a62f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:35.036004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ac7f6-cebf-43e0-a1db-f57632a62f3e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:35.036492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ac7f6-cebf-43e0-a1db-f57632a62f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:35.037102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437ac7f6-cebf-43e0-a1db-f57632a62f3e None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:35.038380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ac7f6-cebf-43e0-a1db-f57632a62f3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:35.038934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ac7f6-cebf-43e0-a1db-f57632a62f3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:35.041467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437ac7f6-cebf-43e0-a1db-f57632a62f3e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:35.051107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:35.057933 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 430/873] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:34 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:35.060003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 444/874] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:35.066027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6092c6a-5b7b-4e75-abca-3d6bdeb66770 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:35.177905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6092c6a-5b7b-4e75-abca-3d6bdeb66770 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:35.216406 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27dd7b-6dc9-41af-960f-cb46e8dd366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:35.217276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27dd7b-6dc9-41af-960f-cb46e8dd366c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:35.217698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27dd7b-6dc9-41af-960f-cb46e8dd366c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:35.218138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27dd7b-6dc9-41af-960f-cb46e8dd366c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:35.219055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27dd7b-6dc9-41af-960f-cb46e8dd366c None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=b536cb90a9d54ad29f0eb69e7a410add) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:35.219528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27dd7b-6dc9-41af-960f-cb46e8dd366c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:35.221146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27dd7b-6dc9-41af-960f-cb46e8dd366c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:35.229430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 431/875] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:35 2022] GET /identity/v3/role_assignments?user.id=b536cb90a9d54ad29f0eb69e7a410add&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:35.331071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ac7f6-cebf-43e0-a1db-f57632a62f3e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:35.402062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:35.452826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437ac7f6-cebf-43e0-a1db-f57632a62f3e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:35.488877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd0cba-50b9-4bc2-a26a-64af5d2e9e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:35.489450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd0cba-50b9-4bc2-a26a-64af5d2e9e09 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:35.489733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd0cba-50b9-4bc2-a26a-64af5d2e9e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:35.490093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd0cba-50b9-4bc2-a26a-64af5d2e9e09 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:35.490688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd0cba-50b9-4bc2-a26a-64af5d2e9e09 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:35.492228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd0cba-50b9-4bc2-a26a-64af5d2e9e09 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-bddd0cba-50b9-4bc2-a26a-64af5d2e9e09 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:35.501729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:35.502786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:35.503621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 445/876] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 1 16:17:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:35.509746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27dd7b-6dc9-41af-960f-cb46e8dd366c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:35.579432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:35.620112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27dd7b-6dc9-41af-960f-cb46e8dd366c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:35.660408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cddaa5-934a-4549-907d-139f6f27c631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:35.661029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cddaa5-934a-4549-907d-139f6f27c631 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:35.661303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cddaa5-934a-4549-907d-139f6f27c631 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:35.661571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cddaa5-934a-4549-907d-139f6f27c631 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:35.662781 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cddaa5-934a-4549-907d-139f6f27c631 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:35.663079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cddaa5-934a-4549-907d-139f6f27c631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:35.664614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cddaa5-934a-4549-907d-139f6f27c631 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:35.670074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 432/877] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 1 16:17:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:35.680071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd0cba-50b9-4bc2-a26a-64af5d2e9e09 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:35.789523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd0cba-50b9-4bc2-a26a-64af5d2e9e09 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:35.808658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:35.826585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4114254-3b74-43fa-9112-784055229405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:35.827196 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114254-3b74-43fa-9112-784055229405 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:35.827529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114254-3b74-43fa-9112-784055229405 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:35.827808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4114254-3b74-43fa-9112-784055229405 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:35.828423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4114254-3b74-43fa-9112-784055229405 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:35.828719 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4114254-3b74-43fa-9112-784055229405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:35.830120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4114254-3b74-43fa-9112-784055229405 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:35.835916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 446/878] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 1 16:17:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:36.104739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b34f77-5f7c-4858-bd54-1a093d753ad9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:36.105175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b34f77-5f7c-4858-bd54-1a093d753ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:36.105346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b34f77-5f7c-4858-bd54-1a093d753ad9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:36.107002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 433/879] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:36.114439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b2448-1600-4ff4-994b-81e53858b6fc None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:36.114865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b2448-1600-4ff4-994b-81e53858b6fc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:36.115276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b2448-1600-4ff4-994b-81e53858b6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:36.137823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e13b2448-1600-4ff4-994b-81e53858b6fc None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:36.139042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e13b2448-1600-4ff4-994b-81e53858b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:36.212372 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 447/880] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:36.483072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b34f77-5f7c-4858-bd54-1a093d753ad9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:36.535759 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c91c3-231f-4761-b246-7d27dc8e24c3 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:36.536282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c91c3-231f-4761-b246-7d27dc8e24c3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:36.536282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c91c3-231f-4761-b246-7d27dc8e24c3 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:36.538206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 448/881] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:36.543893 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587722-05fe-4227-8e02-d20996e6b130 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:36.544216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587722-05fe-4227-8e02-d20996e6b130 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:36.544450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e587722-05fe-4227-8e02-d20996e6b130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:36.564200 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9e587722-05fe-4227-8e02-d20996e6b130 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:36.565409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9e587722-05fe-4227-8e02-d20996e6b130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:36.596682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b34f77-5f7c-4858-bd54-1a093d753ad9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:36.625303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:36.633149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e13f-325b-42fc-8f4f-6c1196163297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:36.633757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e13f-325b-42fc-8f4f-6c1196163297 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:36.634132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e13f-325b-42fc-8f4f-6c1196163297 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:36.634390 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550e13f-325b-42fc-8f4f-6c1196163297 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:36.649579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550e13f-325b-42fc-8f4f-6c1196163297 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:36.649579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5550e13f-325b-42fc-8f4f-6c1196163297 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:36.649791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 449/882] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:36.743082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 434/883] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:17:36 2022] POST /identity/v3/services => generated 269 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:36.918582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587722-05fe-4227-8e02-d20996e6b130 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:36.966516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:37.031371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e587722-05fe-4227-8e02-d20996e6b130 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:37.074431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed169542-528a-4e69-8cc3-798d8044955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:37.075137 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed169542-528a-4e69-8cc3-798d8044955b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:37.075423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed169542-528a-4e69-8cc3-798d8044955b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:37.075698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed169542-528a-4e69-8cc3-798d8044955b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:37.076283 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed169542-528a-4e69-8cc3-798d8044955b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:37.077653 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed169542-528a-4e69-8cc3-798d8044955b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ed169542-528a-4e69-8cc3-798d8044955b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:37.087764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:37.088838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:17:37.089701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:37.093843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 450/884] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:17:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:37.095344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e13f-325b-42fc-8f4f-6c1196163297 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:37.212171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550e13f-325b-42fc-8f4f-6c1196163297 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:37.250654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b229a26-6a1e-47f2-b401-b43b59e720e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:37.251710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b229a26-6a1e-47f2-b401-b43b59e720e8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:37.252185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b229a26-6a1e-47f2-b401-b43b59e720e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:37.252726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b229a26-6a1e-47f2-b401-b43b59e720e8 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:37.253554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b229a26-6a1e-47f2-b401-b43b59e720e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:37.254071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b229a26-6a1e-47f2-b401-b43b59e720e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:37.255696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b229a26-6a1e-47f2-b401-b43b59e720e8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:37.261513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 435/885] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:17:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:37.267193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed169542-528a-4e69-8cc3-798d8044955b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:37.387613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed169542-528a-4e69-8cc3-798d8044955b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:37.389808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:37.425463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f782d7-8d38-4974-9cb8-f0aa369df9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:37.426525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f782d7-8d38-4974-9cb8-f0aa369df9fe None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:37.427111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f782d7-8d38-4974-9cb8-f0aa369df9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:37.428104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f782d7-8d38-4974-9cb8-f0aa369df9fe None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:37.428933 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f782d7-8d38-4974-9cb8-f0aa369df9fe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:37.429558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f782d7-8d38-4974-9cb8-f0aa369df9fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:37.431155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f782d7-8d38-4974-9cb8-f0aa369df9fe None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:37.437223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 451/886] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:17:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:37.443977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b229a26-6a1e-47f2-b401-b43b59e720e8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:37.448205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861fbe7-b8ca-4485-876e-1a5a2405c88f None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:37.448489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861fbe7-b8ca-4485-876e-1a5a2405c88f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:37.448751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861fbe7-b8ca-4485-876e-1a5a2405c88f None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:37.450391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 452/887] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:37.455551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930c01-4bb5-44d6-a814-22f4640c6a75 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:37.455832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930c01-4bb5-44d6-a814-22f4640c6a75 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:37.456104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930c01-4bb5-44d6-a814-22f4640c6a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:37.476136 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9b930c01-4bb5-44d6-a814-22f4640c6a75 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:37.477489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9b930c01-4bb5-44d6-a814-22f4640c6a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:37.518249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:37.561834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 453/888] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:37.578052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b229a26-6a1e-47f2-b401-b43b59e720e8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:37.616995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba671e7e-9747-4bfa-a2a5-63602753ea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:37.618048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba671e7e-9747-4bfa-a2a5-63602753ea5f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:37.618527 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba671e7e-9747-4bfa-a2a5-63602753ea5f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:37.618990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba671e7e-9747-4bfa-a2a5-63602753ea5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:37.619889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba671e7e-9747-4bfa-a2a5-63602753ea5f None admin] RBAC: Adding query filter params (interface=public, service_id=86f02e686b3b41e8a935b83db30a9b51, region_id=RegionOne) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:37.620408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba671e7e-9747-4bfa-a2a5-63602753ea5f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:37.622090 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba671e7e-9747-4bfa-a2a5-63602753ea5f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:37.628717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 436/889] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 1 16:17:37 2022] GET /identity/v3/endpoints?service_id=86f02e686b3b41e8a935b83db30a9b51&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:37.635293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b930c01-4bb5-44d6-a814-22f4640c6a75 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:37.742832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:37.750652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b930c01-4bb5-44d6-a814-22f4640c6a75 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:37.790028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27c061-dfe5-44b2-8ada-c917f3b3f8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:37.790981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27c061-dfe5-44b2-8ada-c917f3b3f8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:37.791390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27c061-dfe5-44b2-8ada-c917f3b3f8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:37.791771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27c061-dfe5-44b2-8ada-c917f3b3f8d4 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:37.792676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27c061-dfe5-44b2-8ada-c917f3b3f8d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:37.794725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27c061-dfe5-44b2-8ada-c917f3b3f8d4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:37.801658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 454/890] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 1 16:17:37 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:17:37.858384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba671e7e-9747-4bfa-a2a5-63602753ea5f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:37.877090 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74c478-10c4-49ee-abb1-c5f3027b63c0 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:37.877671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74c478-10c4-49ee-abb1-c5f3027b63c0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:37.878196 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e74c478-10c4-49ee-abb1-c5f3027b63c0 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:37.880074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 455/891] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:37.886102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ce80-26f3-4b7f-acb2-161e41ae3b28 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:37.886412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ce80-26f3-4b7f-acb2-161e41ae3b28 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:37.886653 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6ce80-26f3-4b7f-acb2-161e41ae3b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:37.906545 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-21c6ce80-26f3-4b7f-acb2-161e41ae3b28 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:37.907792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-21c6ce80-26f3-4b7f-acb2-161e41ae3b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:38.010255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 456/892] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:38.017870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba671e7e-9747-4bfa-a2a5-63602753ea5f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:38.052141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:38.066536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8b044-39b3-4d8e-a7f7-8a6acc298e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:38.067223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8b044-39b3-4d8e-a7f7-8a6acc298e0f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:38.067591 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8b044-39b3-4d8e-a7f7-8a6acc298e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:38.067900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8b044-39b3-4d8e-a7f7-8a6acc298e0f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:38.080182 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8b044-39b3-4d8e-a7f7-8a6acc298e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-67b8b044-39b3-4d8e-a7f7-8a6acc298e0f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:38.091631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:38.092804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:38.094000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 437/893] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 1 16:17:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:38.095084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6ce80-26f3-4b7f-acb2-161e41ae3b28 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:38.253110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:38.269963 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6ce80-26f3-4b7f-acb2-161e41ae3b28 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:38.285024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8b044-39b3-4d8e-a7f7-8a6acc298e0f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:38.324125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f012c0a-9e76-41f1-b74f-e92e0e19d758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:38.325240 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012c0a-9e76-41f1-b74f-e92e0e19d758 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:38.325526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012c0a-9e76-41f1-b74f-e92e0e19d758 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:38.325800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f012c0a-9e76-41f1-b74f-e92e0e19d758 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:38.326787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f012c0a-9e76-41f1-b74f-e92e0e19d758 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:38.327087 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f012c0a-9e76-41f1-b74f-e92e0e19d758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:38.329237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f012c0a-9e76-41f1-b74f-e92e0e19d758 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:38.341811 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 457/894] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 1 16:17:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:38.347420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f012c0a-9e76-41f1-b74f-e92e0e19d758 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:38.438301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8b044-39b3-4d8e-a7f7-8a6acc298e0f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:38.473975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f012c0a-9e76-41f1-b74f-e92e0e19d758 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:38.491411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b81c1e-7aa0-45a1-91c5-dcbd35e01016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:38.492839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b81c1e-7aa0-45a1-91c5-dcbd35e01016 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:38.493275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b81c1e-7aa0-45a1-91c5-dcbd35e01016 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:38.493695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b81c1e-7aa0-45a1-91c5-dcbd35e01016 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:38.494548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b81c1e-7aa0-45a1-91c5-dcbd35e01016 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:38.496514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b81c1e-7aa0-45a1-91c5-dcbd35e01016 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:38.536957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545b040-ebd9-4286-ad9b-c841c69c42ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:38.537912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545b040-ebd9-4286-ad9b-c841c69c42ed None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:38.538408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545b040-ebd9-4286-ad9b-c841c69c42ed None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:38.538864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545b040-ebd9-4286-ad9b-c841c69c42ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:38.558486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545b040-ebd9-4286-ad9b-c841c69c42ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:38.561290 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545b040-ebd9-4286-ad9b-c841c69c42ed None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:38.566189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 438/895] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:17:38 2022] POST /identity/v3/services => generated 241 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-8545b040-ebd9-4286-ad9b-c841c69c42ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:38.584565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:38.585991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:38.586908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:38.586908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:38.586908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:38.590232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 458/896] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:38.596997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b81c1e-7aa0-45a1-91c5-dcbd35e01016 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:38.642356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:38.731905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b81c1e-7aa0-45a1-91c5-dcbd35e01016 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:38.769335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24051e76-bbff-4e0f-bec0-09e665906a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:38.770286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051e76-bbff-4e0f-bec0-09e665906a73 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:38.770768 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051e76-bbff-4e0f-bec0-09e665906a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:38.771772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24051e76-bbff-4e0f-bec0-09e665906a73 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:38.772418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24051e76-bbff-4e0f-bec0-09e665906a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:38.772719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24051e76-bbff-4e0f-bec0-09e665906a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:38.774097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24051e76-bbff-4e0f-bec0-09e665906a73 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:38.787690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 439/897] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:38.793270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545b040-ebd9-4286-ad9b-c841c69c42ed None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:38.797271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:38.819796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb726-10ae-4390-95b2-bf783a7e10dd None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:38.820110 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb726-10ae-4390-95b2-bf783a7e10dd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:38.820341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdb726-10ae-4390-95b2-bf783a7e10dd None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:38.822037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 440/898] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:38.831305 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd710-6814-4436-9383-cfb30c366d90 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:38.831584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd710-6814-4436-9383-cfb30c366d90 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:38.831854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dd710-6814-4436-9383-cfb30c366d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:38.853926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-587dd710-6814-4436-9383-cfb30c366d90 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:38.854412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-587dd710-6814-4436-9383-cfb30c366d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:38.906746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545b040-ebd9-4286-ad9b-c841c69c42ed None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:38.933614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 441/899] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:38.945208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16cc84-a049-4481-ba61-901070f0feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:38.945999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16cc84-a049-4481-ba61-901070f0feb4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:38.946378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16cc84-a049-4481-ba61-901070f0feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:38.946748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16cc84-a049-4481-ba61-901070f0feb4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:38.955173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16cc84-a049-4481-ba61-901070f0feb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:38.956741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16cc84-a049-4481-ba61-901070f0feb4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ed16cc84-a049-4481-ba61-901070f0feb4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:38.969053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:38.970324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:38.971613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:38.971613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:38.971613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:38.971613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:38.971613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:38.971613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:38.971613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:38.971613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:38.971613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:38.971613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:38.973173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 459/900] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 1 16:17:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:38.980147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dd710-6814-4436-9383-cfb30c366d90 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:39.008221 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:39.092338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dd710-6814-4436-9383-cfb30c366d90 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:39.134693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99303dc-e392-4dd7-9ab6-42d39728542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:39.135373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99303dc-e392-4dd7-9ab6-42d39728542c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:39.135653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99303dc-e392-4dd7-9ab6-42d39728542c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:39.135926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99303dc-e392-4dd7-9ab6-42d39728542c None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:39.136661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99303dc-e392-4dd7-9ab6-42d39728542c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:39.136967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99303dc-e392-4dd7-9ab6-42d39728542c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:39.138433 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99303dc-e392-4dd7-9ab6-42d39728542c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:39.157633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 442/901] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 1 16:17:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:39.163958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16cc84-a049-4481-ba61-901070f0feb4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:39.207746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99303dc-e392-4dd7-9ab6-42d39728542c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:39.235343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:39.284768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16cc84-a049-4481-ba61-901070f0feb4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:39.313721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:39.339483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99303dc-e392-4dd7-9ab6-42d39728542c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:39.340647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e0c2c-ac1d-4908-8205-6e027b932d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:39.341486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e0c2c-ac1d-4908-8205-6e027b932d02 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:39.341968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e0c2c-ac1d-4908-8205-6e027b932d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:39.342501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e0c2c-ac1d-4908-8205-6e027b932d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:39.378370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5641d-069e-4359-b8d1-70655c8a46dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:39.379071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5641d-069e-4359-b8d1-70655c8a46dd None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:39.380998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5641d-069e-4359-b8d1-70655c8a46dd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:39.380998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5641d-069e-4359-b8d1-70655c8a46dd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:39.380998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5641d-069e-4359-b8d1-70655c8a46dd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:39.382458 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5641d-069e-4359-b8d1-70655c8a46dd None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6db5641d-069e-4359-b8d1-70655c8a46dd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:39.392120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:39.398279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:39.399213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 443/902] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Sep 1 16:17:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:39.401418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5641d-069e-4359-b8d1-70655c8a46dd None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:39.434977 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e0c2c-ac1d-4908-8205-6e027b932d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:39.437318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e0c2c-ac1d-4908-8205-6e027b932d02 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:39.514631 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:39.531757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5641d-069e-4359-b8d1-70655c8a46dd None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:39.575667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 460/903] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:39 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:17:39.576511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e0c2c-ac1d-4908-8205-6e027b932d02 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:39.584728 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65414517-530d-46b2-bcef-88db67ddb083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:39.586240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65414517-530d-46b2-bcef-88db67ddb083 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:39.586727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65414517-530d-46b2-bcef-88db67ddb083 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:39.587197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65414517-530d-46b2-bcef-88db67ddb083 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:39.588488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65414517-530d-46b2-bcef-88db67ddb083 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:39.589466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65414517-530d-46b2-bcef-88db67ddb083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:39.591367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65414517-530d-46b2-bcef-88db67ddb083 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:39.598763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 444/904] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 1 16:17:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:39.605206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65414517-530d-46b2-bcef-88db67ddb083 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:39.621310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:39.714324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e0c2c-ac1d-4908-8205-6e027b932d02 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:39.747509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65414517-530d-46b2-bcef-88db67ddb083 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:39.754247 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8dd3-bd44-45d7-a026-0957dd922827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:39.755207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8dd3-bd44-45d7-a026-0957dd922827 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:39.755872 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8dd3-bd44-45d7-a026-0957dd922827 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:39.756653 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a8dd3-bd44-45d7-a026-0957dd922827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:39.768217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a8dd3-bd44-45d7-a026-0957dd922827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:39.770109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a8dd3-bd44-45d7-a026-0957dd922827 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:39.787868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b59e-37b3-4929-a645-2c90104c2f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:39.788847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b59e-37b3-4929-a645-2c90104c2f65 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:39.789322 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b59e-37b3-4929-a645-2c90104c2f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:39.789658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b59e-37b3-4929-a645-2c90104c2f65 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-b77a8dd3-bd44-45d7-a026-0957dd922827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:39.790269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:39.791188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:39.792089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:39.792089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:39.792089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:39.792270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9b59e-37b3-4929-a645-2c90104c2f65 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:39.792270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9b59e-37b3-4929-a645-2c90104c2f65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:39.792270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9b59e-37b3-4929-a645-2c90104c2f65 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:39.794497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 461/905] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:39.799557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8dd3-bd44-45d7-a026-0957dd922827 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:39.807486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 445/906] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 1 16:17:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:39.809634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b59e-37b3-4929-a645-2c90104c2f65 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:39.828599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:39.891669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:39.924460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a8dd3-bd44-45d7-a026-0957dd922827 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:39.926113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b59e-37b3-4929-a645-2c90104c2f65 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:39.971749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acaa47-ba30-4f25-bdbc-fd8047f59b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:39.972371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acaa47-ba30-4f25-bdbc-fd8047f59b68 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:39.972649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acaa47-ba30-4f25-bdbc-fd8047f59b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:39.972918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acaa47-ba30-4f25-bdbc-fd8047f59b68 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:39.973632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acaa47-ba30-4f25-bdbc-fd8047f59b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:39.973866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acaa47-ba30-4f25-bdbc-fd8047f59b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:39.976213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99acaa47-ba30-4f25-bdbc-fd8047f59b68 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:39.981958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ec552-97b1-4c83-8f31-67c99292d7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:39.982896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ec552-97b1-4c83-8f31-67c99292d7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:39.983377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ec552-97b1-4c83-8f31-67c99292d7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:39.983870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ec552-97b1-4c83-8f31-67c99292d7d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:39.984864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ec552-97b1-4c83-8f31-67c99292d7d0 None admin] RBAC: Adding query filter params (interface=public, service_id=b43d1903a7624ca984510b884d51e7bb, region_id=RegionOne) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:39.985373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ec552-97b1-4c83-8f31-67c99292d7d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:39.987115 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ec552-97b1-4c83-8f31-67c99292d7d0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:39.989991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 462/907] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:39.995488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acaa47-ba30-4f25-bdbc-fd8047f59b68 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:40.008863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 446/908] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 1 16:17:39 2022] GET /identity/v3/endpoints?service_id=b43d1903a7624ca984510b884d51e7bb&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:40.011033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ec552-97b1-4c83-8f31-67c99292d7d0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:40.117086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:40.155019 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acaa47-ba30-4f25-bdbc-fd8047f59b68 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:40.158189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ec552-97b1-4c83-8f31-67c99292d7d0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:40.197117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89329b9-4ff7-4ac4-a725-116d7913819e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:40.197752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89329b9-4ff7-4ac4-a725-116d7913819e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:40.198065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89329b9-4ff7-4ac4-a725-116d7913819e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:40.198339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89329b9-4ff7-4ac4-a725-116d7913819e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:40.200216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f09c92-c67f-4781-a9ab-bce428892192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:40.200817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f09c92-c67f-4781-a9ab-bce428892192 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:40.201089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f09c92-c67f-4781-a9ab-bce428892192 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:40.201368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f09c92-c67f-4781-a9ab-bce428892192 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:40.201986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f09c92-c67f-4781-a9ab-bce428892192 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:40.203338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f09c92-c67f-4781-a9ab-bce428892192 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:40.205708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:40.205819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89329b9-4ff7-4ac4-a725-116d7913819e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:40.207227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89329b9-4ff7-4ac4-a725-116d7913819e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:40.217922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 447/909] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 1 16:17:40 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:17:40.217922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cec3c-7d5d-472c-b4ec-06a8e7ae63d8 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:40.217922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cec3c-7d5d-472c-b4ec-06a8e7ae63d8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:40.217922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cec3c-7d5d-472c-b4ec-06a8e7ae63d8 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:40.217922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 448/910] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:40.219935 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f250c6-424d-4074-a3de-cb0953139b78 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:40.220215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f250c6-424d-4074-a3de-cb0953139b78 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:40.220479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f250c6-424d-4074-a3de-cb0953139b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-f89329b9-4ff7-4ac4-a725-116d7913819e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:40.226176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:40.227225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:40.228157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:40.228157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:40.228157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:40.228157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:40.228157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:40.228157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:40.228157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:40.228157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:40.228157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 463/911] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:40.235901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89329b9-4ff7-4ac4-a725-116d7913819e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:40.242333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-26f250c6-424d-4074-a3de-cb0953139b78 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:40.244453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-26f250c6-424d-4074-a3de-cb0953139b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:40.330858 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 449/912] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:40.376343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89329b9-4ff7-4ac4-a725-116d7913819e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:40.413562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269bc01-c73c-4c8d-9260-be9da0249cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:40.414129 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269bc01-c73c-4c8d-9260-be9da0249cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:40.414402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269bc01-c73c-4c8d-9260-be9da0249cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:40.414668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269bc01-c73c-4c8d-9260-be9da0249cc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:40.415349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269bc01-c73c-4c8d-9260-be9da0249cc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:40.415649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269bc01-c73c-4c8d-9260-be9da0249cc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:40.417065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269bc01-c73c-4c8d-9260-be9da0249cc0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:40.424050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:40.433008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 464/913] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:40.439005 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f250c6-424d-4074-a3de-cb0953139b78 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:40.554754 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f250c6-424d-4074-a3de-cb0953139b78 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:40.586632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:40.592684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9fd7-8199-4c07-bb0e-58f6745e1f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:40.593304 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9fd7-8199-4c07-bb0e-58f6745e1f11 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:40.593914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9fd7-8199-4c07-bb0e-58f6745e1f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:40.594201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9fd7-8199-4c07-bb0e-58f6745e1f11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:40.594982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea9fd7-8199-4c07-bb0e-58f6745e1f11 None admin] RBAC: Adding query filter params (role.id=0b8370159a9242fbb3f4de16c8c1fd99, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=b536cb90a9d54ad29f0eb69e7a410add) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:40.595296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea9fd7-8199-4c07-bb0e-58f6745e1f11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:40.596711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea9fd7-8199-4c07-bb0e-58f6745e1f11 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:40.603808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 450/914] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:40 2022] GET /identity/v3/role_assignments?user.id=b536cb90a9d54ad29f0eb69e7a410add&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=0b8370159a9242fbb3f4de16c8c1fd99 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:40.631006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269bc01-c73c-4c8d-9260-be9da0249cc0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:40.653616 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7256aaf-83f8-4aab-8fd0-d333a4ff3254 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:40.653924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7256aaf-83f8-4aab-8fd0-d333a4ff3254 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:40.654210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7256aaf-83f8-4aab-8fd0-d333a4ff3254 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:40.655762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 451/915] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:40.661377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7cde-1505-4b5b-a118-1db27b89e274 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:40.662239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7cde-1505-4b5b-a118-1db27b89e274 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:40.662555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7cde-1505-4b5b-a118-1db27b89e274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:40.682236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2d9f7cde-1505-4b5b-a118-1db27b89e274 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:40.683424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2d9f7cde-1505-4b5b-a118-1db27b89e274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:40.768749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269bc01-c73c-4c8d-9260-be9da0249cc0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:40.777992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 452/916] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:40.807881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202db570-5267-434d-b3d7-e6bc50619d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:40.808804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db570-5267-434d-b3d7-e6bc50619d05 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:40.809228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db570-5267-434d-b3d7-e6bc50619d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:40.809645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202db570-5267-434d-b3d7-e6bc50619d05 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:40.810403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202db570-5267-434d-b3d7-e6bc50619d05 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:40.811900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202db570-5267-434d-b3d7-e6bc50619d05 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-202db570-5267-434d-b3d7-e6bc50619d05 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:40.822628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:40.823908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 16:17:40.824954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:40.832030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 465/917] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:17:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:40.833600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f7cde-1505-4b5b-a118-1db27b89e274 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:40.945114 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f7cde-1505-4b5b-a118-1db27b89e274 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:40.977579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:40.983161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b66ed-fe50-4ab0-8403-109fabfefcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:40.983777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b66ed-fe50-4ab0-8403-109fabfefcde None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:40.984055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b66ed-fe50-4ab0-8403-109fabfefcde None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:40.984327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b66ed-fe50-4ab0-8403-109fabfefcde None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:40.984957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b66ed-fe50-4ab0-8403-109fabfefcde None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:40.985259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b66ed-fe50-4ab0-8403-109fabfefcde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:40.986633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b66ed-fe50-4ab0-8403-109fabfefcde None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:40.992425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 453/918] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:17:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:40.998294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202db570-5267-434d-b3d7-e6bc50619d05 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:41.051914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b66ed-fe50-4ab0-8403-109fabfefcde None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:41.072482 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:41.131693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202db570-5267-434d-b3d7-e6bc50619d05 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:41.178549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6331d63-6139-492f-8d2b-d47f64f70270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:41.179166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6331d63-6139-492f-8d2b-d47f64f70270 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:41.179444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6331d63-6139-492f-8d2b-d47f64f70270 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:41.179713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6331d63-6139-492f-8d2b-d47f64f70270 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:41.180893 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6331d63-6139-492f-8d2b-d47f64f70270 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:41.181201 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6331d63-6139-492f-8d2b-d47f64f70270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:41.182897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6331d63-6139-492f-8d2b-d47f64f70270 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:41.189763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 466/919] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Sep 1 16:17:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:41.196874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6331d63-6139-492f-8d2b-d47f64f70270 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:41.202993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b66ed-fe50-4ab0-8403-109fabfefcde None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:41.244013 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb5d97-8656-4ba2-9470-3fec6409b800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:41.244657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb5d97-8656-4ba2-9470-3fec6409b800 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:41.244934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb5d97-8656-4ba2-9470-3fec6409b800 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:41.245200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb5d97-8656-4ba2-9470-3fec6409b800 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:41.245778 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb5d97-8656-4ba2-9470-3fec6409b800 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:41.247329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb5d97-8656-4ba2-9470-3fec6409b800 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-a0cb5d97-8656-4ba2-9470-3fec6409b800 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:41.258775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:41.259901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:41.261418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 454/920] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 1 16:17:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:41.266078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb5d97-8656-4ba2-9470-3fec6409b800 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:41.324576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:41.327887 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6331d63-6139-492f-8d2b-d47f64f70270 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:41.357180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:41.370837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbc645-fff9-4b39-979d-e01386e3e2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:41.371666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbc645-fff9-4b39-979d-e01386e3e2f5 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:41.378429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbc645-fff9-4b39-979d-e01386e3e2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:41.378970 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbc645-fff9-4b39-979d-e01386e3e2f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:41.379411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb5d97-8656-4ba2-9470-3fec6409b800 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:41.380653 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbc645-fff9-4b39-979d-e01386e3e2f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:41.382825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbc645-fff9-4b39-979d-e01386e3e2f5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:41.418273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dde01-0feb-41ee-9f07-4f89e12384b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:41.418922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dde01-0feb-41ee-9f07-4f89e12384b5 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:41.419177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dde01-0feb-41ee-9f07-4f89e12384b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:41.419438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dde01-0feb-41ee-9f07-4f89e12384b5 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:41.420065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dde01-0feb-41ee-9f07-4f89e12384b5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:41.420367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dde01-0feb-41ee-9f07-4f89e12384b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:41.421711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dde01-0feb-41ee-9f07-4f89e12384b5 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:41.426889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 455/921] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 1 16:17:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:41.433248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dde01-0feb-41ee-9f07-4f89e12384b5 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:41.469832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 467/922] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:17:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:41.563651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dde01-0feb-41ee-9f07-4f89e12384b5 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:41.583108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:41.612164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca8a1f-36a8-48b6-a0fd-6609f5cc1fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:41.613140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8a1f-36a8-48b6-a0fd-6609f5cc1fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:41.613633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8a1f-36a8-48b6-a0fd-6609f5cc1fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:41.614234 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca8a1f-36a8-48b6-a0fd-6609f5cc1fb4 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:41.615250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca8a1f-36a8-48b6-a0fd-6609f5cc1fb4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:41.615772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca8a1f-36a8-48b6-a0fd-6609f5cc1fb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:41.617361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca8a1f-36a8-48b6-a0fd-6609f5cc1fb4 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:41.624193 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 456/923] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 1 16:17:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:41.630001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbc645-fff9-4b39-979d-e01386e3e2f5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:41.748741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbc645-fff9-4b39-979d-e01386e3e2f5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:41.786294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c8277-bb94-4280-83bb-a8da1c4dabfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:41.787721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8277-bb94-4280-83bb-a8da1c4dabfe None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:41.787721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8277-bb94-4280-83bb-a8da1c4dabfe None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:41.788062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c8277-bb94-4280-83bb-a8da1c4dabfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:41.788663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8277-bb94-4280-83bb-a8da1c4dabfe None admin] RBAC: Adding query filter params (interface=public, service_id=4d1de9f19690450d9d14fabfb7bc11ca, region_id=RegionOne) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:41.788968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8277-bb94-4280-83bb-a8da1c4dabfe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:41.790368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c8277-bb94-4280-83bb-a8da1c4dabfe None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:41.803965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 468/924] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 1 16:17:41 2022] GET /identity/v3/endpoints?service_id=4d1de9f19690450d9d14fabfb7bc11ca&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:41.805340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca8a1f-36a8-48b6-a0fd-6609f5cc1fb4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:41.918546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca8a1f-36a8-48b6-a0fd-6609f5cc1fb4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:41.954613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a80c1-5313-4a26-89c9-66de38aeb7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:41.955224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a80c1-5313-4a26-89c9-66de38aeb7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:41.955500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a80c1-5313-4a26-89c9-66de38aeb7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:41.955768 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a80c1-5313-4a26-89c9-66de38aeb7c7 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:41.956367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a80c1-5313-4a26-89c9-66de38aeb7c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:41.957715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a80c1-5313-4a26-89c9-66de38aeb7c7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:41.965064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 457/925] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 1 16:17:41 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:17:42.339570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef714f-9687-4fc4-8c30-5f02f81aea0a None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:42.339935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef714f-9687-4fc4-8c30-5f02f81aea0a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:42.340123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef714f-9687-4fc4-8c30-5f02f81aea0a None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:42.341707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 469/926] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:42.346984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418f077-65dc-4d35-9a49-04b2892816c9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:42.347273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418f077-65dc-4d35-9a49-04b2892816c9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:42.347552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418f077-65dc-4d35-9a49-04b2892816c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:42.367659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5418f077-65dc-4d35-9a49-04b2892816c9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:42.369046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5418f077-65dc-4d35-9a49-04b2892816c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:42.406740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:42.441707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 458/927] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:42.614361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5f939-ef55-40c5-bb5c-b4ab192ebc4f None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:42.614646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5f939-ef55-40c5-bb5c-b4ab192ebc4f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:42.615607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5f939-ef55-40c5-bb5c-b4ab192ebc4f None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:42.617324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 470/928] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:42.623137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e58ad-c544-419f-aa8e-0aec591488ab None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:42.623379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e58ad-c544-419f-aa8e-0aec591488ab None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:42.623605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e58ad-c544-419f-aa8e-0aec591488ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:42.643215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-004e58ad-c544-419f-aa8e-0aec591488ab None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:42.644414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-004e58ad-c544-419f-aa8e-0aec591488ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:42.716431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5f939-ef55-40c5-bb5c-b4ab192ebc4f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:42.724951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 459/929] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:42.773109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:42.831825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5f939-ef55-40c5-bb5c-b4ab192ebc4f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:42.868357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4c34-90bf-4303-a588-b48e201ecb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:42.868998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4c34-90bf-4303-a588-b48e201ecb1f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:42.869278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4c34-90bf-4303-a588-b48e201ecb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:42.869547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4c34-90bf-4303-a588-b48e201ecb1f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:42.870252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4c34-90bf-4303-a588-b48e201ecb1f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:42.871675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4c34-90bf-4303-a588-b48e201ecb1f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9d1b4c34-90bf-4303-a588-b48e201ecb1f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:42.882523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:42.884897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:42.887062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 471/930] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Sep 1 16:17:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:42.894653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e58ad-c544-419f-aa8e-0aec591488ab None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:42.998541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e58ad-c544-419f-aa8e-0aec591488ab None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:43.000909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4c34-90bf-4303-a588-b48e201ecb1f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:43.001817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:43.039254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6a25a-fe49-4a7c-8c27-21493f6e5310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:43.040295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6a25a-fe49-4a7c-8c27-21493f6e5310 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.040777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6a25a-fe49-4a7c-8c27-21493f6e5310 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.041248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6a25a-fe49-4a7c-8c27-21493f6e5310 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:43.042232 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6a25a-fe49-4a7c-8c27-21493f6e5310 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:43.042775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6a25a-fe49-4a7c-8c27-21493f6e5310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:43.044352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6a25a-fe49-4a7c-8c27-21493f6e5310 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:43.050954 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 460/931] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 1 16:17:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:43.059286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6a25a-fe49-4a7c-8c27-21493f6e5310 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:43.128146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4c34-90bf-4303-a588-b48e201ecb1f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:43.139079 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:43.178543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623df55-3a59-44b6-915a-b6cb490d12e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:43.179672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623df55-3a59-44b6-915a-b6cb490d12e1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.180352 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623df55-3a59-44b6-915a-b6cb490d12e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.181003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623df55-3a59-44b6-915a-b6cb490d12e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:43.190170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6a25a-fe49-4a7c-8c27-21493f6e5310 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:43.198798 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623df55-3a59-44b6-915a-b6cb490d12e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-0623df55-3a59-44b6-915a-b6cb490d12e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:43.206613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:43.207744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:17:43.209179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:43.209871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 472/932] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 1 16:17:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:43.215801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623df55-3a59-44b6-915a-b6cb490d12e1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:43.235858 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecef85-4f53-494d-8e3b-e0f82d1dfbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:43.236836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecef85-4f53-494d-8e3b-e0f82d1dfbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.237401 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecef85-4f53-494d-8e3b-e0f82d1dfbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.237932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecef85-4f53-494d-8e3b-e0f82d1dfbc0 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:43.238805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecef85-4f53-494d-8e3b-e0f82d1dfbc0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:43.239323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecef85-4f53-494d-8e3b-e0f82d1dfbc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:43.241954 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eecef85-4f53-494d-8e3b-e0f82d1dfbc0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:43.248037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 461/933] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 1 16:17:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:43.253417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecef85-4f53-494d-8e3b-e0f82d1dfbc0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:43.291279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:43.345451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623df55-3a59-44b6-915a-b6cb490d12e1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:43.383772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecef85-4f53-494d-8e3b-e0f82d1dfbc0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:43.385463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aac36d-b801-41b1-9c7a-cb64b08c8139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:43.386400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aac36d-b801-41b1-9c7a-cb64b08c8139 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.386894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aac36d-b801-41b1-9c7a-cb64b08c8139 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.387376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aac36d-b801-41b1-9c7a-cb64b08c8139 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:43.388233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aac36d-b801-41b1-9c7a-cb64b08c8139 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:43.388727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aac36d-b801-41b1-9c7a-cb64b08c8139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:43.390682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aac36d-b801-41b1-9c7a-cb64b08c8139 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:43.405116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 473/934] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 1 16:17:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:43.406339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aac36d-b801-41b1-9c7a-cb64b08c8139 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:43.426524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a3358-05df-4b5d-bcf2-157febd84f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:43.427767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3358-05df-4b5d-bcf2-157febd84f05 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.427956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3358-05df-4b5d-bcf2-157febd84f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.428233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a3358-05df-4b5d-bcf2-157febd84f05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:43.428913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a3358-05df-4b5d-bcf2-157febd84f05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:43.430809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a3358-05df-4b5d-bcf2-157febd84f05 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:43.443123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:43.515298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aac36d-b801-41b1-9c7a-cb64b08c8139 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:43.540432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 462/935] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:17:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:43.568939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b388e-7a51-4dcc-bb28-ea8e673d9819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:43.572281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b388e-7a51-4dcc-bb28-ea8e673d9819 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.572281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b388e-7a51-4dcc-bb28-ea8e673d9819 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.572281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b388e-7a51-4dcc-bb28-ea8e673d9819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:43.574188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab317-f910-4a54-955a-67a57641d861 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.574480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab317-f910-4a54-955a-67a57641d861 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.574759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ab317-f910-4a54-955a-67a57641d861 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:43.576998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 463/936] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:43.583391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f6f6a-eeaf-42b3-b12d-085508b2d721 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.584329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f6f6a-eeaf-42b3-b12d-085508b2d721 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.584730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f6f6a-eeaf-42b3-b12d-085508b2d721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:43.585478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b388e-7a51-4dcc-bb28-ea8e673d9819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:43.586999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b388e-7a51-4dcc-bb28-ea8e673d9819 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-555b388e-7a51-4dcc-bb28-ea8e673d9819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:43.604171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:43.605260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:43.607334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:43.607334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:43.607334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:43.607334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 474/937] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:43.611334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b388e-7a51-4dcc-bb28-ea8e673d9819 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:43.621790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e69f6f6a-eeaf-42b3-b12d-085508b2d721 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:43.624411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e69f6f6a-eeaf-42b3-b12d-085508b2d721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:43.707506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:43.729921 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 464/938] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:43.731386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b388e-7a51-4dcc-bb28-ea8e673d9819 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:43.770149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608daaf1-2e00-486f-9082-8e6b9d08a1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:43.770785 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608daaf1-2e00-486f-9082-8e6b9d08a1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.771333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608daaf1-2e00-486f-9082-8e6b9d08a1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.771754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608daaf1-2e00-486f-9082-8e6b9d08a1d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:43.772412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608daaf1-2e00-486f-9082-8e6b9d08a1d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:43.772710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608daaf1-2e00-486f-9082-8e6b9d08a1d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:43.774096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608daaf1-2e00-486f-9082-8e6b9d08a1d0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:43.788244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 475/939] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:43.793652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f6f6a-eeaf-42b3-b12d-085508b2d721 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:43.811132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:43.909561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f6f6a-eeaf-42b3-b12d-085508b2d721 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:43.946621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98821a-4584-41f2-9a38-792b84fdae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:43.947562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98821a-4584-41f2-9a38-792b84fdae6c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.948017 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98821a-4584-41f2-9a38-792b84fdae6c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.948496 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98821a-4584-41f2-9a38-792b84fdae6c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:43.956522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98821a-4584-41f2-9a38-792b84fdae6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:43.959230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98821a-4584-41f2-9a38-792b84fdae6c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-1a98821a-4584-41f2-9a38-792b84fdae6c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:43.972074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:43.973081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:43.974191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:43.974191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:43.974191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:43.974191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:43.974191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:43.974191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:43.974191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:43.974191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:43.974191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:43.974191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:43.976528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 465/940] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 1 16:17:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:43.982874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608daaf1-2e00-486f-9082-8e6b9d08a1d0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:43.989012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d7dc-fd63-4ea1-b6b2-3a46e890cfc5 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.989541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d7dc-fd63-4ea1-b6b2-3a46e890cfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.990690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d7dc-fd63-4ea1-b6b2-3a46e890cfc5 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:43.992487 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 466/941] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:43.998811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bafe2-71c6-4850-9795-4e00e30525cd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:43.999348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bafe2-71c6-4850-9795-4e00e30525cd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:43.999887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bafe2-71c6-4850-9795-4e00e30525cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:44.021403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fa9bafe2-71c6-4850-9795-4e00e30525cd None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:44.022648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fa9bafe2-71c6-4850-9795-4e00e30525cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:44.094566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 467/942] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:44.095708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bafe2-71c6-4850-9795-4e00e30525cd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:44.108580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:44.110197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608daaf1-2e00-486f-9082-8e6b9d08a1d0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:44.158835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397de550-fdc1-499a-bc4d-05bcfaf97301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:44.159511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397de550-fdc1-499a-bc4d-05bcfaf97301 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:44.160107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397de550-fdc1-499a-bc4d-05bcfaf97301 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:44.160386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397de550-fdc1-499a-bc4d-05bcfaf97301 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:44.161404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397de550-fdc1-499a-bc4d-05bcfaf97301 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:44.161766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397de550-fdc1-499a-bc4d-05bcfaf97301 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:44.164134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397de550-fdc1-499a-bc4d-05bcfaf97301 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:44.174845 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:44.189472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 476/943] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 1 16:17:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:44.194597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397de550-fdc1-499a-bc4d-05bcfaf97301 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:44.232205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bafe2-71c6-4850-9795-4e00e30525cd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:44.284831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faabf3-382f-438b-9b45-f95d20023f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:44.286164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faabf3-382f-438b-9b45-f95d20023f29 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:44.287310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faabf3-382f-438b-9b45-f95d20023f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:44.287537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72faabf3-382f-438b-9b45-f95d20023f29 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:44.288851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72faabf3-382f-438b-9b45-f95d20023f29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:44.290758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72faabf3-382f-438b-9b45-f95d20023f29 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:44.294677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: WARNING keystone.server.flask.common [None req-72faabf3-382f-438b-9b45-f95d20023f29 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 16:17:44.325671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397de550-fdc1-499a-bc4d-05bcfaf97301 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:44.362834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a529b-a14e-48d7-88a2-d42717bafe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:44.363471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a529b-a14e-48d7-88a2-d42717bafe94 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:44.363749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a529b-a14e-48d7-88a2-d42717bafe94 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:44.363982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.sql.core [None req-72faabf3-382f-438b-9b45-f95d20023f29 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:17:44.363982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 16:17:44.363982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [parameters: {'id': '0168e7c2ea3a4aa1af1988832e761268', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 16:17:44.363982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81784) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:17:44.364372 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a529b-a14e-48d7-88a2-d42717bafe94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-72faabf3-382f-438b-9b45-f95d20023f29 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0168e7c2ea3a4aa1af1988832e761268.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0168e7c2ea3a4aa1af1988832e761268. Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:17:44.375189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result.read() Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 16:17:44.376218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application yield resource Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise self.value Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application session.commit() Sep 01 16:17:44.377442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:17:44.378626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:17:44.379845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application result.read() Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:17:44.380939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [parameters: {'id': '0168e7c2ea3a4aa1af1988832e761268', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:44.382073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:44.383083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:44.384224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:44.384224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 16:17:44.384224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 16:17:44.384224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:44.384224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:44.384224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 16:17:44.384224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 16:17:44.384224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0168e7c2ea3a4aa1af1988832e761268. Sep 01 16:17:44.384224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:44.385975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a529b-a14e-48d7-88a2-d42717bafe94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:44.386627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 468/944] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Sep 1 16:17:44 2022] POST /identity/v3/projects => generated 262 bytes in 291 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:44.387517 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a529b-a14e-48d7-88a2-d42717bafe94 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:44.387710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faabf3-382f-438b-9b45-f95d20023f29 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-865a529b-a14e-48d7-88a2-d42717bafe94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:44.404306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:44.405560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:44.406761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:44.406761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:44.406761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:44.410017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 477/945] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:44.411035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a529b-a14e-48d7-88a2-d42717bafe94 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:44.468387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:44.472084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:44.512049 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72faabf3-382f-438b-9b45-f95d20023f29 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:44.525870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a529b-a14e-48d7-88a2-d42717bafe94 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:44.548915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8bf7-ad35-4425-b420-8a29b787219b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:44.549652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8bf7-ad35-4425-b420-8a29b787219b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:44.550037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8bf7-ad35-4425-b420-8a29b787219b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:44.550380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8bf7-ad35-4425-b420-8a29b787219b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:44.551034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c8bf7-ad35-4425-b420-8a29b787219b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:44.553528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c8bf7-ad35-4425-b420-8a29b787219b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:44.563391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40253-eb7a-4930-87b6-4fa07d86249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:44.564027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40253-eb7a-4930-87b6-4fa07d86249f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:44.564303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40253-eb7a-4930-87b6-4fa07d86249f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:44.564571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc40253-eb7a-4930-87b6-4fa07d86249f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-020c8bf7-ad35-4425-b420-8a29b787219b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:44.564859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:44.565860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:44.566779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:44.568989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 469/946] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 1 16:17:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:44.569964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8bf7-ad35-4425-b420-8a29b787219b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:44.575451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40253-eb7a-4930-87b6-4fa07d86249f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:44.576887 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc40253-eb7a-4930-87b6-4fa07d86249f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ddc40253-eb7a-4930-87b6-4fa07d86249f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:44.590697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:44.591882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:44.592990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:44.592990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:44.592990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:44.592990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:44.592990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:44.592990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:44.592990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:44.592990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:44.596762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 478/947] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:44.597552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40253-eb7a-4930-87b6-4fa07d86249f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:44.688144 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8bf7-ad35-4425-b420-8a29b787219b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:44.700054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc40253-eb7a-4930-87b6-4fa07d86249f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:44.710452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:44.715771 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:44.726888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f92adc-be33-47fc-b127-1c5bc94faa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:44.727505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92adc-be33-47fc-b127-1c5bc94faa22 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:44.727788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92adc-be33-47fc-b127-1c5bc94faa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:44.728059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f92adc-be33-47fc-b127-1c5bc94faa22 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:44.728966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f92adc-be33-47fc-b127-1c5bc94faa22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:44.729263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f92adc-be33-47fc-b127-1c5bc94faa22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:44.730651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f92adc-be33-47fc-b127-1c5bc94faa22 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:44.738573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e4dbd-6e85-429a-aa75-351f49484220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:44.740382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e4dbd-6e85-429a-aa75-351f49484220 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:44.740382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e4dbd-6e85-429a-aa75-351f49484220 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:44.740382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e4dbd-6e85-429a-aa75-351f49484220 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:44.740967 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e4dbd-6e85-429a-aa75-351f49484220 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:44.741268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e4dbd-6e85-429a-aa75-351f49484220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:44.742646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e4dbd-6e85-429a-aa75-351f49484220 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:44.756397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 470/948] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:44.756621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 479/949] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 1 16:17:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:44.756725 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f92adc-be33-47fc-b127-1c5bc94faa22 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:44.756814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e4dbd-6e85-429a-aa75-351f49484220 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:44.863243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f92adc-be33-47fc-b127-1c5bc94faa22 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:44.875878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e4dbd-6e85-429a-aa75-351f49484220 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:44.900846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e626d-b0b8-4647-85f0-7ec8f4ce7caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:44.901454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e626d-b0b8-4647-85f0-7ec8f4ce7caa None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:44.901733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e626d-b0b8-4647-85f0-7ec8f4ce7caa None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:44.902124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e626d-b0b8-4647-85f0-7ec8f4ce7caa None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:44.902721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e626d-b0b8-4647-85f0-7ec8f4ce7caa None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:44.903034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e626d-b0b8-4647-85f0-7ec8f4ce7caa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:44.904424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e626d-b0b8-4647-85f0-7ec8f4ce7caa None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:44.911320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9245f1-0dc7-4f33-ac5c-7528b37b065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:44.911988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9245f1-0dc7-4f33-ac5c-7528b37b065b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:44.912264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9245f1-0dc7-4f33-ac5c-7528b37b065b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:44.912527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9245f1-0dc7-4f33-ac5c-7528b37b065b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:44.920278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9245f1-0dc7-4f33-ac5c-7528b37b065b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:44.922020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9245f1-0dc7-4f33-ac5c-7528b37b065b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:44.930242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 471/950] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:44.930242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e626d-b0b8-4647-85f0-7ec8f4ce7caa None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-cf9245f1-0dc7-4f33-ac5c-7528b37b065b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:44.945960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:44.947011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:44.947979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:44.947979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:44.947979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:44.947979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:44.947979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:44.947979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:44.947979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:44.947979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:44.948437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 480/951] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:44.955011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9245f1-0dc7-4f33-ac5c-7528b37b065b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:44.988272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:44.999708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:45.055027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e626d-b0b8-4647-85f0-7ec8f4ce7caa None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:45.102891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1248-5465-451d-b275-921e85f20ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:45.103803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1248-5465-451d-b275-921e85f20ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:45.104057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1248-5465-451d-b275-921e85f20ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:45.104328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1248-5465-451d-b275-921e85f20ca0 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:45.104966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1248-5465-451d-b275-921e85f20ca0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:45.105337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1248-5465-451d-b275-921e85f20ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:45.107330 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1248-5465-451d-b275-921e85f20ca0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:45.111347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9245f1-0dc7-4f33-ac5c-7528b37b065b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:45.113749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 472/952] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 1 16:17:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:45.120370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1248-5465-451d-b275-921e85f20ca0 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:45.166942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a0a7a-8944-4705-b39e-6045828513d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:45.167551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a0a7a-8944-4705-b39e-6045828513d5 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:45.167861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a0a7a-8944-4705-b39e-6045828513d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:45.168130 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39a0a7a-8944-4705-b39e-6045828513d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:45.168822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a0a7a-8944-4705-b39e-6045828513d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:45.169118 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a0a7a-8944-4705-b39e-6045828513d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:45.170609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39a0a7a-8944-4705-b39e-6045828513d5 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:45.186353 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 481/953] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:45.192065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a0a7a-8944-4705-b39e-6045828513d5 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:45.270212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1248-5465-451d-b275-921e85f20ca0 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:45.281468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:45.310899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f59d5-b388-4f41-af6b-bb77cf3e5bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:45.311516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f59d5-b388-4f41-af6b-bb77cf3e5bc1 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:45.311793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f59d5-b388-4f41-af6b-bb77cf3e5bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:45.312059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f59d5-b388-4f41-af6b-bb77cf3e5bc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:45.312736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f59d5-b388-4f41-af6b-bb77cf3e5bc1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:45.314171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f59d5-b388-4f41-af6b-bb77cf3e5bc1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:45.321096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:45.332859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39a0a7a-8944-4705-b39e-6045828513d5 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:45.371130 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9ccd7-b12a-439b-afde-f5bb7bf95ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:45.371882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ccd7-b12a-439b-afde-f5bb7bf95ca1 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:45.372268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ccd7-b12a-439b-afde-f5bb7bf95ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:45.372636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9ccd7-b12a-439b-afde-f5bb7bf95ca1 None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/b536cb90a9d54ad29f0eb69e7a410add/roles/0b8370159a9242fbb3f4de16c8c1fd99` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:45.376702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9ccd7-b12a-439b-afde-f5bb7bf95ca1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=b536cb90a9d54ad29f0eb69e7a410add, role_id=0b8370159a9242fbb3f4de16c8c1fd99)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:45.378271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9ccd7-b12a-439b-afde-f5bb7bf95ca1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:45.406385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 473/954] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:17:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:45.457035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 482/955] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:17:45 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/b536cb90a9d54ad29f0eb69e7a410add/roles/0b8370159a9242fbb3f4de16c8c1fd99 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:17:45.660676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364102-6ddc-487e-a17f-74cdc0d782f4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:45.661199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364102-6ddc-487e-a17f-74cdc0d782f4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:45.661199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364102-6ddc-487e-a17f-74cdc0d782f4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:45.663299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 474/956] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:45.668669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a390b3-b3c5-4ecd-8c75-7a2bfd5f77cd None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:45.668957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a390b3-b3c5-4ecd-8c75-7a2bfd5f77cd None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:45.669237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a390b3-b3c5-4ecd-8c75-7a2bfd5f77cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:45.689186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-67a390b3-b3c5-4ecd-8c75-7a2bfd5f77cd None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:45.690417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-67a390b3-b3c5-4ecd-8c75-7a2bfd5f77cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:45.778225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 483/957] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:46.129656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364102-6ddc-487e-a17f-74cdc0d782f4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:46.259300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364102-6ddc-487e-a17f-74cdc0d782f4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:46.295809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824b8a-e3be-41fe-89b1-19c2b2983918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:46.296837 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824b8a-e3be-41fe-89b1-19c2b2983918 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:46.297314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824b8a-e3be-41fe-89b1-19c2b2983918 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:46.297889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824b8a-e3be-41fe-89b1-19c2b2983918 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:46.298661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30824b8a-e3be-41fe-89b1-19c2b2983918 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:46.300370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30824b8a-e3be-41fe-89b1-19c2b2983918 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-30824b8a-e3be-41fe-89b1-19c2b2983918 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:46.310865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:46.312042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:17:46.312926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:46.315398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 475/958] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:46.323297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a390b3-b3c5-4ecd-8c75-7a2bfd5f77cd None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:46.411219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:46.434535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a390b3-b3c5-4ecd-8c75-7a2bfd5f77cd None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:46.473392 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bb64e-1088-4cb4-a48a-bb411d5eccd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:46.474692 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb64e-1088-4cb4-a48a-bb411d5eccd3 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:46.474985 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb64e-1088-4cb4-a48a-bb411d5eccd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:46.481764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb64e-1088-4cb4-a48a-bb411d5eccd3 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:46.481764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bb64e-1088-4cb4-a48a-bb411d5eccd3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:46.481764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bb64e-1088-4cb4-a48a-bb411d5eccd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:46.481764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bb64e-1088-4cb4-a48a-bb411d5eccd3 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:46.483304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 484/959] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:46.489011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824b8a-e3be-41fe-89b1-19c2b2983918 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:46.520348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:46.601580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824b8a-e3be-41fe-89b1-19c2b2983918 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:46.639053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bc086-efa5-489d-a1a6-54803796e1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:46.639673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc086-efa5-489d-a1a6-54803796e1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:46.639949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc086-efa5-489d-a1a6-54803796e1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:46.640216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bc086-efa5-489d-a1a6-54803796e1e9 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:46.640844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bc086-efa5-489d-a1a6-54803796e1e9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:46.641203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bc086-efa5-489d-a1a6-54803796e1e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:46.642585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bc086-efa5-489d-a1a6-54803796e1e9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:46.648101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 476/960] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:47.082035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6a238-836e-435e-9c06-f5f65613371f None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:47.082424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6a238-836e-435e-9c06-f5f65613371f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:47.082624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6a238-836e-435e-9c06-f5f65613371f None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:47.084831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 485/961] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:47.090372 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf12cd-5885-40aa-928f-abfb218eed75 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:47.090874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf12cd-5885-40aa-928f-abfb218eed75 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:47.090975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf12cd-5885-40aa-928f-abfb218eed75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:47.117621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6ebf12cd-5885-40aa-928f-abfb218eed75 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:47.119265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6ebf12cd-5885-40aa-928f-abfb218eed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:47.195470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 477/962] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:47.428584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695d052-c543-4353-9250-66a0772994de None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:47.429146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695d052-c543-4353-9250-66a0772994de None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:47.429146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695d052-c543-4353-9250-66a0772994de None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:47.430711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 486/963] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:47.436158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4d946-6e5a-48f5-a969-8907b2583e82 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:47.436722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4d946-6e5a-48f5-a969-8907b2583e82 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:47.437207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4d946-6e5a-48f5-a969-8907b2583e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:47.457985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f1b4d946-6e5a-48f5-a969-8907b2583e82 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:47.459855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f1b4d946-6e5a-48f5-a969-8907b2583e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:47.469456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695d052-c543-4353-9250-66a0772994de None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:47.488912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:47.561097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 478/964] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:47.595945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c9022-15c1-430d-b85b-95f20ed38fe5 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:47.596598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c9022-15c1-430d-b85b-95f20ed38fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:47.597258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c9022-15c1-430d-b85b-95f20ed38fe5 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:47.600458 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 479/965] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:47.606101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77657870-51a2-4d9e-814c-819605fba0c1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:47.607044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77657870-51a2-4d9e-814c-819605fba0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:47.607770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77657870-51a2-4d9e-814c-819605fba0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:47.610422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695d052-c543-4353-9250-66a0772994de None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:47.632225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-77657870-51a2-4d9e-814c-819605fba0c1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:47.633770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-77657870-51a2-4d9e-814c-819605fba0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:47.649763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e24cc-6190-4400-9ea9-26071a1f0878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:47.650581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e24cc-6190-4400-9ea9-26071a1f0878 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:47.650859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e24cc-6190-4400-9ea9-26071a1f0878 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:47.651198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e24cc-6190-4400-9ea9-26071a1f0878 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:47.651962 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e24cc-6190-4400-9ea9-26071a1f0878 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:47.653412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e24cc-6190-4400-9ea9-26071a1f0878 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:47.656057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: WARNING keystone.server.flask.common [None req-806e24cc-6190-4400-9ea9-26071a1f0878 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 16:17:47.695029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.sql.core [None req-806e24cc-6190-4400-9ea9-26071a1f0878 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:17:47.695029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 16:17:47.695029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [parameters: {'user_id': '19dc3f1e48a6443590d11187fee7f0ce', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 16:17:47.695029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81783) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-806e24cc-6190-4400-9ea9-26071a1f0878 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result.read() Sep 01 16:17:47.712583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:17:47.713766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application yield resource Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application next(self.gen) Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise self.value Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application session.commit() Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 16:17:47.715049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.session.flush() Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application compat.raise_( Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 16:17:47.716191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 16:17:47.717311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application conn.query(q) Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application result.read() Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 16:17:47.718549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [parameters: {'user_id': '19dc3f1e48a6443590d11187fee7f0ce', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:47.719616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 16:17:47.720634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 16:17:47.721755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 16:17:47.721755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 16:17:47.721755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 16:17:47.721755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 16:17:47.721755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 16:17:47.721755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:47.726036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 487/966] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Sep 1 16:17:47 2022] POST /identity/v3/users => generated 160 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:47.728810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e24cc-6190-4400-9ea9-26071a1f0878 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:47.730599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 480/967] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:47.774784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:47.842568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e24cc-6190-4400-9ea9-26071a1f0878 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:47.869251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77657870-51a2-4d9e-814c-819605fba0c1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:47.887443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4ae92-dcc2-4aa4-9ba3-cb7d3170464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:47.887443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4ae92-dcc2-4aa4-9ba3-cb7d3170464e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:47.887443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4ae92-dcc2-4aa4-9ba3-cb7d3170464e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:47.887443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e4ae92-dcc2-4aa4-9ba3-cb7d3170464e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:47.893613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4ae92-dcc2-4aa4-9ba3-cb7d3170464e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:47.895324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e4ae92-dcc2-4aa4-9ba3-cb7d3170464e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-53e4ae92-dcc2-4aa4-9ba3-cb7d3170464e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:47.910368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:47.912610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:47.915650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:47.915650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:47.915650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:47.915650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:47.915650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:47.915650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:47.915650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:47.915650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:47.915650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 16:17:47.915650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:47.919391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 488/968] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:17:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:47.929931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4ae92-dcc2-4aa4-9ba3-cb7d3170464e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:47.999486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:48.007747 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:48.032729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77657870-51a2-4d9e-814c-819605fba0c1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:48.048051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e4ae92-dcc2-4aa4-9ba3-cb7d3170464e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:48.073986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe29c4-5370-4963-a9d6-fdafa1d78e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:48.074633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe29c4-5370-4963-a9d6-fdafa1d78e3b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.074952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe29c4-5370-4963-a9d6-fdafa1d78e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.075177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe29c4-5370-4963-a9d6-fdafa1d78e3b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.075992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe29c4-5370-4963-a9d6-fdafa1d78e3b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:48.077125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe29c4-5370-4963-a9d6-fdafa1d78e3b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:48.084678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e197ff-c2c6-49ae-98aa-378c36275345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:48.085298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e197ff-c2c6-49ae-98aa-378c36275345 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.085578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e197ff-c2c6-49ae-98aa-378c36275345 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.085851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e197ff-c2c6-49ae-98aa-378c36275345 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.090001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e197ff-c2c6-49ae-98aa-378c36275345 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-6afe29c4-5370-4963-a9d6-fdafa1d78e3b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:48.090151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:48.091599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:48.092452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:48.093197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e197ff-c2c6-49ae-98aa-378c36275345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:48.093268 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 481/969] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 1 16:17:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:48.093336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e197ff-c2c6-49ae-98aa-378c36275345 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:48.093413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe29c4-5370-4963-a9d6-fdafa1d78e3b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:48.138650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 489/970] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Sep 1 16:17:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:48.139533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e197ff-c2c6-49ae-98aa-378c36275345 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:48.261160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe29c4-5370-4963-a9d6-fdafa1d78e3b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:48.282993 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e197ff-c2c6-49ae-98aa-378c36275345 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:48.309134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97f977-51d6-40cd-b934-b820c21c1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:48.310078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97f977-51d6-40cd-b934-b820c21c1417 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.310502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97f977-51d6-40cd-b934-b820c21c1417 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.310923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97f977-51d6-40cd-b934-b820c21c1417 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.311448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:48.324708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97f977-51d6-40cd-b934-b820c21c1417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:48.326231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e6c72-930f-4b52-98a2-f2715b9f25b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:48.326845 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e6c72-930f-4b52-98a2-f2715b9f25b7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.327119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e6c72-930f-4b52-98a2-f2715b9f25b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.329510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e6c72-930f-4b52-98a2-f2715b9f25b7 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.329510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e6c72-930f-4b52-98a2-f2715b9f25b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:48.329510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e6c72-930f-4b52-98a2-f2715b9f25b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:48.329792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e6c72-930f-4b52-98a2-f2715b9f25b7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-7c97f977-51d6-40cd-b934-b820c21c1417 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:48.331689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:48.332672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:48.333614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 482/971] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 1 16:17:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:48.337790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 490/972] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 1 16:17:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:48.341513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97f977-51d6-40cd-b934-b820c21c1417 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:48.346003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e6c72-930f-4b52-98a2-f2715b9f25b7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:48.353143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:48.487537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97f977-51d6-40cd-b934-b820c21c1417 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:48.501580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e6c72-930f-4b52-98a2-f2715b9f25b7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:48.530076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be87196-57ef-4a37-8d1d-1e4708fcc827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:48.530610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be87196-57ef-4a37-8d1d-1e4708fcc827 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.530886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be87196-57ef-4a37-8d1d-1e4708fcc827 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.531159 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be87196-57ef-4a37-8d1d-1e4708fcc827 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.531816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be87196-57ef-4a37-8d1d-1e4708fcc827 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:48.532121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be87196-57ef-4a37-8d1d-1e4708fcc827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:48.533556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be87196-57ef-4a37-8d1d-1e4708fcc827 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:48.546734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 483/973] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 1 16:17:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:48.547849 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be87196-57ef-4a37-8d1d-1e4708fcc827 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:48.547961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f0fac-ac3a-450b-8e76-c7ca290751dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:48.548472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f0fac-ac3a-450b-8e76-c7ca290751dd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.548755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f0fac-ac3a-450b-8e76-c7ca290751dd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.549030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f0fac-ac3a-450b-8e76-c7ca290751dd None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.549667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f0fac-ac3a-450b-8e76-c7ca290751dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:48.550001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f0fac-ac3a-450b-8e76-c7ca290751dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:48.551375 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f0fac-ac3a-450b-8e76-c7ca290751dd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:48.562744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 491/974] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 1 16:17:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:48.569460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f0fac-ac3a-450b-8e76-c7ca290751dd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:48.636680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:48.639147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:48.674672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be87196-57ef-4a37-8d1d-1e4708fcc827 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:48.705674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f0fac-ac3a-450b-8e76-c7ca290751dd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:48.714987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49760b28-3f53-43d2-8fb2-09d1292ebab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:48.715632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49760b28-3f53-43d2-8fb2-09d1292ebab8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.715908 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49760b28-3f53-43d2-8fb2-09d1292ebab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.716176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49760b28-3f53-43d2-8fb2-09d1292ebab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.729493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49760b28-3f53-43d2-8fb2-09d1292ebab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:48.730978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49760b28-3f53-43d2-8fb2-09d1292ebab8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-49760b28-3f53-43d2-8fb2-09d1292ebab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:48.745605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:48.748507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:48.750794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:48.750794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:48.750794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:48.750794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 484/975] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:48.751026 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02603d44-e55a-45ed-8e2f-26393acc9b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:48.751561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02603d44-e55a-45ed-8e2f-26393acc9b4f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.751561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02603d44-e55a-45ed-8e2f-26393acc9b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.751858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02603d44-e55a-45ed-8e2f-26393acc9b4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.752464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02603d44-e55a-45ed-8e2f-26393acc9b4f None admin] RBAC: Adding query filter params (interface=admin, service_id=4d1de9f19690450d9d14fabfb7bc11ca, region_id=RegionOne) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:48.752639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49760b28-3f53-43d2-8fb2-09d1292ebab8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:48.752745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02603d44-e55a-45ed-8e2f-26393acc9b4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:48.754079 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02603d44-e55a-45ed-8e2f-26393acc9b4f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:48.761404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 492/976] 10.222.0.15 () {56 vars in 1249 bytes} [Thu Sep 1 16:17:48 2022] GET /identity/v3/endpoints?service_id=4d1de9f19690450d9d14fabfb7bc11ca&interface=admin®ion_id=RegionOne => generated 193 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:48.762816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b9ce5-e1b7-4f3b-bb57-5c208cdf0f3e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.763098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b9ce5-e1b7-4f3b-bb57-5c208cdf0f3e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.763379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b9ce5-e1b7-4f3b-bb57-5c208cdf0f3e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.764770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 493/977] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:48.766816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b9ce5-e1b7-4f3b-bb57-5c208cdf0f3e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:48.862815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49760b28-3f53-43d2-8fb2-09d1292ebab8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:48.875763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b9ce5-e1b7-4f3b-bb57-5c208cdf0f3e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:48.884490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:48.891502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:48.900980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d4d22-16a7-4fb5-a819-a777ca56895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:48.901642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d4d22-16a7-4fb5-a819-a777ca56895f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.902185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d4d22-16a7-4fb5-a819-a777ca56895f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.902466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d4d22-16a7-4fb5-a819-a777ca56895f None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.903480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d4d22-16a7-4fb5-a819-a777ca56895f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:48.903997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d4d22-16a7-4fb5-a819-a777ca56895f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:48.905753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d4d22-16a7-4fb5-a819-a777ca56895f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:48.913143 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9f988-7879-4211-bb2a-c59bc352c44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:48.913754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9f988-7879-4211-bb2a-c59bc352c44f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.914059 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9f988-7879-4211-bb2a-c59bc352c44f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.914375 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9f988-7879-4211-bb2a-c59bc352c44f None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.914949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9f988-7879-4211-bb2a-c59bc352c44f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:48.916316 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9f988-7879-4211-bb2a-c59bc352c44f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:48.918850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 485/978] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:48.920190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1746e-d3c6-4258-847e-6af9ba768716 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:48.937039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1746e-d3c6-4258-847e-6af9ba768716 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:48.937039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1746e-d3c6-4258-847e-6af9ba768716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:48.937282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 494/979] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 1 16:17:48 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:17:48.937282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9f988-7879-4211-bb2a-c59bc352c44f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:48.953123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-dcf1746e-d3c6-4258-847e-6af9ba768716 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:48.954450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dcf1746e-d3c6-4258-847e-6af9ba768716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:49.038859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 486/980] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:49.076763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9f988-7879-4211-bb2a-c59bc352c44f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:49.122475 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18972b68-d034-4895-bff5-64c708fdc3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:49.123044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972b68-d034-4895-bff5-64c708fdc3ee None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:49.123324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972b68-d034-4895-bff5-64c708fdc3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:49.123586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18972b68-d034-4895-bff5-64c708fdc3ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:49.135291 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18972b68-d034-4895-bff5-64c708fdc3ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:49.136736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18972b68-d034-4895-bff5-64c708fdc3ee None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-18972b68-d034-4895-bff5-64c708fdc3ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:49.149624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:49.151039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:49.152344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:49.152344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:49.152344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:49.152344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:49.152344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:49.152344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:49.152344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:49.152344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:49.152344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 16:17:49.152344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:49.152344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 495/981] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 1 16:17:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:49.156588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1746e-d3c6-4258-847e-6af9ba768716 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:49.283997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1746e-d3c6-4258-847e-6af9ba768716 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:49.295603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:49.312575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18972b68-d034-4895-bff5-64c708fdc3ee None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:49.323657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3333f0-12be-4fb4-905b-772b6626083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:49.324273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3333f0-12be-4fb4-905b-772b6626083f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:49.324547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3333f0-12be-4fb4-905b-772b6626083f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:49.324815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3333f0-12be-4fb4-905b-772b6626083f None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:49.325542 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3333f0-12be-4fb4-905b-772b6626083f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:49.325843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3333f0-12be-4fb4-905b-772b6626083f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:49.327398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3333f0-12be-4fb4-905b-772b6626083f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:49.356858 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 487/982] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Sep 1 16:17:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:49.358030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3333f0-12be-4fb4-905b-772b6626083f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:49.370478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:49.441829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18972b68-d034-4895-bff5-64c708fdc3ee None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:49.469087 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3333f0-12be-4fb4-905b-772b6626083f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:49.480237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77045e2-4a98-4600-9e16-3f8a7b7ef31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:49.480857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77045e2-4a98-4600-9e16-3f8a7b7ef31b None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:49.481447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77045e2-4a98-4600-9e16-3f8a7b7ef31b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:49.481725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77045e2-4a98-4600-9e16-3f8a7b7ef31b None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:49.482570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77045e2-4a98-4600-9e16-3f8a7b7ef31b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:49.483973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77045e2-4a98-4600-9e16-3f8a7b7ef31b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:49.505138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac365-3891-4d31-a104-42b4bc944a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:49.506360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac365-3891-4d31-a104-42b4bc944a5d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:49.509673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac365-3891-4d31-a104-42b4bc944a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:49.509673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ac365-3891-4d31-a104-42b4bc944a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:49.542741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:49.559698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 496/983] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:17:49 2022] POST /identity/v3/services => generated 242 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:17:49.591303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ac365-3891-4d31-a104-42b4bc944a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:49.593227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ac365-3891-4d31-a104-42b4bc944a5d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:49.713957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 488/984] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:49 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:17:49.719519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77045e2-4a98-4600-9e16-3f8a7b7ef31b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:49.830669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:49.843615 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77045e2-4a98-4600-9e16-3f8a7b7ef31b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:49.888469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497a311-f62f-4ecd-9ea6-0d23bca528bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:49.889112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497a311-f62f-4ecd-9ea6-0d23bca528bd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:49.889389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497a311-f62f-4ecd-9ea6-0d23bca528bd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:49.889656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497a311-f62f-4ecd-9ea6-0d23bca528bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:49.903357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497a311-f62f-4ecd-9ea6-0d23bca528bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:49.904843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497a311-f62f-4ecd-9ea6-0d23bca528bd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-7497a311-f62f-4ecd-9ea6-0d23bca528bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:49.919992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:49.920995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:49.922489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:49.922489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:49.922489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:49.922489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 497/985] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:49.926780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac365-3891-4d31-a104-42b4bc944a5d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:50.003350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:50.042778 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ac365-3891-4d31-a104-42b4bc944a5d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:50.085773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2892b68-e214-4a4f-a3de-b4b9b217a95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:50.086433 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2892b68-e214-4a4f-a3de-b4b9b217a95f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:50.086714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2892b68-e214-4a4f-a3de-b4b9b217a95f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:50.086985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2892b68-e214-4a4f-a3de-b4b9b217a95f None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:50.087635 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2892b68-e214-4a4f-a3de-b4b9b217a95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:50.087937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2892b68-e214-4a4f-a3de-b4b9b217a95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:50.089291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2892b68-e214-4a4f-a3de-b4b9b217a95f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:50.111339 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 489/986] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:50.112930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497a311-f62f-4ecd-9ea6-0d23bca528bd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:50.230682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497a311-f62f-4ecd-9ea6-0d23bca528bd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:50.266766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4778654-74b2-4b76-ac08-854228bdf855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:50.267344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4778654-74b2-4b76-ac08-854228bdf855 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:50.267627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4778654-74b2-4b76-ac08-854228bdf855 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:50.267901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4778654-74b2-4b76-ac08-854228bdf855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:50.274838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4778654-74b2-4b76-ac08-854228bdf855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:50.276284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4778654-74b2-4b76-ac08-854228bdf855 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-e4778654-74b2-4b76-ac08-854228bdf855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:17:50.288506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:50.289423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:50.290402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:17:50.290402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:17:50.290402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:17:50.290402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:17:50.290402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:17:50.290402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:17:50.290402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:17:50.290402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:50.294199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 498/987] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:50.295553 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2892b68-e214-4a4f-a3de-b4b9b217a95f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:50.402470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2892b68-e214-4a4f-a3de-b4b9b217a95f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:50.432528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:50.440920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed268652-bb8d-45ef-9dd8-1bc36b8ce6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:50.441535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed268652-bb8d-45ef-9dd8-1bc36b8ce6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:50.441815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed268652-bb8d-45ef-9dd8-1bc36b8ce6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:50.442131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed268652-bb8d-45ef-9dd8-1bc36b8ce6e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:50.443513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed268652-bb8d-45ef-9dd8-1bc36b8ce6e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:50.443827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed268652-bb8d-45ef-9dd8-1bc36b8ce6e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:50.445442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed268652-bb8d-45ef-9dd8-1bc36b8ce6e8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:50.462227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 490/988] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:17:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:50.465398 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4778654-74b2-4b76-ac08-854228bdf855 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:50.476381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:50.576515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4778654-74b2-4b76-ac08-854228bdf855 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:50.612778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d7725-1318-4d36-8db0-fdd5c8cb7201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:50.613394 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d7725-1318-4d36-8db0-fdd5c8cb7201 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:50.613673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d7725-1318-4d36-8db0-fdd5c8cb7201 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:50.613972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d7725-1318-4d36-8db0-fdd5c8cb7201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:50.614805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d7725-1318-4d36-8db0-fdd5c8cb7201 None admin] RBAC: Adding query filter params (role.id=0b8370159a9242fbb3f4de16c8c1fd99, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=b536cb90a9d54ad29f0eb69e7a410add) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:50.615133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d7725-1318-4d36-8db0-fdd5c8cb7201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:50.616663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d7725-1318-4d36-8db0-fdd5c8cb7201 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:50.623113 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 499/989] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:17:50 2022] GET /identity/v3/role_assignments?user.id=b536cb90a9d54ad29f0eb69e7a410add&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=0b8370159a9242fbb3f4de16c8c1fd99 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:50.928093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf780d74-6057-47f1-9b89-b96cf68f1d10 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:50.928435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf780d74-6057-47f1-9b89-b96cf68f1d10 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:50.928769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf780d74-6057-47f1-9b89-b96cf68f1d10 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:50.930352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 491/990] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:50.935378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604a9a0-d336-448c-a8a3-a8737af5baff None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:50.935665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604a9a0-d336-448c-a8a3-a8737af5baff None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:50.935939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604a9a0-d336-448c-a8a3-a8737af5baff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:50.955013 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f604a9a0-d336-448c-a8a3-a8737af5baff None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:50.956538 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f604a9a0-d336-448c-a8a3-a8737af5baff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:51.023191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:51.028656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 500/991] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:51.300935 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf780d74-6057-47f1-9b89-b96cf68f1d10 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:51.410245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf780d74-6057-47f1-9b89-b96cf68f1d10 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:51.451859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1ef84-95c1-4570-9147-bbdd28782654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:51.452554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ef84-95c1-4570-9147-bbdd28782654 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:51.452841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ef84-95c1-4570-9147-bbdd28782654 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:51.453115 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1ef84-95c1-4570-9147-bbdd28782654 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:51.453705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1ef84-95c1-4570-9147-bbdd28782654 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:51.455109 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf1ef84-95c1-4570-9147-bbdd28782654 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-aaf1ef84-95c1-4570-9147-bbdd28782654 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:51.465653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:51.466749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:51.470995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 492/992] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Sep 1 16:17:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:51.473116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604a9a0-d336-448c-a8a3-a8737af5baff None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:51.544053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4db8b8-01d7-42c6-b5d2-80398b324356 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:51.544405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4db8b8-01d7-42c6-b5d2-80398b324356 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:51.544605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4db8b8-01d7-42c6-b5d2-80398b324356 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:51.546114 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 493/993] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:51.551111 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc301ac-1d94-40b4-8224-7802742d2ced None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:51.551304 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc301ac-1d94-40b4-8224-7802742d2ced None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:51.551572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc301ac-1d94-40b4-8224-7802742d2ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:51.571405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0bc301ac-1d94-40b4-8224-7802742d2ced None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:51.572545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0bc301ac-1d94-40b4-8224-7802742d2ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:51.594781 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604a9a0-d336-448c-a8a3-a8737af5baff None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:51.624883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:51.633376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fd934-1829-4929-9d64-8c52c6ce3187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:51.646825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd934-1829-4929-9d64-8c52c6ce3187 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:51.646825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd934-1829-4929-9d64-8c52c6ce3187 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:51.646825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fd934-1829-4929-9d64-8c52c6ce3187 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:51.646825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fd934-1829-4929-9d64-8c52c6ce3187 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:51.646825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fd934-1829-4929-9d64-8c52c6ce3187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:51.646825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fd934-1829-4929-9d64-8c52c6ce3187 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:51.647424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 501/994] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 1 16:17:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:51.650122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 494/995] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:51.650222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fd934-1829-4929-9d64-8c52c6ce3187 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:51.718800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:51.758600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fd934-1829-4929-9d64-8c52c6ce3187 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:51.796578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc568e1e-d2a2-459b-ae2e-a0d3064cb448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:51.797198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc568e1e-d2a2-459b-ae2e-a0d3064cb448 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:51.797476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc568e1e-d2a2-459b-ae2e-a0d3064cb448 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:51.797747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc568e1e-d2a2-459b-ae2e-a0d3064cb448 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:51.798405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc568e1e-d2a2-459b-ae2e-a0d3064cb448 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:51.798706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc568e1e-d2a2-459b-ae2e-a0d3064cb448 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:51.800131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc568e1e-d2a2-459b-ae2e-a0d3064cb448 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:51.809978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 502/996] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Sep 1 16:17:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:51.811978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc301ac-1d94-40b4-8224-7802742d2ced None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:51.913297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc568e1e-d2a2-459b-ae2e-a0d3064cb448 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:51.920379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc301ac-1d94-40b4-8224-7802742d2ced None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:51.960111 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a3e05-7f10-483e-95c5-0104fe37b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:51.961040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a3e05-7f10-483e-95c5-0104fe37b71d None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:51.961500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a3e05-7f10-483e-95c5-0104fe37b71d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:51.962037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a3e05-7f10-483e-95c5-0104fe37b71d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:51.962710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a3e05-7f10-483e-95c5-0104fe37b71d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:51.964137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a3e05-7f10-483e-95c5-0104fe37b71d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:52.020108 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc568e1e-d2a2-459b-ae2e-a0d3064cb448 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:52.050744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 495/997] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:17:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:17:52.056216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:52.069982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c8860-81f0-4b81-a850-a99500a7bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:52.070821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c8860-81f0-4b81-a850-a99500a7bf23 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:52.072245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c8860-81f0-4b81-a850-a99500a7bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:52.072245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c8860-81f0-4b81-a850-a99500a7bf23 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:52.072245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c8860-81f0-4b81-a850-a99500a7bf23 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:52.073901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c8860-81f0-4b81-a850-a99500a7bf23 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-822c8860-81f0-4b81-a850-a99500a7bf23 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:52.091552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:52.096107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:52.097536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 503/998] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:52.109298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a3e05-7f10-483e-95c5-0104fe37b71d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:52.167792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:52.257195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a3e05-7f10-483e-95c5-0104fe37b71d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:52.293724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2f7af-2eed-4a71-8da9-157ebd41f260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:52.294390 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2f7af-2eed-4a71-8da9-157ebd41f260 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:52.295585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2f7af-2eed-4a71-8da9-157ebd41f260 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:52.295585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2f7af-2eed-4a71-8da9-157ebd41f260 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:52.295585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2f7af-2eed-4a71-8da9-157ebd41f260 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:52.295793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2f7af-2eed-4a71-8da9-157ebd41f260 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:52.297145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2f7af-2eed-4a71-8da9-157ebd41f260 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:52.303075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 496/999] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:52.308817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c8860-81f0-4b81-a850-a99500a7bf23 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:52.415249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c8860-81f0-4b81-a850-a99500a7bf23 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:52.453530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914edbfc-a490-4f15-91e8-8f26f15a9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:52.454224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914edbfc-a490-4f15-91e8-8f26f15a9685 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:52.454501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914edbfc-a490-4f15-91e8-8f26f15a9685 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:52.454765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914edbfc-a490-4f15-91e8-8f26f15a9685 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:52.455384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914edbfc-a490-4f15-91e8-8f26f15a9685 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:52.455680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914edbfc-a490-4f15-91e8-8f26f15a9685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:52.457029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914edbfc-a490-4f15-91e8-8f26f15a9685 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:52.468576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 504/1000] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:52.468764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2f7af-2eed-4a71-8da9-157ebd41f260 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:52.608541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2f7af-2eed-4a71-8da9-157ebd41f260 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:52.626959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:52.645696 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0e86-7939-4e4a-be0e-8f0b0e8eeb6d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:52.647381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0e86-7939-4e4a-be0e-8f0b0e8eeb6d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:52.647381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b0e86-7939-4e4a-be0e-8f0b0e8eeb6d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:52.651111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 505/1001] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:52.653662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208a3c2-2da1-4eeb-a865-468a98c72510 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:52.653978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208a3c2-2da1-4eeb-a865-468a98c72510 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:52.654256 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208a3c2-2da1-4eeb-a865-468a98c72510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:52.659539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8eddb-7102-4419-b148-3f52663b5441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:52.660148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8eddb-7102-4419-b148-3f52663b5441 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:52.660729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8eddb-7102-4419-b148-3f52663b5441 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:52.661006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8eddb-7102-4419-b148-3f52663b5441 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:52.664927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8eddb-7102-4419-b148-3f52663b5441 None admin] RBAC: Adding query filter params (interface=public, service_id=f33723aed9c84db4ba9c73a540266263, region_id=RegionOne) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:52.664927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8eddb-7102-4419-b148-3f52663b5441 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:52.665764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8eddb-7102-4419-b148-3f52663b5441 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:52.680066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 497/1002] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 1 16:17:52 2022] GET /identity/v3/endpoints?service_id=f33723aed9c84db4ba9c73a540266263&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:52.680244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a208a3c2-2da1-4eeb-a865-468a98c72510 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:52.680244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a208a3c2-2da1-4eeb-a865-468a98c72510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:52.681408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8eddb-7102-4419-b148-3f52663b5441 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:52.732433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:52.762334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 506/1003] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:52 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:52.813375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8eddb-7102-4419-b148-3f52663b5441 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:52.852708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bd72-c58d-4fa9-bbc9-636da8f3719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:52.853511 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bd72-c58d-4fa9-bbc9-636da8f3719a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:52.854211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bd72-c58d-4fa9-bbc9-636da8f3719a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:52.854613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99bd72-c58d-4fa9-bbc9-636da8f3719a None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:52.855358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99bd72-c58d-4fa9-bbc9-636da8f3719a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:52.856913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99bd72-c58d-4fa9-bbc9-636da8f3719a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:52.869915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 498/1004] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 1 16:17:52 2022] GET /identity/v3/services => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:17:53.048433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208a3c2-2da1-4eeb-a865-468a98c72510 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:53.179161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208a3c2-2da1-4eeb-a865-468a98c72510 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:53.219662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdddfa-20e9-4994-ad47-b9caa3fb1af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:53.220341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdddfa-20e9-4994-ad47-b9caa3fb1af9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:53.220620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdddfa-20e9-4994-ad47-b9caa3fb1af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:53.220886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdddfa-20e9-4994-ad47-b9caa3fb1af9 None admin] PATH_INFO: `/v3/services/image` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:53.221465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdddfa-20e9-4994-ad47-b9caa3fb1af9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:53.222845 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfdddfa-20e9-4994-ad47-b9caa3fb1af9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-3bfdddfa-20e9-4994-ad47-b9caa3fb1af9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:53.233021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:53.234067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:53.235384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 507/1005] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Sep 1 16:17:53 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:53.240422 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bd72-c58d-4fa9-bbc9-636da8f3719a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:53.277210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:53.348049 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99bd72-c58d-4fa9-bbc9-636da8f3719a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:53.382440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce39bb2-e8d3-4b6f-820c-066773dd7030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:53.383054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce39bb2-e8d3-4b6f-820c-066773dd7030 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:53.383330 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce39bb2-e8d3-4b6f-820c-066773dd7030 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:53.383597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce39bb2-e8d3-4b6f-820c-066773dd7030 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:53.384218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce39bb2-e8d3-4b6f-820c-066773dd7030 None admin] RBAC: Adding query filter params (name=image) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:53.384513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce39bb2-e8d3-4b6f-820c-066773dd7030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:53.385853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce39bb2-e8d3-4b6f-820c-066773dd7030 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:53.395605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 499/1006] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:53.396474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdddfa-20e9-4994-ad47-b9caa3fb1af9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:53.446556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:53.501616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdddfa-20e9-4994-ad47-b9caa3fb1af9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:53.535982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84247b8-4b7d-4d35-9754-89c7bb92a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:53.536599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84247b8-4b7d-4d35-9754-89c7bb92a87e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:53.536872 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84247b8-4b7d-4d35-9754-89c7bb92a87e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:53.537326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84247b8-4b7d-4d35-9754-89c7bb92a87e None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:53.538039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84247b8-4b7d-4d35-9754-89c7bb92a87e None admin] RBAC: Adding query filter params (type=image) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:53.538380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84247b8-4b7d-4d35-9754-89c7bb92a87e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:53.539734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84247b8-4b7d-4d35-9754-89c7bb92a87e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:53.553917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 508/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:54.065722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580d11-3606-487b-a323-e6f3bcb4985d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:54.066146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580d11-3606-487b-a323-e6f3bcb4985d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:54.066330 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d580d11-3606-487b-a323-e6f3bcb4985d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:54.067692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 500/1008] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:54.073319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3c3ea-898c-41dc-aa89-9a90e6ed47f8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:54.073841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3c3ea-898c-41dc-aa89-9a90e6ed47f8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:54.073841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3c3ea-898c-41dc-aa89-9a90e6ed47f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:54.093191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1cf3c3ea-898c-41dc-aa89-9a90e6ed47f8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:54.094424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1cf3c3ea-898c-41dc-aa89-9a90e6ed47f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:54.176516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 509/1009] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:54.449052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d580d11-3606-487b-a323-e6f3bcb4985d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:54.559654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:54.564981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d580d11-3606-487b-a323-e6f3bcb4985d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:54.600943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72405e-79c9-4974-8eac-6be837b865fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:54.601587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72405e-79c9-4974-8eac-6be837b865fe None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:54.601866 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72405e-79c9-4974-8eac-6be837b865fe None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:54.602167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72405e-79c9-4974-8eac-6be837b865fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:54.603297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72405e-79c9-4974-8eac-6be837b865fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:54.604971 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72405e-79c9-4974-8eac-6be837b865fe None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:54.609915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 501/1010] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:54.612665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3c3ea-898c-41dc-aa89-9a90e6ed47f8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:54.667223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:54.738956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3c3ea-898c-41dc-aa89-9a90e6ed47f8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:54.778070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de445d-5ac3-447b-9e90-dd6b18893b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:54.778687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de445d-5ac3-447b-9e90-dd6b18893b40 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:54.778961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de445d-5ac3-447b-9e90-dd6b18893b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:54.779226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8de445d-5ac3-447b-9e90-dd6b18893b40 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:54.779888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de445d-5ac3-447b-9e90-dd6b18893b40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:54.781295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8de445d-5ac3-447b-9e90-dd6b18893b40 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:54.850958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c23b6-3df0-4a50-a0b2-7bb57f377588 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:54.851281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c23b6-3df0-4a50-a0b2-7bb57f377588 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:54.851620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c23b6-3df0-4a50-a0b2-7bb57f377588 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:54.852998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 502/1011] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:54.858299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa8235-105b-45ab-b0ef-988a05778521 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:54.858579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa8235-105b-45ab-b0ef-988a05778521 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:54.858923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa8235-105b-45ab-b0ef-988a05778521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:54.877309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4daa8235-105b-45ab-b0ef-988a05778521 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:54.878525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4daa8235-105b-45ab-b0ef-988a05778521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:54.902205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 510/1012] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:17:54 2022] POST /identity/v3/projects => generated 311 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:54.968967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 503/1013] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:55.245500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de445d-5ac3-447b-9e90-dd6b18893b40 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:55.340214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:55.350028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8de445d-5ac3-447b-9e90-dd6b18893b40 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:55.387742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3bc20-ebb6-44f1-83ae-261a5383fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:55.388312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3bc20-ebb6-44f1-83ae-261a5383fe02 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:55.388590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3bc20-ebb6-44f1-83ae-261a5383fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:55.388864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3bc20-ebb6-44f1-83ae-261a5383fe02 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:55.389442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3bc20-ebb6-44f1-83ae-261a5383fe02 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:55.390965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3bc20-ebb6-44f1-83ae-261a5383fe02 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-1aa3bc20-ebb6-44f1-83ae-261a5383fe02 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:55.401020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:55.402506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 16:17:55.403584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:55.406520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 511/1014] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:17:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:55.412711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa8235-105b-45ab-b0ef-988a05778521 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:55.493586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40395feb-47cf-4f4d-b7a4-d60ec641cce1 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:55.493948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40395feb-47cf-4f4d-b7a4-d60ec641cce1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:55.494167 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40395feb-47cf-4f4d-b7a4-d60ec641cce1 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:55.496920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 512/1015] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:55.501834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aaaad-4319-41ab-8ed3-49ee26c6a9d9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:55.502140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aaaad-4319-41ab-8ed3-49ee26c6a9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:55.502411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aaaad-4319-41ab-8ed3-49ee26c6a9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:55.516566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:55.522960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa8235-105b-45ab-b0ef-988a05778521 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:55.526678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f30aaaad-4319-41ab-8ed3-49ee26c6a9d9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:55.545194 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f30aaaad-4319-41ab-8ed3-49ee26c6a9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:55.557780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f07e6-40f3-47bd-aad3-663b7517e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:55.558396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f07e6-40f3-47bd-aad3-663b7517e588 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:55.558683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f07e6-40f3-47bd-aad3-663b7517e588 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:55.558938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f07e6-40f3-47bd-aad3-663b7517e588 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:55.559550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f07e6-40f3-47bd-aad3-663b7517e588 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:55.559874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f07e6-40f3-47bd-aad3-663b7517e588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:55.561170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f07e6-40f3-47bd-aad3-663b7517e588 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:55.571168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 504/1016] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:55.573060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f07e6-40f3-47bd-aad3-663b7517e588 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:55.603214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 513/1017] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:55 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:55.680997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f07e6-40f3-47bd-aad3-663b7517e588 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:55.717992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b2a31-07a8-4299-9570-3d16f5de757c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:55.718610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b2a31-07a8-4299-9570-3d16f5de757c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:55.718894 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b2a31-07a8-4299-9570-3d16f5de757c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:55.719166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0b2a31-07a8-4299-9570-3d16f5de757c None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:55.719793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b2a31-07a8-4299-9570-3d16f5de757c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:55.720097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b2a31-07a8-4299-9570-3d16f5de757c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:55.721443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0b2a31-07a8-4299-9570-3d16f5de757c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:55.726608 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 505/1018] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Sep 1 16:17:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:55.732359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aaaad-4319-41ab-8ed3-49ee26c6a9d9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:55.825257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:55.841664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aaaad-4319-41ab-8ed3-49ee26c6a9d9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:55.870638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b2a31-07a8-4299-9570-3d16f5de757c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:55.879781 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca953c40-f07f-4d8b-a2aa-eb2f8136235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:55.880678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca953c40-f07f-4d8b-a2aa-eb2f8136235f None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:55.881165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca953c40-f07f-4d8b-a2aa-eb2f8136235f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:55.881610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca953c40-f07f-4d8b-a2aa-eb2f8136235f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:55.882511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca953c40-f07f-4d8b-a2aa-eb2f8136235f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:55.884040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca953c40-f07f-4d8b-a2aa-eb2f8136235f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:55.898002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:55.977248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0b2a31-07a8-4299-9570-3d16f5de757c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:55.985968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 514/1019] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:17:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:17:56.040203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185710fb-259e-4de5-8a88-1c7ca6b29438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:56.040824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185710fb-259e-4de5-8a88-1c7ca6b29438 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:56.041098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185710fb-259e-4de5-8a88-1c7ca6b29438 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:56.041366 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185710fb-259e-4de5-8a88-1c7ca6b29438 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:56.042067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185710fb-259e-4de5-8a88-1c7ca6b29438 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:56.043445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185710fb-259e-4de5-8a88-1c7ca6b29438 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:56.159091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 506/1020] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:17:55 2022] POST /identity/v3/services => generated 242 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:17:56.963628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371592f-0b97-4327-9dbe-b2d6a551235d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:56.964197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371592f-0b97-4327-9dbe-b2d6a551235d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:56.964197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371592f-0b97-4327-9dbe-b2d6a551235d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:56.965671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 515/1021] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:56.971065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64b60a-28fe-4cdf-95cc-7b69e6804a25 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:56.971564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64b60a-28fe-4cdf-95cc-7b69e6804a25 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:56.971673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64b60a-28fe-4cdf-95cc-7b69e6804a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:56.991877 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5c64b60a-28fe-4cdf-95cc-7b69e6804a25 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:56.993064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5c64b60a-28fe-4cdf-95cc-7b69e6804a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:57.096378 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 507/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:57.370163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371592f-0b97-4327-9dbe-b2d6a551235d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:57.483035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371592f-0b97-4327-9dbe-b2d6a551235d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:57.519391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e849e-b57f-48c4-aba4-df026b76b711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:57.520025 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e849e-b57f-48c4-aba4-df026b76b711 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:57.520299 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e849e-b57f-48c4-aba4-df026b76b711 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:57.520573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e849e-b57f-48c4-aba4-df026b76b711 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:57.522442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e849e-b57f-48c4-aba4-df026b76b711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:57.523862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e849e-b57f-48c4-aba4-df026b76b711 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:57.525613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 516/1023] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:57.531161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64b60a-28fe-4cdf-95cc-7b69e6804a25 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:57.539529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:57.638739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64b60a-28fe-4cdf-95cc-7b69e6804a25 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:57.680335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c20114-5210-43bd-a066-c5a21f4de5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:57.680954 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c20114-5210-43bd-a066-c5a21f4de5ae None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:57.681229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c20114-5210-43bd-a066-c5a21f4de5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:57.681495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c20114-5210-43bd-a066-c5a21f4de5ae None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:57.682190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c20114-5210-43bd-a066-c5a21f4de5ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:57.683590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c20114-5210-43bd-a066-c5a21f4de5ae None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:57.784827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 508/1024] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:17:57 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:17:58.109964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389650b-680d-4aae-bc0d-5458cdbd61f8 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:58.110489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389650b-680d-4aae-bc0d-5458cdbd61f8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:58.110570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5389650b-680d-4aae-bc0d-5458cdbd61f8 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:58.111907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 517/1025] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:17:58.118487 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1fcd-c02d-4a83-83dd-09a6b49b87c0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:58.118988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1fcd-c02d-4a83-83dd-09a6b49b87c0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:58.119094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab1fcd-c02d-4a83-83dd-09a6b49b87c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:58.143790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-19ab1fcd-c02d-4a83-83dd-09a6b49b87c0 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:58.144990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-19ab1fcd-c02d-4a83-83dd-09a6b49b87c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:58.171629 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397e623-5054-4831-b8b9-7479f1b3f20c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:58.171911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397e623-5054-4831-b8b9-7479f1b3f20c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:58.172182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397e623-5054-4831-b8b9-7479f1b3f20c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:58.173931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 518/1026] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:58.180477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7b822-1249-4015-a985-0cca11842e33 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:58.180905 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7b822-1249-4015-a985-0cca11842e33 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:58.181185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d7b822-1249-4015-a985-0cca11842e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:58.203838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-21d7b822-1249-4015-a985-0cca11842e33 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:58.205901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-21d7b822-1249-4015-a985-0cca11842e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:58.212005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:58.216069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:58.228244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 509/1027] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:58.301951 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 519/1028] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:17:58.503708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1fcd-c02d-4a83-83dd-09a6b49b87c0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:58.571122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7b822-1249-4015-a985-0cca11842e33 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:58.618834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab1fcd-c02d-4a83-83dd-09a6b49b87c0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:58.655100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b123ba1-d7ab-4e2a-842e-b0a79048afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:58.655740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123ba1-d7ab-4e2a-842e-b0a79048afd2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:58.656022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123ba1-d7ab-4e2a-842e-b0a79048afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:58.656296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b123ba1-d7ab-4e2a-842e-b0a79048afd2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:58.667905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b123ba1-d7ab-4e2a-842e-b0a79048afd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-7b123ba1-d7ab-4e2a-842e-b0a79048afd2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:17:58.672766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:58.673777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:58.674690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 510/1029] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 1 16:17:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:58.680681 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b123ba1-d7ab-4e2a-842e-b0a79048afd2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:58.701481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d7b822-1249-4015-a985-0cca11842e33 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:58.738358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1dbd4-b75a-4261-9428-afcfc080f3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:58.739003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1dbd4-b75a-4261-9428-afcfc080f3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:58.739280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1dbd4-b75a-4261-9428-afcfc080f3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:58.740197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1dbd4-b75a-4261-9428-afcfc080f3b4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:58.740833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1dbd4-b75a-4261-9428-afcfc080f3b4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:58.742173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1dbd4-b75a-4261-9428-afcfc080f3b4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:58.746323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-53e1dbd4-b75a-4261-9428-afcfc080f3b4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:58.751521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:58.752565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:17:58.753431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 520/1030] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Sep 1 16:17:58 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:17:58.761711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1dbd4-b75a-4261-9428-afcfc080f3b4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:58.765602 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:58.811450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b123ba1-d7ab-4e2a-842e-b0a79048afd2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:58.851719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ea7b7-f82a-4bcc-a4af-60d04a31ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:58.852344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ea7b7-f82a-4bcc-a4af-60d04a31ba9e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:58.852627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ea7b7-f82a-4bcc-a4af-60d04a31ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:58.852904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ea7b7-f82a-4bcc-a4af-60d04a31ba9e None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:58.853571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ea7b7-f82a-4bcc-a4af-60d04a31ba9e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:58.854255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ea7b7-f82a-4bcc-a4af-60d04a31ba9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:58.855609 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ea7b7-f82a-4bcc-a4af-60d04a31ba9e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:58.865917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 511/1031] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 1 16:17:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:58.870814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ea7b7-f82a-4bcc-a4af-60d04a31ba9e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:58.880830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1dbd4-b75a-4261-9428-afcfc080f3b4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:58.924861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f107aa6-670a-4387-a219-c6ffec3d892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:58.925473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107aa6-670a-4387-a219-c6ffec3d892c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:58.925756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107aa6-670a-4387-a219-c6ffec3d892c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:58.926053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f107aa6-670a-4387-a219-c6ffec3d892c None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:58.926680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f107aa6-670a-4387-a219-c6ffec3d892c None admin] RBAC: Adding query filter params (name=image) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:58.926978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f107aa6-670a-4387-a219-c6ffec3d892c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:58.929622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f107aa6-670a-4387-a219-c6ffec3d892c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:58.935028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 521/1032] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:58.941656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f107aa6-670a-4387-a219-c6ffec3d892c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:59.008123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ea7b7-f82a-4bcc-a4af-60d04a31ba9e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:59.019120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:59.024161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:59.051351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d299df-1cee-4c65-bc8d-4f0ffca9a406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:59.052111 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d299df-1cee-4c65-bc8d-4f0ffca9a406 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:59.052915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d299df-1cee-4c65-bc8d-4f0ffca9a406 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:59.052915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d299df-1cee-4c65-bc8d-4f0ffca9a406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:59.058220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f107aa6-670a-4387-a219-c6ffec3d892c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:59.064687 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d299df-1cee-4c65-bc8d-4f0ffca9a406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:59.066225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d299df-1cee-4c65-bc8d-4f0ffca9a406 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-f3d299df-1cee-4c65-bc8d-4f0ffca9a406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:17:59.081576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:59.082799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:17:59.085197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:17:59.085197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:17:59.085197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:59.088576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 512/1033] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:59.089523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d299df-1cee-4c65-bc8d-4f0ffca9a406 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:59.114837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03897-3d30-4183-b5fb-f800c6473608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:59.116185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03897-3d30-4183-b5fb-f800c6473608 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:59.116185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03897-3d30-4183-b5fb-f800c6473608 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:59.116339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca03897-3d30-4183-b5fb-f800c6473608 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:59.116963 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03897-3d30-4183-b5fb-f800c6473608 None admin] RBAC: Adding query filter params (type=image) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:59.117265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03897-3d30-4183-b5fb-f800c6473608 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:59.118658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca03897-3d30-4183-b5fb-f800c6473608 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:59.127676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 522/1034] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:17:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:59.132404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03897-3d30-4183-b5fb-f800c6473608 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:59.222438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d299df-1cee-4c65-bc8d-4f0ffca9a406 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:59.251366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca03897-3d30-4183-b5fb-f800c6473608 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:59.263706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36277471-2cbb-41fe-9341-f0e643e493bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:59.264322 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36277471-2cbb-41fe-9341-f0e643e493bb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:59.264658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36277471-2cbb-41fe-9341-f0e643e493bb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:59.264933 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36277471-2cbb-41fe-9341-f0e643e493bb None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:59.265578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36277471-2cbb-41fe-9341-f0e643e493bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:59.265897 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36277471-2cbb-41fe-9341-f0e643e493bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:59.267378 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36277471-2cbb-41fe-9341-f0e643e493bb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:59.284714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 513/1035] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:59.285893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36277471-2cbb-41fe-9341-f0e643e493bb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:59.290679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:59.296613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08585f7-5870-499d-bc7f-bec393caad3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:59.297226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08585f7-5870-499d-bc7f-bec393caad3e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:59.297505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08585f7-5870-499d-bc7f-bec393caad3e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:59.297774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08585f7-5870-499d-bc7f-bec393caad3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:59.299542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08585f7-5870-499d-bc7f-bec393caad3e None admin] RBAC: Adding query filter params (interface=public, service_id=354493b7f4a2418893ab966cd5a665a3, region_id=RegionOne) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:59.299542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08585f7-5870-499d-bc7f-bec393caad3e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:59.300190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08585f7-5870-499d-bc7f-bec393caad3e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:59.306841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 523/1036] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 1 16:17:59 2022] GET /identity/v3/endpoints?service_id=354493b7f4a2418893ab966cd5a665a3&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:17:59.312315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08585f7-5870-499d-bc7f-bec393caad3e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:59.317487 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:59.401292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36277471-2cbb-41fe-9341-f0e643e493bb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:59.431301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08585f7-5870-499d-bc7f-bec393caad3e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:59.446904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a748421-e8ee-469b-840d-6463a03597bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:59.447663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748421-e8ee-469b-840d-6463a03597bc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:59.448047 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748421-e8ee-469b-840d-6463a03597bc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:59.448322 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748421-e8ee-469b-840d-6463a03597bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:59.456089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a748421-e8ee-469b-840d-6463a03597bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:59.457514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a748421-e8ee-469b-840d-6463a03597bc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-8a748421-e8ee-469b-840d-6463a03597bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:17:59.470071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:17:59.471091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:17:59.477741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:17:59.477741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:17:59.477741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:17:59.477741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:17:59.477741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:17:59.477741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:17:59.477741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:17:59.477741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:17:59.477741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:17:59.477741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:17:59.478355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7abb2e-ccb2-466c-a2fa-43fc390da03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:59.478355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7abb2e-ccb2-466c-a2fa-43fc390da03e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:59.478355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7abb2e-ccb2-466c-a2fa-43fc390da03e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:59.478559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 514/1037] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 1 16:17:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:17:59.478637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7abb2e-ccb2-466c-a2fa-43fc390da03e None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:59.478637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7abb2e-ccb2-466c-a2fa-43fc390da03e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:59.478637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7abb2e-ccb2-466c-a2fa-43fc390da03e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:59.479078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a748421-e8ee-469b-840d-6463a03597bc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:59.490527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 524/1038] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 1 16:17:59 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:17:59.580308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:59.601171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a748421-e8ee-469b-840d-6463a03597bc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:59.642195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb666b-727a-4122-8d85-b421d2264c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:59.642820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb666b-727a-4122-8d85-b421d2264c7e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:59.643100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb666b-727a-4122-8d85-b421d2264c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:59.643369 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb666b-727a-4122-8d85-b421d2264c7e None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:59.644100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb666b-727a-4122-8d85-b421d2264c7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:17:59.644406 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb666b-727a-4122-8d85-b421d2264c7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:59.646396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb666b-727a-4122-8d85-b421d2264c7e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:59.669215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 515/1039] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 1 16:17:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:17:59.674584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7abb2e-ccb2-466c-a2fa-43fc390da03e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:17:59.741154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:17:59.790339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7abb2e-ccb2-466c-a2fa-43fc390da03e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:17:59.829987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cd74d-ebee-4cc9-9dcd-a80aa92695a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:17:59.830656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cd74d-ebee-4cc9-9dcd-a80aa92695a8 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:59.830884 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cd74d-ebee-4cc9-9dcd-a80aa92695a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:59.831151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cd74d-ebee-4cc9-9dcd-a80aa92695a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:59.839269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ee30a-503b-449d-9089-115653d8312c None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:59.839551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ee30a-503b-449d-9089-115653d8312c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:59.839822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ee30a-503b-449d-9089-115653d8312c None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:59.841320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 516/1040] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:17:59.846133 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20847b37-6ded-4b2e-a3eb-24e8af766a61 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:17:59.846428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20847b37-6ded-4b2e-a3eb-24e8af766a61 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:17:59.846709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20847b37-6ded-4b2e-a3eb-24e8af766a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:17:59.867944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-20847b37-6ded-4b2e-a3eb-24e8af766a61 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:17:59.869471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-20847b37-6ded-4b2e-a3eb-24e8af766a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:17:59.910611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cd74d-ebee-4cc9-9dcd-a80aa92695a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:17:59.912869 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cd74d-ebee-4cc9-9dcd-a80aa92695a8 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:17:59.955196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 517/1041] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:17:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:17:59.982562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:00.031174 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 525/1042] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:17:59 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:18:00.038000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20847b37-6ded-4b2e-a3eb-24e8af766a61 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:00.131714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:00.155792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20847b37-6ded-4b2e-a3eb-24e8af766a61 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:00.196168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5052ba-0ff2-4615-89d0-d6a907e7555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:00.196816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5052ba-0ff2-4615-89d0-d6a907e7555c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:00.197094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5052ba-0ff2-4615-89d0-d6a907e7555c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:00.197377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5052ba-0ff2-4615-89d0-d6a907e7555c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:00.209479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5052ba-0ff2-4615-89d0-d6a907e7555c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:00.211197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5052ba-0ff2-4615-89d0-d6a907e7555c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0d5052ba-0ff2-4615-89d0-d6a907e7555c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:18:00.228694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:00.234239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:18:00.235242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:18:00.235242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:00.235242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:00.235242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 518/1043] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:00.235481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cd74d-ebee-4cc9-9dcd-a80aa92695a8 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:00.238331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5052ba-0ff2-4615-89d0-d6a907e7555c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:00.359640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cd74d-ebee-4cc9-9dcd-a80aa92695a8 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:00.375166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5052ba-0ff2-4615-89d0-d6a907e7555c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:00.397940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c67c4-2348-40d5-9b64-dd12cfc7234d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:00.398592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c67c4-2348-40d5-9b64-dd12cfc7234d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:00.398878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c67c4-2348-40d5-9b64-dd12cfc7234d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:00.399148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c67c4-2348-40d5-9b64-dd12cfc7234d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:00.404268 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:00.412227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c67c4-2348-40d5-9b64-dd12cfc7234d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:00.414637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72feb9-b119-48b0-a5ab-bbfc4d55e9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:00.415253 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72feb9-b119-48b0-a5ab-bbfc4d55e9bd None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:00.415531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72feb9-b119-48b0-a5ab-bbfc4d55e9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:00.415953 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae72feb9-b119-48b0-a5ab-bbfc4d55e9bd None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:00.416603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72feb9-b119-48b0-a5ab-bbfc4d55e9bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:00.416904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72feb9-b119-48b0-a5ab-bbfc4d55e9bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-cc9c67c4-2348-40d5-9b64-dd12cfc7234d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:00.417190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:00.418160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:00.419591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:00.420275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae72feb9-b119-48b0-a5ab-bbfc4d55e9bd None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:00.420349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 526/1044] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:00.424232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c67c4-2348-40d5-9b64-dd12cfc7234d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:00.438246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 519/1045] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:00.442300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72feb9-b119-48b0-a5ab-bbfc4d55e9bd None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:00.455239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:00.561469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c67c4-2348-40d5-9b64-dd12cfc7234d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:00.561997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae72feb9-b119-48b0-a5ab-bbfc4d55e9bd None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:00.600644 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa9c55-80b5-4c65-9b5c-db07f563dcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:00.601284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9c55-80b5-4c65-9b5c-db07f563dcdf None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:00.601561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9c55-80b5-4c65-9b5c-db07f563dcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:00.601831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa9c55-80b5-4c65-9b5c-db07f563dcdf None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:00.602529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa9c55-80b5-4c65-9b5c-db07f563dcdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:00.602826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa9c55-80b5-4c65-9b5c-db07f563dcdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:00.603690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdc065-97a4-4593-acba-4e7d0d98949c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:00.604489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa9c55-80b5-4c65-9b5c-db07f563dcdf None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:00.604668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdc065-97a4-4593-acba-4e7d0d98949c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:00.604945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdc065-97a4-4593-acba-4e7d0d98949c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:00.605225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdc065-97a4-4593-acba-4e7d0d98949c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:00.612933 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdc065-97a4-4593-acba-4e7d0d98949c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:00.613974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 527/1046] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:00.614333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdc065-97a4-4593-acba-4e7d0d98949c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:00.620494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa9c55-80b5-4c65-9b5c-db07f563dcdf None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-dcbdc065-97a4-4593-acba-4e7d0d98949c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:18:00.628348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:00.629357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:00.630387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:18:00.630387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:18:00.630387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:18:00.630387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:18:00.630387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:18:00.630387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:18:00.630387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:18:00.630387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:00.630387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 520/1047] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:18:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:00.637331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdc065-97a4-4593-acba-4e7d0d98949c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:00.691786 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:00.723630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:00.745225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa9c55-80b5-4c65-9b5c-db07f563dcdf None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:00.762792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdc065-97a4-4593-acba-4e7d0d98949c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:00.790702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e00db-2749-4c0b-93f3-ba99c91860d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:00.791407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e00db-2749-4c0b-93f3-ba99c91860d9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:00.791746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e00db-2749-4c0b-93f3-ba99c91860d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:00.792151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e00db-2749-4c0b-93f3-ba99c91860d9 None admin] PATH_INFO: `/v3/users/8715b49ec17942ea98bd67682225c806` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:00.807632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ba79-4b21-4817-b142-a84917cbc9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:00.808018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e00db-2749-4c0b-93f3-ba99c91860d9 None admin] RBAC: Authorizing `identity:get_user(user_id=8715b49ec17942ea98bd67682225c806)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:00.808407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ba79-4b21-4817-b142-a84917cbc9a2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:00.808757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ba79-4b21-4817-b142-a84917cbc9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:00.809099 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6ba79-4b21-4817-b142-a84917cbc9a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:00.809464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e00db-2749-4c0b-93f3-ba99c91860d9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:00.809957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6ba79-4b21-4817-b142-a84917cbc9a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:00.810331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6ba79-4b21-4817-b142-a84917cbc9a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:00.811401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 528/1048] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:00 2022] GET /identity/v3/users/8715b49ec17942ea98bd67682225c806 => generated 285 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:00.811875 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6ba79-4b21-4817-b142-a84917cbc9a2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:00.816972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e00db-2749-4c0b-93f3-ba99c91860d9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:00.832637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 521/1049] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:18:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:00.835303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ba79-4b21-4817-b142-a84917cbc9a2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:00.942172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e00db-2749-4c0b-93f3-ba99c91860d9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:00.948337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6ba79-4b21-4817-b142-a84917cbc9a2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:00.956802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:00.983654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95d79e-5f32-4207-a0df-f5c2dc4d8f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:00.984268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d79e-5f32-4207-a0df-f5c2dc4d8f79 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:00.984543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d79e-5f32-4207-a0df-f5c2dc4d8f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:00.984874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95d79e-5f32-4207-a0df-f5c2dc4d8f79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:00.987653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0be98-4652-4903-94f6-d29cab1eef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:00.988407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0be98-4652-4903-94f6-d29cab1eef7e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:00.988748 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0be98-4652-4903-94f6-d29cab1eef7e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:00.989084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0be98-4652-4903-94f6-d29cab1eef7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:00.990521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0be98-4652-4903-94f6-d29cab1eef7e None admin] RBAC: Adding query filter params (role.id=0b8370159a9242fbb3f4de16c8c1fd99, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=060b6347b13b4f67bf47169f5668b205) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:00.990834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0be98-4652-4903-94f6-d29cab1eef7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:00.992303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0be98-4652-4903-94f6-d29cab1eef7e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:00.998603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 522/1050] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:00 2022] GET /identity/v3/role_assignments?user.id=060b6347b13b4f67bf47169f5668b205&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=0b8370159a9242fbb3f4de16c8c1fd99 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:01.006510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:01.082356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95d79e-5f32-4207-a0df-f5c2dc4d8f79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:01.084245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95d79e-5f32-4207-a0df-f5c2dc4d8f79 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:01.215716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 529/1051] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:00 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:18:01.221604 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0be98-4652-4903-94f6-d29cab1eef7e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:01.346685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0be98-4652-4903-94f6-d29cab1eef7e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:01.386277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74277a7f-2358-4ab1-ae01-7ec3c55dc1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:01.387102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277a7f-2358-4ab1-ae01-7ec3c55dc1de None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:01.387482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277a7f-2358-4ab1-ae01-7ec3c55dc1de None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:01.387853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74277a7f-2358-4ab1-ae01-7ec3c55dc1de None admin] PATH_INFO: `/v3/projects/1cdf28a1363b4a86bffd24293ade28a3` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:01.389100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74277a7f-2358-4ab1-ae01-7ec3c55dc1de None admin] RBAC: Authorizing `identity:get_project(project_id=1cdf28a1363b4a86bffd24293ade28a3)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:01.390645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74277a7f-2358-4ab1-ae01-7ec3c55dc1de None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:01.392630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 523/1052] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:01 2022] GET /identity/v3/projects/1cdf28a1363b4a86bffd24293ade28a3 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:01.399122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95d79e-5f32-4207-a0df-f5c2dc4d8f79 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:01.449587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:01.511203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4c88f-aee2-47af-8385-8f84e988820d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:01.511564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4c88f-aee2-47af-8385-8f84e988820d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:01.512019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4c88f-aee2-47af-8385-8f84e988820d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:01.514416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 524/1053] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:01.520072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653720ee-1e49-41be-b09c-781089357125 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:01.520411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653720ee-1e49-41be-b09c-781089357125 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:01.520782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653720ee-1e49-41be-b09c-781089357125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:01.533385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95d79e-5f32-4207-a0df-f5c2dc4d8f79 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:01.543623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-653720ee-1e49-41be-b09c-781089357125 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:01.544918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-653720ee-1e49-41be-b09c-781089357125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:01.581128 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7bee6-fca1-4d7d-ae3a-a50abde12d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:01.581560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:01.581950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7bee6-fca1-4d7d-ae3a-a50abde12d09 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:01.582264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7bee6-fca1-4d7d-ae3a-a50abde12d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:01.582663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7bee6-fca1-4d7d-ae3a-a50abde12d09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:01.583559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7bee6-fca1-4d7d-ae3a-a50abde12d09 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=1cdf28a1363b4a86bffd24293ade28a3, user.id=8715b49ec17942ea98bd67682225c806) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:01.584613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7bee6-fca1-4d7d-ae3a-a50abde12d09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:01.586150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7bee6-fca1-4d7d-ae3a-a50abde12d09 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:01.601909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 530/1054] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:01 2022] GET /identity/v3/role_assignments?user.id=8715b49ec17942ea98bd67682225c806&scope.project.id=1cdf28a1363b4a86bffd24293ade28a3&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:01.638649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 525/1055] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:18:01.922990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7bee6-fca1-4d7d-ae3a-a50abde12d09 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:02.044254 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7bee6-fca1-4d7d-ae3a-a50abde12d09 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:02.048362 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:02.090604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce93db2-7bd0-456f-a3ba-f43ab53fbf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:02.091257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93db2-7bd0-456f-a3ba-f43ab53fbf17 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:02.091537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93db2-7bd0-456f-a3ba-f43ab53fbf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:02.091814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce93db2-7bd0-456f-a3ba-f43ab53fbf17 None admin] PATH_INFO: `/v3/services/image` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:02.093690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce93db2-7bd0-456f-a3ba-f43ab53fbf17 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:02.093827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce93db2-7bd0-456f-a3ba-f43ab53fbf17 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9ce93db2-7bd0-456f-a3ba-f43ab53fbf17 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:02.106971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:02.108215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 16:18:02.109228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:02.111214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 531/1056] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Sep 1 16:18:01 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:02.118064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653720ee-1e49-41be-b09c-781089357125 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:02.242609 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653720ee-1e49-41be-b09c-781089357125 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:02.280484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5acb0-f896-4480-b25e-38e28bae54e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:02.281517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5acb0-f896-4480-b25e-38e28bae54e9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:02.282059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5acb0-f896-4480-b25e-38e28bae54e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:02.282547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5acb0-f896-4480-b25e-38e28bae54e9 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:02.283721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5acb0-f896-4480-b25e-38e28bae54e9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:02.284266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5acb0-f896-4480-b25e-38e28bae54e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:02.286861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5acb0-f896-4480-b25e-38e28bae54e9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:02.294641 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 526/1057] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:02.300373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce93db2-7bd0-456f-a3ba-f43ab53fbf17 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:02.417823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce93db2-7bd0-456f-a3ba-f43ab53fbf17 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:02.458052 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9d4ec-08d0-42b5-8157-10960c1b169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:02.458856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d4ec-08d0-42b5-8157-10960c1b169a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:02.459300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d4ec-08d0-42b5-8157-10960c1b169a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:02.459577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d4ec-08d0-42b5-8157-10960c1b169a None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:02.460222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9d4ec-08d0-42b5-8157-10960c1b169a None admin] RBAC: Adding query filter params (type=image) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:02.460525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9d4ec-08d0-42b5-8157-10960c1b169a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:02.461923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9d4ec-08d0-42b5-8157-10960c1b169a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:02.468422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 532/1058] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:02.474174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5acb0-f896-4480-b25e-38e28bae54e9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:02.509745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:02.587787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5acb0-f896-4480-b25e-38e28bae54e9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:02.628227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40d3bb-dde5-4e9f-a7cb-0139bbbba359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:02.628845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d3bb-dde5-4e9f-a7cb-0139bbbba359 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:02.629124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d3bb-dde5-4e9f-a7cb-0139bbbba359 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:02.629396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40d3bb-dde5-4e9f-a7cb-0139bbbba359 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:02.631910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40d3bb-dde5-4e9f-a7cb-0139bbbba359 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:02.632491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40d3bb-dde5-4e9f-a7cb-0139bbbba359 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:02.745918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 527/1059] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:18:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:03.030404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d29f3-c5f1-474d-83e1-5afdac3e9314 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:03.030667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d29f3-c5f1-474d-83e1-5afdac3e9314 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:03.031024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d29f3-c5f1-474d-83e1-5afdac3e9314 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:03.032309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 533/1060] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:03.039421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802ad0-3838-4246-a232-83c2a9fc8003 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:03.039714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802ad0-3838-4246-a232-83c2a9fc8003 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:03.039967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0802ad0-3838-4246-a232-83c2a9fc8003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:03.061099 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f0802ad0-3838-4246-a232-83c2a9fc8003 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:03.062353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f0802ad0-3838-4246-a232-83c2a9fc8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:03.165972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 528/1061] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Sep 01 16:18:03.434270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d29f3-c5f1-474d-83e1-5afdac3e9314 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:03.474385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:03.539618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4f0f3-2157-42b8-a0d3-5a352a9adaf4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:03.540194 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4f0f3-2157-42b8-a0d3-5a352a9adaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:03.540462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4f0f3-2157-42b8-a0d3-5a352a9adaf4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:03.542042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 529/1062] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:03.547370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4792-e05b-4c20-9849-56a7a6961595 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:03.547646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4792-e05b-4c20-9849-56a7a6961595 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:03.547970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4792-e05b-4c20-9849-56a7a6961595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:03.568645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-118c4792-e05b-4c20-9849-56a7a6961595 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:03.569819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-118c4792-e05b-4c20-9849-56a7a6961595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:03.578626 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d29f3-c5f1-474d-83e1-5afdac3e9314 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:03.580476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:03.624064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acb58d-6529-4289-a958-3d91e38514ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:03.624695 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acb58d-6529-4289-a958-3d91e38514ea None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:03.624968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acb58d-6529-4289-a958-3d91e38514ea None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:03.625235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acb58d-6529-4289-a958-3d91e38514ea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:03.636744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acb58d-6529-4289-a958-3d91e38514ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-a8acb58d-6529-4289-a958-3d91e38514ea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:03.641562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:03.642592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:18:03.643471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:03.647871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 534/1063] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 1 16:18:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:03.648927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acb58d-6529-4289-a958-3d91e38514ea None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:03.658122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 530/1064] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:03.759396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:03.769693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acb58d-6529-4289-a958-3d91e38514ea None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:03.812259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36625166-4338-4fa5-afc9-fbc1ee14380f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:03.812877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36625166-4338-4fa5-afc9-fbc1ee14380f None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:03.813155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36625166-4338-4fa5-afc9-fbc1ee14380f None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:03.813427 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36625166-4338-4fa5-afc9-fbc1ee14380f None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:03.814129 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36625166-4338-4fa5-afc9-fbc1ee14380f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:03.814439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36625166-4338-4fa5-afc9-fbc1ee14380f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:03.815819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36625166-4338-4fa5-afc9-fbc1ee14380f None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:03.827579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 535/1065] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 1 16:18:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:03.834098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4792-e05b-4c20-9849-56a7a6961595 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:03.944219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36625166-4338-4fa5-afc9-fbc1ee14380f None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:03.966147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4792-e05b-4c20-9849-56a7a6961595 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:04.006736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9a829-f5c8-401c-8ecb-23a71d8b0830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:04.007385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9a829-f5c8-401c-8ecb-23a71d8b0830 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.007665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9a829-f5c8-401c-8ecb-23a71d8b0830 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.007937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9a829-f5c8-401c-8ecb-23a71d8b0830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.018473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9a829-f5c8-401c-8ecb-23a71d8b0830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:04.019847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9a829-f5c8-401c-8ecb-23a71d8b0830 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:04.028327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-76b9a829-f5c8-401c-8ecb-23a71d8b0830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:18:04.043815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:04.045348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:18:04.046456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:18:04.046456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:04.046456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:04.053075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 531/1066] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:04.055037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9a829-f5c8-401c-8ecb-23a71d8b0830 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:04.066766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36625166-4338-4fa5-afc9-fbc1ee14380f None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:04.109032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb6715-f94b-403a-b7e2-e84993abb21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:04.109674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb6715-f94b-403a-b7e2-e84993abb21e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.109994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb6715-f94b-403a-b7e2-e84993abb21e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.110267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb6715-f94b-403a-b7e2-e84993abb21e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.122314 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb6715-f94b-403a-b7e2-e84993abb21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-ebeb6715-f94b-403a-b7e2-e84993abb21e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:04.127334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:04.128446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:04.129363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 536/1067] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:04.135385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb6715-f94b-403a-b7e2-e84993abb21e None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:04.153372 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:04.204205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9a829-f5c8-401c-8ecb-23a71d8b0830 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:04.270272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d1fc9-b8a0-4352-9f36-ed89ef81d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:04.270983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d1fc9-b8a0-4352-9f36-ed89ef81d996 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.271252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d1fc9-b8a0-4352-9f36-ed89ef81d996 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.271525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d1fc9-b8a0-4352-9f36-ed89ef81d996 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.273337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d1fc9-b8a0-4352-9f36-ed89ef81d996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:04.273643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d1fc9-b8a0-4352-9f36-ed89ef81d996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:04.274136 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb6715-f94b-403a-b7e2-e84993abb21e None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:04.275069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d1fc9-b8a0-4352-9f36-ed89ef81d996 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:04.289158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 532/1068] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:04.294804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d1fc9-b8a0-4352-9f36-ed89ef81d996 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:04.317738 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328689e5-31b9-463c-b6af-ebcfc9cf6d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:04.319463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328689e5-31b9-463c-b6af-ebcfc9cf6d66 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.319463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328689e5-31b9-463c-b6af-ebcfc9cf6d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.319463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328689e5-31b9-463c-b6af-ebcfc9cf6d66 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.319945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328689e5-31b9-463c-b6af-ebcfc9cf6d66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:04.320281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328689e5-31b9-463c-b6af-ebcfc9cf6d66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:04.321614 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328689e5-31b9-463c-b6af-ebcfc9cf6d66 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:04.332236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 537/1069] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:04.338941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328689e5-31b9-463c-b6af-ebcfc9cf6d66 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:04.373307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:04.425181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d1fc9-b8a0-4352-9f36-ed89ef81d996 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:04.435729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:04.466583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f774e4-2dab-4ce3-ae69-b86b1d478c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:04.467255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f774e4-2dab-4ce3-ae69-b86b1d478c72 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.467537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f774e4-2dab-4ce3-ae69-b86b1d478c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.467810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f774e4-2dab-4ce3-ae69-b86b1d478c72 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.473098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328689e5-31b9-463c-b6af-ebcfc9cf6d66 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:04.479103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f774e4-2dab-4ce3-ae69-b86b1d478c72 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:04.480839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f774e4-2dab-4ce3-ae69-b86b1d478c72 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-48f774e4-2dab-4ce3-ae69-b86b1d478c72 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:18:04.495368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:04.496615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:04.497755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:04.497755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:04.497755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:18:04.497755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:18:04.497755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:18:04.497755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:18:04.497755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:18:04.497755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:18:04.497755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:18:04.497755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:04.497755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 533/1070] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 1 16:18:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:04.502717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f774e4-2dab-4ce3-ae69-b86b1d478c72 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:04.524855 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07949b3b-8b45-430c-97d5-f7e46b512adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:04.525432 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07949b3b-8b45-430c-97d5-f7e46b512adb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.525713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07949b3b-8b45-430c-97d5-f7e46b512adb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.526021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07949b3b-8b45-430c-97d5-f7e46b512adb None admin] PATH_INFO: `/v3/users/8715b49ec17942ea98bd67682225c806` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.527207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07949b3b-8b45-430c-97d5-f7e46b512adb None admin] RBAC: Authorizing `identity:get_user(user_id=8715b49ec17942ea98bd67682225c806)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:04.528651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07949b3b-8b45-430c-97d5-f7e46b512adb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:04.530469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 538/1071] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:04 2022] GET /identity/v3/users/8715b49ec17942ea98bd67682225c806 => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:04.536024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07949b3b-8b45-430c-97d5-f7e46b512adb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:04.633437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f774e4-2dab-4ce3-ae69-b86b1d478c72 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:04.651574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:04.664963 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07949b3b-8b45-430c-97d5-f7e46b512adb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:04.673266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086acdbd-4d33-4071-b4bc-ca701dd2df5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:04.673958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086acdbd-4d33-4071-b4bc-ca701dd2df5c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.674205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086acdbd-4d33-4071-b4bc-ca701dd2df5c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.674479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086acdbd-4d33-4071-b4bc-ca701dd2df5c None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.675287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086acdbd-4d33-4071-b4bc-ca701dd2df5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:04.675598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086acdbd-4d33-4071-b4bc-ca701dd2df5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:04.677116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086acdbd-4d33-4071-b4bc-ca701dd2df5c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:04.701118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 534/1072] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 1 16:18:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:04.702241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086acdbd-4d33-4071-b4bc-ca701dd2df5c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:04.704716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac08fe-9ac8-4d63-8306-324200488387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:04.705364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac08fe-9ac8-4d63-8306-324200488387 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.705653 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac08fe-9ac8-4d63-8306-324200488387 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.705935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac08fe-9ac8-4d63-8306-324200488387 None admin] PATH_INFO: `/v3/projects/1cdf28a1363b4a86bffd24293ade28a3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.707088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac08fe-9ac8-4d63-8306-324200488387 None admin] RBAC: Authorizing `identity:get_project(project_id=1cdf28a1363b4a86bffd24293ade28a3)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:04.709551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac08fe-9ac8-4d63-8306-324200488387 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:04.711566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 539/1073] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:04 2022] GET /identity/v3/projects/1cdf28a1363b4a86bffd24293ade28a3 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:04.717447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac08fe-9ac8-4d63-8306-324200488387 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:04.735417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:04.824845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086acdbd-4d33-4071-b4bc-ca701dd2df5c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:04.836676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac08fe-9ac8-4d63-8306-324200488387 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:04.861396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbce708-48c6-47a2-b519-626b7c54706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:04.862082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce708-48c6-47a2-b519-626b7c54706a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.862363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce708-48c6-47a2-b519-626b7c54706a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.862632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbce708-48c6-47a2-b519-626b7c54706a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.872426 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b77488-1d6f-4ba3-b46f-a5f9bd9c13ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:04.873098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77488-1d6f-4ba3-b46f-a5f9bd9c13ca None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.873375 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77488-1d6f-4ba3-b46f-a5f9bd9c13ca None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.873516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbce708-48c6-47a2-b519-626b7c54706a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:04.873643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77488-1d6f-4ba3-b46f-a5f9bd9c13ca None admin] PATH_INFO: `/v3/projects/1cdf28a1363b4a86bffd24293ade28a3/users/8715b49ec17942ea98bd67682225c806/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.874983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbce708-48c6-47a2-b519-626b7c54706a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:04.875585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b77488-1d6f-4ba3-b46f-a5f9bd9c13ca None admin] RBAC: Authorizing `identity:create_grant(project_id=1cdf28a1363b4a86bffd24293ade28a3, user_id=8715b49ec17942ea98bd67682225c806, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:04.876995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b77488-1d6f-4ba3-b46f-a5f9bd9c13ca None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-1dbce708-48c6-47a2-b519-626b7c54706a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:18:04.890310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:04.895329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:18:04.896958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:18:04.896958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:04.896958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:04.896958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 535/1074] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:04.896958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f290498-dc65-4d8f-9855-e0791fdc10e8 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.896958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f290498-dc65-4d8f-9855-e0791fdc10e8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.896958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f290498-dc65-4d8f-9855-e0791fdc10e8 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.896958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 536/1075] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:04.897831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f290498-dc65-4d8f-9855-e0791fdc10e8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:04.926059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:04.969824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 540/1076] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:04 2022] PUT /identity/v3/projects/1cdf28a1363b4a86bffd24293ade28a3/users/8715b49ec17942ea98bd67682225c806/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:18:04.971134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f807a-7faf-45f1-b506-3c69b15eabc9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:04.971420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f807a-7faf-45f1-b506-3c69b15eabc9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:04.971693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f807a-7faf-45f1-b506-3c69b15eabc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:04.994328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c67f807a-7faf-45f1-b506-3c69b15eabc9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:04.995578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c67f807a-7faf-45f1-b506-3c69b15eabc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:05.025820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f290498-dc65-4d8f-9855-e0791fdc10e8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:05.071470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ac629-483c-4703-ae61-dd9a3957a613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:05.072099 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ac629-483c-4703-ae61-dd9a3957a613 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:05.072404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ac629-483c-4703-ae61-dd9a3957a613 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:05.072650 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ac629-483c-4703-ae61-dd9a3957a613 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:05.073306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ac629-483c-4703-ae61-dd9a3957a613 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:05.073653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ac629-483c-4703-ae61-dd9a3957a613 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:05.075101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ac629-483c-4703-ae61-dd9a3957a613 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:05.086602 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 541/1077] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:05.095197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 537/1078] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:05.096573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f807a-7faf-45f1-b506-3c69b15eabc9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:05.102391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:05.219896 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f807a-7faf-45f1-b506-3c69b15eabc9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:05.258259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82159552-e993-4b39-b794-fcd6f4f525ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:05.259061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82159552-e993-4b39-b794-fcd6f4f525ff None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:05.259431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82159552-e993-4b39-b794-fcd6f4f525ff None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:05.259795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82159552-e993-4b39-b794-fcd6f4f525ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:05.267054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82159552-e993-4b39-b794-fcd6f4f525ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:05.268622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82159552-e993-4b39-b794-fcd6f4f525ff None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-82159552-e993-4b39-b794-fcd6f4f525ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:18:05.280833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:05.282022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:05.283166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:18:05.283166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:18:05.283166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:18:05.283166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:18:05.283166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:18:05.283166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:18:05.283166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:18:05.283166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:05.289954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 542/1079] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:18:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:05.291181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ac629-483c-4703-ae61-dd9a3957a613 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:05.360688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82159552-e993-4b39-b794-fcd6f4f525ff None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:05.387191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:05.404963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ac629-483c-4703-ae61-dd9a3957a613 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:05.431873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:05.445471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba0ff2-6f70-44e3-99f2-69d6fb1928ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:05.451238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba0ff2-6f70-44e3-99f2-69d6fb1928ad None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:05.451238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba0ff2-6f70-44e3-99f2-69d6fb1928ad None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:05.451238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba0ff2-6f70-44e3-99f2-69d6fb1928ad None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:05.451238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba0ff2-6f70-44e3-99f2-69d6fb1928ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:05.451238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba0ff2-6f70-44e3-99f2-69d6fb1928ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:05.451238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba0ff2-6f70-44e3-99f2-69d6fb1928ad None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:05.468345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 538/1080] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:18:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:05.469613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba0ff2-6f70-44e3-99f2-69d6fb1928ad None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:05.481651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82159552-e993-4b39-b794-fcd6f4f525ff None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:05.519750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba73e7-a1e4-4bf4-a7ac-ce833dbe4539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:05.520380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba73e7-a1e4-4bf4-a7ac-ce833dbe4539 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:05.521173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba73e7-a1e4-4bf4-a7ac-ce833dbe4539 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:05.521449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba73e7-a1e4-4bf4-a7ac-ce833dbe4539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:05.594113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba0ff2-6f70-44e3-99f2-69d6fb1928ad None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:05.613820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba73e7-a1e4-4bf4-a7ac-ce833dbe4539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:05.616692 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba73e7-a1e4-4bf4-a7ac-ce833dbe4539 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:05.639469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30713872-6583-4466-8bb7-c20631e10df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:05.640229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713872-6583-4466-8bb7-c20631e10df9 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:05.640571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713872-6583-4466-8bb7-c20631e10df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:05.640915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30713872-6583-4466-8bb7-c20631e10df9 None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/060b6347b13b4f67bf47169f5668b205/roles/0b8370159a9242fbb3f4de16c8c1fd99` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:05.643867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30713872-6583-4466-8bb7-c20631e10df9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=060b6347b13b4f67bf47169f5668b205, role_id=0b8370159a9242fbb3f4de16c8c1fd99)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:05.645351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30713872-6583-4466-8bb7-c20631e10df9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:05.686638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:05.717449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 539/1081] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:05 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/060b6347b13b4f67bf47169f5668b205/roles/0b8370159a9242fbb3f4de16c8c1fd99 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:05.745906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 543/1082] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:18:05.751868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30713872-6583-4466-8bb7-c20631e10df9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:05.762958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:05.872954 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30713872-6583-4466-8bb7-c20631e10df9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:05.913031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c765a8f-47e7-4fa1-9044-e8ec0d846280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:05.913702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c765a8f-47e7-4fa1-9044-e8ec0d846280 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:05.914019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c765a8f-47e7-4fa1-9044-e8ec0d846280 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:05.914292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c765a8f-47e7-4fa1-9044-e8ec0d846280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:05.926606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c765a8f-47e7-4fa1-9044-e8ec0d846280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:05.928082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c765a8f-47e7-4fa1-9044-e8ec0d846280 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-7c765a8f-47e7-4fa1-9044-e8ec0d846280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:18:05.943962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:05.945026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:18:05.946011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:18:05.946011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:05.946011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:05.946011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 540/1083] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:05.951308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba73e7-a1e4-4bf4-a7ac-ce833dbe4539 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:06.067511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba73e7-a1e4-4bf4-a7ac-ce833dbe4539 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:06.114375 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d50b19-a8de-4a4c-aba6-e58ae0affb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:06.116753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d50b19-a8de-4a4c-aba6-e58ae0affb30 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:06.117253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d50b19-a8de-4a4c-aba6-e58ae0affb30 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:06.117708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d50b19-a8de-4a4c-aba6-e58ae0affb30 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:06.118561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d50b19-a8de-4a4c-aba6-e58ae0affb30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:06.119061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d50b19-a8de-4a4c-aba6-e58ae0affb30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:06.120684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d50b19-a8de-4a4c-aba6-e58ae0affb30 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:06.137994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 544/1084] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:06.952721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecb818-d107-40b0-b3fe-a2615e97617e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:06.953268 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecb818-d107-40b0-b3fe-a2615e97617e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:06.953268 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecb818-d107-40b0-b3fe-a2615e97617e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:06.954640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 541/1085] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:06.960716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0b6fc-dddf-48f6-b1ff-28b7d4c28e6f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:06.961538 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0b6fc-dddf-48f6-b1ff-28b7d4c28e6f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:06.961538 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0b6fc-dddf-48f6-b1ff-28b7d4c28e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:06.982096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-39d0b6fc-dddf-48f6-b1ff-28b7d4c28e6f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:06.983268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-39d0b6fc-dddf-48f6-b1ff-28b7d4c28e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:07.001538 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:07.054158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 545/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:07.326819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecb818-d107-40b0-b3fe-a2615e97617e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:07.391940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:07.436532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecb818-d107-40b0-b3fe-a2615e97617e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:07.472898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9904d4-a50d-433c-8e90-38bf1d3b417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:07.473528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9904d4-a50d-433c-8e90-38bf1d3b417d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:07.473831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9904d4-a50d-433c-8e90-38bf1d3b417d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:07.474221 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9904d4-a50d-433c-8e90-38bf1d3b417d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:07.485865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9904d4-a50d-433c-8e90-38bf1d3b417d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-7d9904d4-a50d-433c-8e90-38bf1d3b417d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:07.491328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:07.492493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:07.493367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 542/1087] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:07.498544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0b6fc-dddf-48f6-b1ff-28b7d4c28e6f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:07.610287 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0b6fc-dddf-48f6-b1ff-28b7d4c28e6f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:07.648023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884313f0-bb88-4922-9343-ce6deecee4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:07.648642 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884313f0-bb88-4922-9343-ce6deecee4ac None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:07.648917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884313f0-bb88-4922-9343-ce6deecee4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:07.649187 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884313f0-bb88-4922-9343-ce6deecee4ac None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:07.649862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884313f0-bb88-4922-9343-ce6deecee4ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:07.650188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884313f0-bb88-4922-9343-ce6deecee4ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:07.651560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884313f0-bb88-4922-9343-ce6deecee4ac None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:07.660446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 546/1088] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:07.666499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9904d4-a50d-433c-8e90-38bf1d3b417d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:07.686628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0388-0203-4eb7-af82-81cea068ad7d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:07.686907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0388-0203-4eb7-af82-81cea068ad7d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:07.687176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0388-0203-4eb7-af82-81cea068ad7d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:07.688657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 547/1089] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:07.694575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237692e-6001-44c4-9754-e54b2e0c54eb None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:07.694856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237692e-6001-44c4-9754-e54b2e0c54eb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:07.695124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237692e-6001-44c4-9754-e54b2e0c54eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:07.714651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b237692e-6001-44c4-9754-e54b2e0c54eb None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:07.715859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b237692e-6001-44c4-9754-e54b2e0c54eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:07.726163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:07.772873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9904d4-a50d-433c-8e90-38bf1d3b417d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:07.787882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 548/1090] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:18:07.790788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:07.808581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5e1d-5193-4c97-9329-f25196d0b85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:07.809227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5e1d-5193-4c97-9329-f25196d0b85f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:07.809508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5e1d-5193-4c97-9329-f25196d0b85f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:07.809779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac5e1d-5193-4c97-9329-f25196d0b85f None admin] PATH_INFO: `/v3/users/8715b49ec17942ea98bd67682225c806` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:07.810944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac5e1d-5193-4c97-9329-f25196d0b85f None admin] RBAC: Authorizing `identity:get_user(user_id=8715b49ec17942ea98bd67682225c806)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:07.812379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac5e1d-5193-4c97-9329-f25196d0b85f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:07.819424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 543/1091] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:07 2022] GET /identity/v3/users/8715b49ec17942ea98bd67682225c806 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:07.820623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237692e-6001-44c4-9754-e54b2e0c54eb None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:07.925128 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237692e-6001-44c4-9754-e54b2e0c54eb None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:07.965468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff2eb1-abf6-427a-a729-4efc59786eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:07.966180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff2eb1-abf6-427a-a729-4efc59786eab None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:07.966405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff2eb1-abf6-427a-a729-4efc59786eab None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:07.966672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff2eb1-abf6-427a-a729-4efc59786eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:07.983672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:08.039726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff2eb1-abf6-427a-a729-4efc59786eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:08.041172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff2eb1-abf6-427a-a729-4efc59786eab None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:08.057861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5e1d-5193-4c97-9329-f25196d0b85f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:08.151320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 549/1092] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:18:08.157272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff2eb1-abf6-427a-a729-4efc59786eab None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:08.177580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac5e1d-5193-4c97-9329-f25196d0b85f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:08.205408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:08.212904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afe242-ae17-4d60-947c-e785f6853976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:08.213538 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afe242-ae17-4d60-947c-e785f6853976 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:08.213814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afe242-ae17-4d60-947c-e785f6853976 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:08.214111 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afe242-ae17-4d60-947c-e785f6853976 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:08.225712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afe242-ae17-4d60-947c-e785f6853976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-c0afe242-ae17-4d60-947c-e785f6853976 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:08.230836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:08.231856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:08.232909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 544/1093] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Sep 1 16:18:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:18:08.237906 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afe242-ae17-4d60-947c-e785f6853976 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:08.261396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff2eb1-abf6-427a-a729-4efc59786eab None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:08.288453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:08.297633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2712-54d4-42da-8449-eda1e32cc12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:08.298315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2712-54d4-42da-8449-eda1e32cc12b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:08.298587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2712-54d4-42da-8449-eda1e32cc12b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:08.301865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2712-54d4-42da-8449-eda1e32cc12b None admin] PATH_INFO: `/v3/projects/1cdf28a1363b4a86bffd24293ade28a3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:08.301865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2712-54d4-42da-8449-eda1e32cc12b None admin] RBAC: Authorizing `identity:get_project(project_id=1cdf28a1363b4a86bffd24293ade28a3)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:08.301865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2712-54d4-42da-8449-eda1e32cc12b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:08.304232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 550/1094] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:08 2022] GET /identity/v3/projects/1cdf28a1363b4a86bffd24293ade28a3 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:08.310208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2712-54d4-42da-8449-eda1e32cc12b None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:08.355059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afe242-ae17-4d60-947c-e785f6853976 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:08.390865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63857e-9d52-4e8d-8781-1143ee057dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:08.391483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63857e-9d52-4e8d-8781-1143ee057dfb None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:08.391767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63857e-9d52-4e8d-8781-1143ee057dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:08.392036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63857e-9d52-4e8d-8781-1143ee057dfb None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:08.392703 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63857e-9d52-4e8d-8781-1143ee057dfb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:08.393009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63857e-9d52-4e8d-8781-1143ee057dfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:08.394417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63857e-9d52-4e8d-8781-1143ee057dfb None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:08.403699 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 545/1095] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 1 16:18:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:08.409375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63857e-9d52-4e8d-8781-1143ee057dfb None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:08.421408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2712-54d4-42da-8449-eda1e32cc12b None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:08.435464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:08.456673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997374d7-4549-4c08-97c4-3e96100d389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:08.457332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997374d7-4549-4c08-97c4-3e96100d389c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:08.457613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997374d7-4549-4c08-97c4-3e96100d389c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:08.457904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997374d7-4549-4c08-97c4-3e96100d389c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:08.459437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997374d7-4549-4c08-97c4-3e96100d389c None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=1cdf28a1363b4a86bffd24293ade28a3, user.id=8715b49ec17942ea98bd67682225c806) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:08.459749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997374d7-4549-4c08-97c4-3e96100d389c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:08.461170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997374d7-4549-4c08-97c4-3e96100d389c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:08.467999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 551/1096] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:08 2022] GET /identity/v3/role_assignments?user.id=8715b49ec17942ea98bd67682225c806&scope.project.id=1cdf28a1363b4a86bffd24293ade28a3&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:08.533012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63857e-9d52-4e8d-8781-1143ee057dfb None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:08.543553 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:08.571563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe34141-80a6-4a6d-bf63-87fb0c5c79c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:08.572210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe34141-80a6-4a6d-bf63-87fb0c5c79c2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:08.572485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe34141-80a6-4a6d-bf63-87fb0c5c79c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:08.572752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe34141-80a6-4a6d-bf63-87fb0c5c79c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:08.585134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe34141-80a6-4a6d-bf63-87fb0c5c79c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:08.586640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe34141-80a6-4a6d-bf63-87fb0c5c79c2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0fe34141-80a6-4a6d-bf63-87fb0c5c79c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:18:08.602262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:08.603341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:18:08.604557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:18:08.604557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:08.604557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:08.604557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 546/1097] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:08.609860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997374d7-4549-4c08-97c4-3e96100d389c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:08.729391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997374d7-4549-4c08-97c4-3e96100d389c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:08.765075 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d328106-a37c-4934-b00c-acf73d9d6eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:08.765689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d328106-a37c-4934-b00c-acf73d9d6eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:08.766000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d328106-a37c-4934-b00c-acf73d9d6eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:08.766271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d328106-a37c-4934-b00c-acf73d9d6eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:08.766915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d328106-a37c-4934-b00c-acf73d9d6eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:08.767217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d328106-a37c-4934-b00c-acf73d9d6eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:08.768576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d328106-a37c-4934-b00c-acf73d9d6eb2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:08.780776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 552/1098] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:08.787219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe34141-80a6-4a6d-bf63-87fb0c5c79c2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:08.898811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe34141-80a6-4a6d-bf63-87fb0c5c79c2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:08.936251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83ae19-4ce5-4cf3-ba5e-b1ecdbb98929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:08.936877 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ae19-4ce5-4cf3-ba5e-b1ecdbb98929 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:08.937151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ae19-4ce5-4cf3-ba5e-b1ecdbb98929 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:08.937422 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83ae19-4ce5-4cf3-ba5e-b1ecdbb98929 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:08.945708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83ae19-4ce5-4cf3-ba5e-b1ecdbb98929 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:08.947313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83ae19-4ce5-4cf3-ba5e-b1ecdbb98929 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-9e83ae19-4ce5-4cf3-ba5e-b1ecdbb98929 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:18:08.960566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:08.961835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:08.962865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:08.962865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:08.962865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:18:08.962865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:18:08.962865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:18:08.962865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:18:08.962865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:18:08.962865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:18:08.962865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 16:18:08.962865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:08.962865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 547/1099] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Sep 1 16:18:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:08.968070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d328106-a37c-4934-b00c-acf73d9d6eb2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:09.005260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:09.077480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d328106-a37c-4934-b00c-acf73d9d6eb2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:09.116781 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912a9b0-d116-4317-aaa5-4f2da73f64a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:09.117407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a9b0-d116-4317-aaa5-4f2da73f64a0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:09.117688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a9b0-d116-4317-aaa5-4f2da73f64a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:09.117994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a9b0-d116-4317-aaa5-4f2da73f64a0 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:09.118732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912a9b0-d116-4317-aaa5-4f2da73f64a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:09.119033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912a9b0-d116-4317-aaa5-4f2da73f64a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:09.120460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912a9b0-d116-4317-aaa5-4f2da73f64a0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:09.139794 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 553/1100] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Sep 1 16:18:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:09.145480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83ae19-4ce5-4cf3-ba5e-b1ecdbb98929 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:09.170747 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:09.254864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83ae19-4ce5-4cf3-ba5e-b1ecdbb98929 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:09.290621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da7d10-d2fb-44a6-bab8-bfccb9cfeb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:09.291155 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7d10-d2fb-44a6-bab8-bfccb9cfeb21 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:09.291434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7d10-d2fb-44a6-bab8-bfccb9cfeb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:09.291706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7d10-d2fb-44a6-bab8-bfccb9cfeb21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:09.372003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da7d10-d2fb-44a6-bab8-bfccb9cfeb21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:09.373067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da7d10-d2fb-44a6-bab8-bfccb9cfeb21 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:09.397038 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:09.480396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 548/1101] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:18:09.486123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912a9b0-d116-4317-aaa5-4f2da73f64a0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:09.588419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:09.595411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912a9b0-d116-4317-aaa5-4f2da73f64a0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:09.637973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c0382-8473-4838-a13f-2a335fc3ca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:09.638610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c0382-8473-4838-a13f-2a335fc3ca86 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:09.638890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c0382-8473-4838-a13f-2a335fc3ca86 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:09.639161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c0382-8473-4838-a13f-2a335fc3ca86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:09.650114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c0382-8473-4838-a13f-2a335fc3ca86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:09.651561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c0382-8473-4838-a13f-2a335fc3ca86 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-fb1c0382-8473-4838-a13f-2a335fc3ca86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:18:09.667418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:09.669459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:18:09.670830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:18:09.670830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:18:09.670830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:09.670830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 554/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:09.674394 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da7d10-d2fb-44a6-bab8-bfccb9cfeb21 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:09.779824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da7d10-d2fb-44a6-bab8-bfccb9cfeb21 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:09.803380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:09.819087 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bca032-82b5-4fc2-8b5a-bd338551e0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:09.825130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bca032-82b5-4fc2-8b5a-bd338551e0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:09.825130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bca032-82b5-4fc2-8b5a-bd338551e0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:09.825130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bca032-82b5-4fc2-8b5a-bd338551e0c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:09.825130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bca032-82b5-4fc2-8b5a-bd338551e0c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:09.825130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bca032-82b5-4fc2-8b5a-bd338551e0c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:09.825130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bca032-82b5-4fc2-8b5a-bd338551e0c2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:09.836729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 549/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:09.842470 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c0382-8473-4838-a13f-2a335fc3ca86 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:09.965626 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c0382-8473-4838-a13f-2a335fc3ca86 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:10.003923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2e3db-7487-43f4-8fee-1d203d8108e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:10.004611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2e3db-7487-43f4-8fee-1d203d8108e2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:10.004818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2e3db-7487-43f4-8fee-1d203d8108e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:10.005619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2e3db-7487-43f4-8fee-1d203d8108e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:10.013594 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2e3db-7487-43f4-8fee-1d203d8108e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:10.015329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2e3db-7487-43f4-8fee-1d203d8108e2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-74c2e3db-7487-43f4-8fee-1d203d8108e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:18:10.028327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:10.030193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:10.031969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:18:10.031969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:18:10.031969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:18:10.031969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:18:10.031969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:18:10.031969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:18:10.031969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:18:10.031969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:10.031969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 555/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:18:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:10.036336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bca032-82b5-4fc2-8b5a-bd338551e0c2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:10.183376 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bca032-82b5-4fc2-8b5a-bd338551e0c2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:10.225443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42813468-3d70-43d2-bf49-23db9c3b5868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:10.226103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42813468-3d70-43d2-bf49-23db9c3b5868 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:10.226391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42813468-3d70-43d2-bf49-23db9c3b5868 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:10.226667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42813468-3d70-43d2-bf49-23db9c3b5868 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:10.227375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42813468-3d70-43d2-bf49-23db9c3b5868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:10.227676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42813468-3d70-43d2-bf49-23db9c3b5868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:10.229384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42813468-3d70-43d2-bf49-23db9c3b5868 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:10.248511 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 550/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:18:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:10.249970 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2e3db-7487-43f4-8fee-1d203d8108e2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:10.260714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:10.407370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2e3db-7487-43f4-8fee-1d203d8108e2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:10.450752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1628a-3648-4ba8-9ebb-3a23bb00ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:10.451781 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1628a-3648-4ba8-9ebb-3a23bb00ab1e None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:10.452120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1628a-3648-4ba8-9ebb-3a23bb00ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:10.452386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1628a-3648-4ba8-9ebb-3a23bb00ab1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:10.453120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1628a-3648-4ba8-9ebb-3a23bb00ab1e None admin] RBAC: Adding query filter params (role.id=0b8370159a9242fbb3f4de16c8c1fd99, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=060b6347b13b4f67bf47169f5668b205) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:10.453664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1628a-3648-4ba8-9ebb-3a23bb00ab1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:10.456214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1628a-3648-4ba8-9ebb-3a23bb00ab1e None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:10.467303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 556/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:10 2022] GET /identity/v3/role_assignments?user.id=060b6347b13b4f67bf47169f5668b205&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=0b8370159a9242fbb3f4de16c8c1fd99 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:10.544516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1ff83-622d-4aa9-91e6-8cdc010640da None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:10.544902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1ff83-622d-4aa9-91e6-8cdc010640da None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:10.545247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1ff83-622d-4aa9-91e6-8cdc010640da None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:10.546775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 551/1107] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:10.553330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febad3b3-b3cc-4d83-9883-5c9f8be4d000 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:10.553603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febad3b3-b3cc-4d83-9883-5c9f8be4d000 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:10.553907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febad3b3-b3cc-4d83-9883-5c9f8be4d000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:10.574841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-febad3b3-b3cc-4d83-9883-5c9f8be4d000 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:10.576393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-febad3b3-b3cc-4d83-9883-5c9f8be4d000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:10.670435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:10.676066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 557/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:10.970903 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1ff83-622d-4aa9-91e6-8cdc010640da None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:11.038775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:11.111132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1ff83-622d-4aa9-91e6-8cdc010640da None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:11.151984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b86b3-603c-47cb-a9af-0987365807d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:11.152640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b86b3-603c-47cb-a9af-0987365807d2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:11.152922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b86b3-603c-47cb-a9af-0987365807d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:11.153202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b86b3-603c-47cb-a9af-0987365807d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:11.154374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b86b3-603c-47cb-a9af-0987365807d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:11.155815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b86b3-603c-47cb-a9af-0987365807d2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:11.157427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 552/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:11.164018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febad3b3-b3cc-4d83-9883-5c9f8be4d000 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:11.278739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febad3b3-b3cc-4d83-9883-5c9f8be4d000 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:11.328198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea48d40-2ac9-491b-9304-07d6676f394a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:11.328813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48d40-2ac9-491b-9304-07d6676f394a None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:11.329087 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48d40-2ac9-491b-9304-07d6676f394a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:11.329359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea48d40-2ac9-491b-9304-07d6676f394a None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:11.330084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea48d40-2ac9-491b-9304-07d6676f394a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:11.331509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea48d40-2ac9-491b-9304-07d6676f394a None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:11.416428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 558/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:18:11 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:13.415671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342013a1-9ff8-4337-9520-ef2d0b612cba None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:13.416265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342013a1-9ff8-4337-9520-ef2d0b612cba None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:13.416265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342013a1-9ff8-4337-9520-ef2d0b612cba None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:13.417562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 553/1111] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:13.422836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee28f45-02c3-4f38-8f59-0dbefab52ee2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:13.423279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee28f45-02c3-4f38-8f59-0dbefab52ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:13.423388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee28f45-02c3-4f38-8f59-0dbefab52ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:13.442225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9ee28f45-02c3-4f38-8f59-0dbefab52ee2 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:13.443726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9ee28f45-02c3-4f38-8f59-0dbefab52ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:13.495252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:13.512751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 559/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:13.783893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342013a1-9ff8-4337-9520-ef2d0b612cba None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:13.884540 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342013a1-9ff8-4337-9520-ef2d0b612cba None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:13.893474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:13.919364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42885d07-1646-4aa5-b194-e04a2e18479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:13.919992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42885d07-1646-4aa5-b194-e04a2e18479d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:13.920268 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42885d07-1646-4aa5-b194-e04a2e18479d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:13.920533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42885d07-1646-4aa5-b194-e04a2e18479d None admin] PATH_INFO: `/v3/roles/57a8970530a24c16b8d86a333768e765` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:13.921935 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42885d07-1646-4aa5-b194-e04a2e18479d None admin] RBAC: Authorizing `identity:get_role(role_id=57a8970530a24c16b8d86a333768e765)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:13.923273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42885d07-1646-4aa5-b194-e04a2e18479d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:13.924603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 554/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:13 2022] GET /identity/v3/roles/57a8970530a24c16b8d86a333768e765 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:13.930605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee28f45-02c3-4f38-8f59-0dbefab52ee2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:14.030141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee28f45-02c3-4f38-8f59-0dbefab52ee2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:14.063882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54405390-2fca-4206-b1ac-0aa098a587bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:14.064438 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54405390-2fca-4206-b1ac-0aa098a587bd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:14.064715 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54405390-2fca-4206-b1ac-0aa098a587bd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:14.064985 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54405390-2fca-4206-b1ac-0aa098a587bd None admin] PATH_INFO: `/v3/users/9b4391a9ee07447d8649461e91a0ce2c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:14.078724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54405390-2fca-4206-b1ac-0aa098a587bd None admin] RBAC: Authorizing `identity:get_user(user_id=9b4391a9ee07447d8649461e91a0ce2c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:14.080147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54405390-2fca-4206-b1ac-0aa098a587bd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:14.081755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 560/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:13 2022] GET /identity/v3/users/9b4391a9ee07447d8649461e91a0ce2c => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:14.088606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42885d07-1646-4aa5-b194-e04a2e18479d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:14.190444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42885d07-1646-4aa5-b194-e04a2e18479d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:14.226770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba31054-af52-4a01-9b4b-f01db86a96fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:14.227392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba31054-af52-4a01-9b4b-f01db86a96fd None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:14.227673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba31054-af52-4a01-9b4b-f01db86a96fd None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:14.227947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba31054-af52-4a01-9b4b-f01db86a96fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:14.276402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:14.298889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba31054-af52-4a01-9b4b-f01db86a96fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:14.300318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba31054-af52-4a01-9b4b-f01db86a96fd None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:14.401519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 555/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:18:14.407551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54405390-2fca-4206-b1ac-0aa098a587bd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:14.461184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:14.515923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54405390-2fca-4206-b1ac-0aa098a587bd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:14.550455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009f866-20f6-4fc9-b67c-79b04b183dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:14.551082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009f866-20f6-4fc9-b67c-79b04b183dad None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:14.551357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009f866-20f6-4fc9-b67c-79b04b183dad None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:14.551720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009f866-20f6-4fc9-b67c-79b04b183dad None admin] PATH_INFO: `/v3/projects/1cdf28a1363b4a86bffd24293ade28a3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:14.553666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009f866-20f6-4fc9-b67c-79b04b183dad None admin] RBAC: Authorizing `identity:get_project(project_id=1cdf28a1363b4a86bffd24293ade28a3)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:14.555107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009f866-20f6-4fc9-b67c-79b04b183dad None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:14.557466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 561/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:14 2022] GET /identity/v3/projects/1cdf28a1363b4a86bffd24293ade28a3 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:14.563151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba31054-af52-4a01-9b4b-f01db86a96fd None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:14.645967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:14.674237 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba31054-af52-4a01-9b4b-f01db86a96fd None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:14.712162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f3196-ee92-4d6b-9369-08c121b19b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:14.712785 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3196-ee92-4d6b-9369-08c121b19b71 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:14.713066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3196-ee92-4d6b-9369-08c121b19b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:14.713338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3196-ee92-4d6b-9369-08c121b19b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:14.714093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f3196-ee92-4d6b-9369-08c121b19b71 None admin] RBAC: Adding query filter params (role.id=57a8970530a24c16b8d86a333768e765, scope.project.id=1cdf28a1363b4a86bffd24293ade28a3, user.id=9b4391a9ee07447d8649461e91a0ce2c) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:14.714400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f3196-ee92-4d6b-9369-08c121b19b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:14.715810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f3196-ee92-4d6b-9369-08c121b19b71 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:14.721713 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 556/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:14 2022] GET /identity/v3/role_assignments?user.id=9b4391a9ee07447d8649461e91a0ce2c&scope.project.id=1cdf28a1363b4a86bffd24293ade28a3&role.id=57a8970530a24c16b8d86a333768e765 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:16.676339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118abb2-d4bf-4c35-ab28-ae5a661c4f0a None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:16.677536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118abb2-d4bf-4c35-ab28-ae5a661c4f0a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:16.677536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118abb2-d4bf-4c35-ab28-ae5a661c4f0a None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:16.678888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 562/1118] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:16.684310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715e115-928d-4ff2-a638-a8b6c21953cc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:16.684777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715e115-928d-4ff2-a638-a8b6c21953cc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:16.684873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715e115-928d-4ff2-a638-a8b6c21953cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:16.703563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c715e115-928d-4ff2-a638-a8b6c21953cc None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:16.704780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c715e115-928d-4ff2-a638-a8b6c21953cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:16.773955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 557/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:17.049950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118abb2-d4bf-4c35-ab28-ae5a661c4f0a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:17.157971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118abb2-d4bf-4c35-ab28-ae5a661c4f0a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:17.171084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:17.191269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a518c-2839-4c98-99dc-8ce46f7fde90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:17.191898 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a518c-2839-4c98-99dc-8ce46f7fde90 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.192170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a518c-2839-4c98-99dc-8ce46f7fde90 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.192972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a518c-2839-4c98-99dc-8ce46f7fde90 None admin] PATH_INFO: `/v3/roles/57a8970530a24c16b8d86a333768e765` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.194425 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a518c-2839-4c98-99dc-8ce46f7fde90 None admin] RBAC: Authorizing `identity:get_role(role_id=57a8970530a24c16b8d86a333768e765)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:17.195778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a518c-2839-4c98-99dc-8ce46f7fde90 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:17.197143 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 563/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:17 2022] GET /identity/v3/roles/57a8970530a24c16b8d86a333768e765 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:17.203122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715e115-928d-4ff2-a638-a8b6c21953cc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:17.283873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:17.319200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715e115-928d-4ff2-a638-a8b6c21953cc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:17.354889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743ee1-d852-4cc4-baf6-be107a5e86c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:17.355518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743ee1-d852-4cc4-baf6-be107a5e86c2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.355795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743ee1-d852-4cc4-baf6-be107a5e86c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.356065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85743ee1-d852-4cc4-baf6-be107a5e86c2 None admin] PATH_INFO: `/v3/users/9b4391a9ee07447d8649461e91a0ce2c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.357214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85743ee1-d852-4cc4-baf6-be107a5e86c2 None admin] RBAC: Authorizing `identity:get_user(user_id=9b4391a9ee07447d8649461e91a0ce2c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:17.358686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85743ee1-d852-4cc4-baf6-be107a5e86c2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:17.360302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 558/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:17 2022] GET /identity/v3/users/9b4391a9ee07447d8649461e91a0ce2c => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:17.366783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a518c-2839-4c98-99dc-8ce46f7fde90 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:17.474991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a518c-2839-4c98-99dc-8ce46f7fde90 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:17.511119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4abd81-fdda-4ea1-85e1-5bdbb80719bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:17.511755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4abd81-fdda-4ea1-85e1-5bdbb80719bc None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.512033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4abd81-fdda-4ea1-85e1-5bdbb80719bc None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.512303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4abd81-fdda-4ea1-85e1-5bdbb80719bc None admin] PATH_INFO: `/v3/projects/1cdf28a1363b4a86bffd24293ade28a3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.513421 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4abd81-fdda-4ea1-85e1-5bdbb80719bc None admin] RBAC: Authorizing `identity:get_project(project_id=1cdf28a1363b4a86bffd24293ade28a3)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:17.514874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4abd81-fdda-4ea1-85e1-5bdbb80719bc None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:17.516527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 564/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:17 2022] GET /identity/v3/projects/1cdf28a1363b4a86bffd24293ade28a3 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:17.523485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743ee1-d852-4cc4-baf6-be107a5e86c2 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:17.628019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85743ee1-d852-4cc4-baf6-be107a5e86c2 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:17.674100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfef3aa-eb21-4ec4-87ce-56e08779d5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:17.674772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfef3aa-eb21-4ec4-87ce-56e08779d5ba None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:17.675051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfef3aa-eb21-4ec4-87ce-56e08779d5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:17.675323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfef3aa-eb21-4ec4-87ce-56e08779d5ba None admin] PATH_INFO: `/v3/projects/1cdf28a1363b4a86bffd24293ade28a3/users/9b4391a9ee07447d8649461e91a0ce2c/roles/57a8970530a24c16b8d86a333768e765` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:17.677763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfef3aa-eb21-4ec4-87ce-56e08779d5ba None admin] RBAC: Authorizing `identity:create_grant(project_id=1cdf28a1363b4a86bffd24293ade28a3, user_id=9b4391a9ee07447d8649461e91a0ce2c, role_id=57a8970530a24c16b8d86a333768e765)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:17.679208 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfef3aa-eb21-4ec4-87ce-56e08779d5ba None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:17.750271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:17.756663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 559/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:17 2022] PUT /identity/v3/projects/1cdf28a1363b4a86bffd24293ade28a3/users/9b4391a9ee07447d8649461e91a0ce2c/roles/57a8970530a24c16b8d86a333768e765 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:19.728512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca44cd-f7d4-47d3-88f4-a72c64f818d6 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:19.729077 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca44cd-f7d4-47d3-88f4-a72c64f818d6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:19.729077 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca44cd-f7d4-47d3-88f4-a72c64f818d6 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:19.730704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 565/1124] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:19.736118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f295e4b-d445-41c8-a5b9-deb7966f2eb6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:19.736549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f295e4b-d445-41c8-a5b9-deb7966f2eb6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:19.736664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f295e4b-d445-41c8-a5b9-deb7966f2eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:19.758014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6f295e4b-d445-41c8-a5b9-deb7966f2eb6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:19.759631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6f295e4b-d445-41c8-a5b9-deb7966f2eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:19.828326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 560/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:20.104989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca44cd-f7d4-47d3-88f4-a72c64f818d6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:20.157616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:20.213084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca44cd-f7d4-47d3-88f4-a72c64f818d6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:20.247343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf0bf3-3817-4abd-a041-239db3e98503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:20.247975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf0bf3-3817-4abd-a041-239db3e98503 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:20.248253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf0bf3-3817-4abd-a041-239db3e98503 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:20.248521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf0bf3-3817-4abd-a041-239db3e98503 None admin] PATH_INFO: `/v3/roles/57a8970530a24c16b8d86a333768e765` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:20.249928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf0bf3-3817-4abd-a041-239db3e98503 None admin] RBAC: Authorizing `identity:get_role(role_id=57a8970530a24c16b8d86a333768e765)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:20.251286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf0bf3-3817-4abd-a041-239db3e98503 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:20.252634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 566/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:20 2022] GET /identity/v3/roles/57a8970530a24c16b8d86a333768e765 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:20.259379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f295e4b-d445-41c8-a5b9-deb7966f2eb6 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:20.362261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f295e4b-d445-41c8-a5b9-deb7966f2eb6 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:20.395277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:20.404522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96d071-b994-439d-8c01-cc0a03fba718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:20.405321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96d071-b994-439d-8c01-cc0a03fba718 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:20.405611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96d071-b994-439d-8c01-cc0a03fba718 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:20.405912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96d071-b994-439d-8c01-cc0a03fba718 None admin] PATH_INFO: `/v3/users/9b4391a9ee07447d8649461e91a0ce2c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:20.407071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96d071-b994-439d-8c01-cc0a03fba718 None admin] RBAC: Authorizing `identity:get_user(user_id=9b4391a9ee07447d8649461e91a0ce2c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:20.408623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96d071-b994-439d-8c01-cc0a03fba718 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:20.410239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 561/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:20 2022] GET /identity/v3/users/9b4391a9ee07447d8649461e91a0ce2c => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:20.416744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf0bf3-3817-4abd-a041-239db3e98503 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:20.520382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf0bf3-3817-4abd-a041-239db3e98503 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:20.539927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:20.557733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19c7cf-b7c3-42cd-963b-e37ef866a490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:20.558381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19c7cf-b7c3-42cd-963b-e37ef866a490 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:20.558658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19c7cf-b7c3-42cd-963b-e37ef866a490 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:20.558925 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19c7cf-b7c3-42cd-963b-e37ef866a490 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:20.631308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19c7cf-b7c3-42cd-963b-e37ef866a490 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:20.632680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19c7cf-b7c3-42cd-963b-e37ef866a490 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:20.743429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 567/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:18:20.749409 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96d071-b994-439d-8c01-cc0a03fba718 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:20.851003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96d071-b994-439d-8c01-cc0a03fba718 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:20.886857 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35454d5-26f6-4609-a874-1ee34be01186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:20.887413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35454d5-26f6-4609-a874-1ee34be01186 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:20.887687 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35454d5-26f6-4609-a874-1ee34be01186 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:20.887953 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35454d5-26f6-4609-a874-1ee34be01186 None admin] PATH_INFO: `/v3/projects/1cdf28a1363b4a86bffd24293ade28a3` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:20.889051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35454d5-26f6-4609-a874-1ee34be01186 None admin] RBAC: Authorizing `identity:get_project(project_id=1cdf28a1363b4a86bffd24293ade28a3)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:20.890496 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35454d5-26f6-4609-a874-1ee34be01186 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:20.892131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 562/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:20 2022] GET /identity/v3/projects/1cdf28a1363b4a86bffd24293ade28a3 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:20.898691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19c7cf-b7c3-42cd-963b-e37ef866a490 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:20.917023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:21.002966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19c7cf-b7c3-42cd-963b-e37ef866a490 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:21.038250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b66226-024f-453f-9684-c0592f0eddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:21.038849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66226-024f-453f-9684-c0592f0eddd0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:21.039128 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66226-024f-453f-9684-c0592f0eddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:21.039397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66226-024f-453f-9684-c0592f0eddd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:21.040115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b66226-024f-453f-9684-c0592f0eddd0 None admin] RBAC: Adding query filter params (role.id=57a8970530a24c16b8d86a333768e765, scope.project.id=1cdf28a1363b4a86bffd24293ade28a3, user.id=9b4391a9ee07447d8649461e91a0ce2c) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:21.040420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b66226-024f-453f-9684-c0592f0eddd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:21.041838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b66226-024f-453f-9684-c0592f0eddd0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:21.047857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 568/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:20 2022] GET /identity/v3/role_assignments?user.id=9b4391a9ee07447d8649461e91a0ce2c&scope.project.id=1cdf28a1363b4a86bffd24293ade28a3&role.id=57a8970530a24c16b8d86a333768e765 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:23.024176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a7aed-081d-401d-9045-cec9304b83e9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:23.024718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a7aed-081d-401d-9045-cec9304b83e9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:23.024718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a7aed-081d-401d-9045-cec9304b83e9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:23.026101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 563/1131] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:23.031435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2886a-c1ad-484b-ac71-ad7f25493371 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:23.031912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2886a-c1ad-484b-ac71-ad7f25493371 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:23.032025 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2886a-c1ad-484b-ac71-ad7f25493371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:23.052882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e1a2886a-c1ad-484b-ac71-ad7f25493371 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:23.054095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e1a2886a-c1ad-484b-ac71-ad7f25493371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:23.129209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 569/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:18:23.398924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a7aed-081d-401d-9045-cec9304b83e9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:23.465898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:23.506143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a7aed-081d-401d-9045-cec9304b83e9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:23.540855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e689f0-0122-40df-9233-7a7aa4e3e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:23.541483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e689f0-0122-40df-9233-7a7aa4e3e429 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:23.541757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e689f0-0122-40df-9233-7a7aa4e3e429 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:23.542056 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e689f0-0122-40df-9233-7a7aa4e3e429 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:23.543171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e689f0-0122-40df-9233-7a7aa4e3e429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:23.544590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e689f0-0122-40df-9233-7a7aa4e3e429 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:23.546210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 564/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:23.552705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2886a-c1ad-484b-ac71-ad7f25493371 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:23.564725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:23.670149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2886a-c1ad-484b-ac71-ad7f25493371 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:23.705892 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f11ed-1eb4-4960-93a6-f9a359031824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:23.706512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f11ed-1eb4-4960-93a6-f9a359031824 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:23.706792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f11ed-1eb4-4960-93a6-f9a359031824 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:23.707065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f11ed-1eb4-4960-93a6-f9a359031824 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:23.707714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f11ed-1eb4-4960-93a6-f9a359031824 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:23.709470 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f11ed-1eb4-4960-93a6-f9a359031824 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:23.787980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 570/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:18:23 2022] POST /identity/v3/projects => generated 311 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:25.777132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ea4a-c428-4379-a658-05c5199ed52b None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:25.777710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ea4a-c428-4379-a658-05c5199ed52b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:25.777710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560ea4a-c428-4379-a658-05c5199ed52b None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:25.779028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 565/1135] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:25.784574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf661-941e-483b-87e7-94224e84e4bc None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:25.785053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf661-941e-483b-87e7-94224e84e4bc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:25.785150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf661-941e-483b-87e7-94224e84e4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:25.805052 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-28cbf661-941e-483b-87e7-94224e84e4bc None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:25.806323 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-28cbf661-941e-483b-87e7-94224e84e4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:25.866028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:25.876297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 571/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:26.167468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560ea4a-c428-4379-a658-05c5199ed52b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:26.276491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1560ea4a-c428-4379-a658-05c5199ed52b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:26.309043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:26.314033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ea56b-fb4b-4ead-b09e-86d8a4e7b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:26.314673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ea56b-fb4b-4ead-b09e-86d8a4e7b3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:26.314952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ea56b-fb4b-4ead-b09e-86d8a4e7b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:26.315223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ea56b-fb4b-4ead-b09e-86d8a4e7b3d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:26.316334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ea56b-fb4b-4ead-b09e-86d8a4e7b3d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:26.318475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ea56b-fb4b-4ead-b09e-86d8a4e7b3d9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:26.320082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 566/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:18:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:26.325865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbf661-941e-483b-87e7-94224e84e4bc None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:26.425616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbf661-941e-483b-87e7-94224e84e4bc None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:26.466110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f16160-bb6b-424f-8367-8538b60d2545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:26.466712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f16160-bb6b-424f-8367-8538b60d2545 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:26.466989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f16160-bb6b-424f-8367-8538b60d2545 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:26.467258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f16160-bb6b-424f-8367-8538b60d2545 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:26.467912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f16160-bb6b-424f-8367-8538b60d2545 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:26.469324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f16160-bb6b-424f-8367-8538b60d2545 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:26.543953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 572/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:18:26 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:28.526230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f84c-ef4e-402e-baa8-c198ce342288 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:28.526772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f84c-ef4e-402e-baa8-c198ce342288 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:28.526772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1f84c-ef4e-402e-baa8-c198ce342288 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:28.528134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 567/1139] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:28.533458 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756e59c-b329-4700-a89a-6f41a63d86be None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:28.533929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756e59c-b329-4700-a89a-6f41a63d86be None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:28.534041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756e59c-b329-4700-a89a-6f41a63d86be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:28.552680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0756e59c-b329-4700-a89a-6f41a63d86be None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:28.553869 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0756e59c-b329-4700-a89a-6f41a63d86be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:28.598189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:28.626529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 573/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:28.902242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1f84c-ef4e-402e-baa8-c198ce342288 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:29.013721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1f84c-ef4e-402e-baa8-c198ce342288 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:29.047670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394ae8-f47f-41a4-93d5-10325bd7eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:29.048286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394ae8-f47f-41a4-93d5-10325bd7eb68 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:29.048562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394ae8-f47f-41a4-93d5-10325bd7eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:29.048830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f394ae8-f47f-41a4-93d5-10325bd7eb68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:29.059518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f394ae8-f47f-41a4-93d5-10325bd7eb68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-4f394ae8-f47f-41a4-93d5-10325bd7eb68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:29.064217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:29.065482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:29.066727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 568/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:29.071698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756e59c-b329-4700-a89a-6f41a63d86be None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:29.177155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756e59c-b329-4700-a89a-6f41a63d86be None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:29.216007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456ec20-dad8-4b5d-886b-94972856b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:29.216614 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ec20-dad8-4b5d-886b-94972856b98c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:29.216893 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ec20-dad8-4b5d-886b-94972856b98c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:29.217164 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456ec20-dad8-4b5d-886b-94972856b98c None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:29.217827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456ec20-dad8-4b5d-886b-94972856b98c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:29.218158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456ec20-dad8-4b5d-886b-94972856b98c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:29.219524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456ec20-dad8-4b5d-886b-94972856b98c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:29.228119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 574/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:29.234449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394ae8-f47f-41a4-93d5-10325bd7eb68 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:29.295868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:29.338471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f394ae8-f47f-41a4-93d5-10325bd7eb68 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:29.373530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47c4fe-9965-4ff6-b740-239138420094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:29.374278 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47c4fe-9965-4ff6-b740-239138420094 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:29.374560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47c4fe-9965-4ff6-b740-239138420094 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:29.374832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47c4fe-9965-4ff6-b740-239138420094 None admin] PATH_INFO: `/v3/users/d37b6d786608489a8f8717d027630917` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:29.389603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47c4fe-9965-4ff6-b740-239138420094 None admin] RBAC: Authorizing `identity:get_user(user_id=d37b6d786608489a8f8717d027630917)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:29.391067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47c4fe-9965-4ff6-b740-239138420094 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:29.392828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 569/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:29 2022] GET /identity/v3/users/d37b6d786608489a8f8717d027630917 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:29.399276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456ec20-dad8-4b5d-886b-94972856b98c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:29.440623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:29.499261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456ec20-dad8-4b5d-886b-94972856b98c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:29.535063 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2ece1-ce33-427b-af06-0f87d5a37930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:29.535735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2ece1-ce33-427b-af06-0f87d5a37930 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:29.535931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2ece1-ce33-427b-af06-0f87d5a37930 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:29.536224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2ece1-ce33-427b-af06-0f87d5a37930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:29.603901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2ece1-ce33-427b-af06-0f87d5a37930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:29.605601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2ece1-ce33-427b-af06-0f87d5a37930 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:29.646474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:29.705221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 575/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:18:29.711412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47c4fe-9965-4ff6-b740-239138420094 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:29.815032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47c4fe-9965-4ff6-b740-239138420094 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:29.832616 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:29.850371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204097d2-45eb-4363-9a70-eac0ebb0cb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:29.851007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204097d2-45eb-4363-9a70-eac0ebb0cb68 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:29.851286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204097d2-45eb-4363-9a70-eac0ebb0cb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:29.851559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204097d2-45eb-4363-9a70-eac0ebb0cb68 None admin] PATH_INFO: `/v3/projects/182aea52c402450491051fc14685699d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:29.852687 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204097d2-45eb-4363-9a70-eac0ebb0cb68 None admin] RBAC: Authorizing `identity:get_project(project_id=182aea52c402450491051fc14685699d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:29.854150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204097d2-45eb-4363-9a70-eac0ebb0cb68 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:29.856274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 570/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:29 2022] GET /identity/v3/projects/182aea52c402450491051fc14685699d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:29.862297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2ece1-ce33-427b-af06-0f87d5a37930 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:29.967132 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2ece1-ce33-427b-af06-0f87d5a37930 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:30.002304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcb764-664b-4888-ba1b-ab4aa3b8a494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:30.002906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb764-664b-4888-ba1b-ab4aa3b8a494 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:30.003183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb764-664b-4888-ba1b-ab4aa3b8a494 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:30.003452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcb764-664b-4888-ba1b-ab4aa3b8a494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:30.004175 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcb764-664b-4888-ba1b-ab4aa3b8a494 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=182aea52c402450491051fc14685699d, user.id=d37b6d786608489a8f8717d027630917) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:30.004480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcb764-664b-4888-ba1b-ab4aa3b8a494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:30.006080 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcb764-664b-4888-ba1b-ab4aa3b8a494 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:30.011630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 576/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:29 2022] GET /identity/v3/role_assignments?user.id=d37b6d786608489a8f8717d027630917&scope.project.id=182aea52c402450491051fc14685699d&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:31.957261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10f316-3ee4-414c-9e12-9b5810f8d542 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.957950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10f316-3ee4-414c-9e12-9b5810f8d542 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.957950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10f316-3ee4-414c-9e12-9b5810f8d542 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.959232 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 571/1147] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:31.964539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f20ad-9bff-4e8e-9fcb-a71446cb3626 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:31.964957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f20ad-9bff-4e8e-9fcb-a71446cb3626 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:31.965064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f20ad-9bff-4e8e-9fcb-a71446cb3626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:31.972433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:31.985374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8b9f20ad-9bff-4e8e-9fcb-a71446cb3626 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:31.986606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8b9f20ad-9bff-4e8e-9fcb-a71446cb3626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:32.064552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 577/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:32.339806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10f316-3ee4-414c-9e12-9b5810f8d542 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:32.459896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10f316-3ee4-414c-9e12-9b5810f8d542 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:32.495798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36da10e-c56f-48bf-8a61-d7eac8b00421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:32.496434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da10e-c56f-48bf-8a61-d7eac8b00421 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:32.496716 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da10e-c56f-48bf-8a61-d7eac8b00421 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:32.496990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da10e-c56f-48bf-8a61-d7eac8b00421 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:32.516633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36da10e-c56f-48bf-8a61-d7eac8b00421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-c36da10e-c56f-48bf-8a61-d7eac8b00421 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:32.521724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:32.522845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:32.523796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 572/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:32.529128 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f20ad-9bff-4e8e-9fcb-a71446cb3626 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:32.631264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f20ad-9bff-4e8e-9fcb-a71446cb3626 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:32.665479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c398c2-e90d-42d5-bed7-7fa1551a592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:32.666116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c398c2-e90d-42d5-bed7-7fa1551a592c None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:32.666397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c398c2-e90d-42d5-bed7-7fa1551a592c None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:32.666674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c398c2-e90d-42d5-bed7-7fa1551a592c None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:32.667339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c398c2-e90d-42d5-bed7-7fa1551a592c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:32.667638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c398c2-e90d-42d5-bed7-7fa1551a592c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:32.669080 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c398c2-e90d-42d5-bed7-7fa1551a592c None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:32.670564 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:32.681090 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 578/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:32.687613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36da10e-c56f-48bf-8a61-d7eac8b00421 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:32.749297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:32.806731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36da10e-c56f-48bf-8a61-d7eac8b00421 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:32.840755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51aba4-d5e8-489c-b240-d23f1ed2d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:32.841382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51aba4-d5e8-489c-b240-d23f1ed2d59e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:32.841656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51aba4-d5e8-489c-b240-d23f1ed2d59e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:32.841952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51aba4-d5e8-489c-b240-d23f1ed2d59e None admin] PATH_INFO: `/v3/users/d37b6d786608489a8f8717d027630917` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:32.843081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51aba4-d5e8-489c-b240-d23f1ed2d59e None admin] RBAC: Authorizing `identity:get_user(user_id=d37b6d786608489a8f8717d027630917)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:32.844488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51aba4-d5e8-489c-b240-d23f1ed2d59e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:32.846090 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 573/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:32 2022] GET /identity/v3/users/d37b6d786608489a8f8717d027630917 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:32.853510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c398c2-e90d-42d5-bed7-7fa1551a592c None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:32.958179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c398c2-e90d-42d5-bed7-7fa1551a592c None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:32.993020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b9796-c2d8-4c04-904b-d55002df7b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:32.993701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b9796-c2d8-4c04-904b-d55002df7b72 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:32.993924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b9796-c2d8-4c04-904b-d55002df7b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:32.994196 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b9796-c2d8-4c04-904b-d55002df7b72 None admin] PATH_INFO: `/v3/projects/182aea52c402450491051fc14685699d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:32.995308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b9796-c2d8-4c04-904b-d55002df7b72 None admin] RBAC: Authorizing `identity:get_project(project_id=182aea52c402450491051fc14685699d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:32.996719 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b9796-c2d8-4c04-904b-d55002df7b72 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:32.998391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 579/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:32 2022] GET /identity/v3/projects/182aea52c402450491051fc14685699d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:33.004363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51aba4-d5e8-489c-b240-d23f1ed2d59e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:33.138378 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51aba4-d5e8-489c-b240-d23f1ed2d59e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:33.156152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:33.182444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cdfb9-d09f-4c91-a633-649b359c022b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:33.183119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cdfb9-d09f-4c91-a633-649b359c022b None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:33.183397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cdfb9-d09f-4c91-a633-649b359c022b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:33.183668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cdfb9-d09f-4c91-a633-649b359c022b None admin] PATH_INFO: `/v3/projects/182aea52c402450491051fc14685699d/users/d37b6d786608489a8f8717d027630917/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:33.185578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cdfb9-d09f-4c91-a633-649b359c022b None admin] RBAC: Authorizing `identity:create_grant(project_id=182aea52c402450491051fc14685699d, user_id=d37b6d786608489a8f8717d027630917, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:33.187018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cdfb9-d09f-4c91-a633-649b359c022b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:33.290598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 574/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:33 2022] PUT /identity/v3/projects/182aea52c402450491051fc14685699d/users/d37b6d786608489a8f8717d027630917/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:35.279903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0067e8-43b1-4792-8501-3b727c4b65b5 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:35.280442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0067e8-43b1-4792-8501-3b727c4b65b5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:35.280442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0067e8-43b1-4792-8501-3b727c4b65b5 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:35.281794 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 580/1154] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:35.287257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d645af3-0478-46d2-832d-379d03a34ed9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:35.287730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d645af3-0478-46d2-832d-379d03a34ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:35.287921 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d645af3-0478-46d2-832d-379d03a34ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:35.306808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0d645af3-0478-46d2-832d-379d03a34ed9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:35.308013 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0d645af3-0478-46d2-832d-379d03a34ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:35.377150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 575/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:35.655355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0067e8-43b1-4792-8501-3b727c4b65b5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:35.721410 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:35.762864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0067e8-43b1-4792-8501-3b727c4b65b5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:35.796915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9a6db-01d7-4318-9110-6794f8ba2a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:35.797544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a6db-01d7-4318-9110-6794f8ba2a87 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:35.797818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a6db-01d7-4318-9110-6794f8ba2a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:35.798115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9a6db-01d7-4318-9110-6794f8ba2a87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:35.809567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9a6db-01d7-4318-9110-6794f8ba2a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-90c9a6db-01d7-4318-9110-6794f8ba2a87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:35.814332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:35.815481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:35.816647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 581/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:35.822013 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d645af3-0478-46d2-832d-379d03a34ed9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:35.923798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d645af3-0478-46d2-832d-379d03a34ed9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:35.926072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:35.959241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa2477-e7cc-4163-a444-b50741b8fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:35.959853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa2477-e7cc-4163-a444-b50741b8fd50 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:35.960129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa2477-e7cc-4163-a444-b50741b8fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:35.960400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa2477-e7cc-4163-a444-b50741b8fd50 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:35.961055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa2477-e7cc-4163-a444-b50741b8fd50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:35.961351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa2477-e7cc-4163-a444-b50741b8fd50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:35.962742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa2477-e7cc-4163-a444-b50741b8fd50 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:35.971043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 576/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:35.977546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9a6db-01d7-4318-9110-6794f8ba2a87 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:36.078003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9a6db-01d7-4318-9110-6794f8ba2a87 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:36.102476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:36.113130 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a05e-87df-47cf-9235-22217b14f5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:36.113762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a05e-87df-47cf-9235-22217b14f5fe None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.114634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a05e-87df-47cf-9235-22217b14f5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.114909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7a05e-87df-47cf-9235-22217b14f5fe None admin] PATH_INFO: `/v3/users/d37b6d786608489a8f8717d027630917` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.116050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7a05e-87df-47cf-9235-22217b14f5fe None admin] RBAC: Authorizing `identity:get_user(user_id=d37b6d786608489a8f8717d027630917)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:36.117476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7a05e-87df-47cf-9235-22217b14f5fe None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:36.119117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 582/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:35 2022] GET /identity/v3/users/d37b6d786608489a8f8717d027630917 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:36.125168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa2477-e7cc-4163-a444-b50741b8fd50 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:36.225428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa2477-e7cc-4163-a444-b50741b8fd50 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:36.260520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a86ea-0e41-4c34-92c4-d274e1849fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:36.261129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a86ea-0e41-4c34-92c4-d274e1849fb6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.261403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a86ea-0e41-4c34-92c4-d274e1849fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.261670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a86ea-0e41-4c34-92c4-d274e1849fb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.296040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:36.331645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a86ea-0e41-4c34-92c4-d274e1849fb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:36.333599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a86ea-0e41-4c34-92c4-d274e1849fb6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:36.434019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 577/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:18:36.440138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a05e-87df-47cf-9235-22217b14f5fe None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:36.547395 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7a05e-87df-47cf-9235-22217b14f5fe None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:36.583357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f14d-4d78-44f7-ac6f-107124e80d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:36.583692 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f14d-4d78-44f7-ac6f-107124e80d66 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.583873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f14d-4d78-44f7-ac6f-107124e80d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.584300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f14d-4d78-44f7-ac6f-107124e80d66 None admin] PATH_INFO: `/v3/projects/182aea52c402450491051fc14685699d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.585599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0f14d-4d78-44f7-ac6f-107124e80d66 None admin] RBAC: Authorizing `identity:get_project(project_id=182aea52c402450491051fc14685699d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:36.587074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0f14d-4d78-44f7-ac6f-107124e80d66 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:36.588741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 583/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:36 2022] GET /identity/v3/projects/182aea52c402450491051fc14685699d => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:36.594969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a86ea-0e41-4c34-92c4-d274e1849fb6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:36.660451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:36.699262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a86ea-0e41-4c34-92c4-d274e1849fb6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:36.735218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24091529-fca1-40a9-972a-88f80246087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:36.735890 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24091529-fca1-40a9-972a-88f80246087b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:36.736170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24091529-fca1-40a9-972a-88f80246087b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:36.736442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24091529-fca1-40a9-972a-88f80246087b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:36.737198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24091529-fca1-40a9-972a-88f80246087b None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=182aea52c402450491051fc14685699d, user.id=d37b6d786608489a8f8717d027630917) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:36.737503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24091529-fca1-40a9-972a-88f80246087b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:36.739067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24091529-fca1-40a9-972a-88f80246087b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:36.746368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 578/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:36 2022] GET /identity/v3/role_assignments?user.id=d37b6d786608489a8f8717d027630917&scope.project.id=182aea52c402450491051fc14685699d&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:38.692203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558956c7-8060-4c30-9452-581df9410214 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.692745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558956c7-8060-4c30-9452-581df9410214 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.692745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558956c7-8060-4c30-9452-581df9410214 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.694113 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 584/1162] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:38.700801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f3058-c1f2-4eb8-b810-cc040c5b5e7f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:38.701292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f3058-c1f2-4eb8-b810-cc040c5b5e7f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:38.701390 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f3058-c1f2-4eb8-b810-cc040c5b5e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:38.719741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-829f3058-c1f2-4eb8-b810-cc040c5b5e7f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:38.720927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-829f3058-c1f2-4eb8-b810-cc040c5b5e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:38.799779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 579/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:39.075596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558956c7-8060-4c30-9452-581df9410214 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:39.140632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:39.200585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558956c7-8060-4c30-9452-581df9410214 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:39.235730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b78069-bed9-4a7d-9f99-f291ce6db6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:39.236335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b78069-bed9-4a7d-9f99-f291ce6db6ab None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:39.236616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b78069-bed9-4a7d-9f99-f291ce6db6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:39.236889 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b78069-bed9-4a7d-9f99-f291ce6db6ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:39.306665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b78069-bed9-4a7d-9f99-f291ce6db6ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:39.308115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b78069-bed9-4a7d-9f99-f291ce6db6ab None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:39.367941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:39.410401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 585/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:18:39.417392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f3058-c1f2-4eb8-b810-cc040c5b5e7f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:39.477449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:39.521074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f3058-c1f2-4eb8-b810-cc040c5b5e7f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:39.556183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c4664-69b1-4cc6-b9f8-3866eeaff1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:39.556818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c4664-69b1-4cc6-b9f8-3866eeaff1ec None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:39.557093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c4664-69b1-4cc6-b9f8-3866eeaff1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:39.557361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c4664-69b1-4cc6-b9f8-3866eeaff1ec None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:39.564084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c4664-69b1-4cc6-b9f8-3866eeaff1ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:39.565499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c4664-69b1-4cc6-b9f8-3866eeaff1ec None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-fc4c4664-69b1-4cc6-b9f8-3866eeaff1ec None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:39.578416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:39.579705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:39.580777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 580/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 1 16:18:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:39.586255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b78069-bed9-4a7d-9f99-f291ce6db6ab None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:39.687151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b78069-bed9-4a7d-9f99-f291ce6db6ab None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:39.721969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706634c0-ae0d-4d46-ba09-309c04f9df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:39.722648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706634c0-ae0d-4d46-ba09-309c04f9df38 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:39.722846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706634c0-ae0d-4d46-ba09-309c04f9df38 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:39.723116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706634c0-ae0d-4d46-ba09-309c04f9df38 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:39.723832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706634c0-ae0d-4d46-ba09-309c04f9df38 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:39.724127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706634c0-ae0d-4d46-ba09-309c04f9df38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:39.725487 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706634c0-ae0d-4d46-ba09-309c04f9df38 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:39.733229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 586/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Sep 1 16:18:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:41.666961 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69dc19-7988-494a-8d42-760f78df3ff4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.667544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69dc19-7988-494a-8d42-760f78df3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.667544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69dc19-7988-494a-8d42-760f78df3ff4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.668864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 581/1167] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:41.674354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed0c1-f4b3-4078-834e-644ca7ee167d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:41.674802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed0c1-f4b3-4078-834e-644ca7ee167d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:41.674917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ed0c1-f4b3-4078-834e-644ca7ee167d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:41.694214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-732ed0c1-f4b3-4078-834e-644ca7ee167d None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:41.695448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-732ed0c1-f4b3-4078-834e-644ca7ee167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:41.714471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:41.767507 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 587/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:42.041337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69dc19-7988-494a-8d42-760f78df3ff4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:42.147305 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69dc19-7988-494a-8d42-760f78df3ff4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:42.167663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:42.182177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4cca8-cd85-465f-b988-5939a446a0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:42.182789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4cca8-cd85-465f-b988-5939a446a0b8 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:42.183067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4cca8-cd85-465f-b988-5939a446a0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:42.183338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4cca8-cd85-465f-b988-5939a446a0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:42.184004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4cca8-cd85-465f-b988-5939a446a0b8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:42.185353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4cca8-cd85-465f-b988-5939a446a0b8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:42.260217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 582/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Thu Sep 1 16:18:42 2022] POST /identity/v3/domains => generated 267 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:44.235630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994967-5352-4db5-818b-3d65c8074c17 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:44.236208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994967-5352-4db5-818b-3d65c8074c17 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:44.236208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27994967-5352-4db5-818b-3d65c8074c17 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:44.237528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 588/1170] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:18:44.243614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9eb1f-4e1f-4f4b-9934-049e70240807 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:44.244082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9eb1f-4e1f-4f4b-9934-049e70240807 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:44.244183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9eb1f-4e1f-4f4b-9934-049e70240807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:44.262377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-02a9eb1f-4e1f-4f4b-9934-049e70240807 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:44.263599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-02a9eb1f-4e1f-4f4b-9934-049e70240807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:44.331788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 583/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:44.602489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27994967-5352-4db5-818b-3d65c8074c17 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:44.710239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27994967-5352-4db5-818b-3d65c8074c17 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:44.745272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70f613-14b5-4d66-84dd-053a3a9875ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:44.745926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70f613-14b5-4d66-84dd-053a3a9875ce None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:44.746209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70f613-14b5-4d66-84dd-053a3a9875ce None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:44.746480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70f613-14b5-4d66-84dd-053a3a9875ce None admin] PATH_INFO: `/v3/domains/5e82b0923a764064a5d84d59cba9de45` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:44.758014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70f613-14b5-4d66-84dd-053a3a9875ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=5e82b0923a764064a5d84d59cba9de45)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:44.759469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70f613-14b5-4d66-84dd-053a3a9875ce None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:44.761162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 589/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Sep 1 16:18:44 2022] GET /identity/v3/domains/5e82b0923a764064a5d84d59cba9de45 => generated 267 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:44.767091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9eb1f-4e1f-4f4b-9934-049e70240807 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:44.872406 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9eb1f-4e1f-4f4b-9934-049e70240807 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:44.884303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:44.908300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c881b-5274-48a9-b480-b25acee82357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:44.909091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c881b-5274-48a9-b480-b25acee82357 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:44.909396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c881b-5274-48a9-b480-b25acee82357 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:44.909669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c881b-5274-48a9-b480-b25acee82357 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:44.910345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c881b-5274-48a9-b480-b25acee82357 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:44.911853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26c881b-5274-48a9-b480-b25acee82357 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:45.033073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 584/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:18:44 2022] POST /identity/v3/projects => generated 361 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:47.009789 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728250-8823-413c-8d5f-ef2b222ecccc None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.010371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728250-8823-413c-8d5f-ef2b222ecccc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.010371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37728250-8823-413c-8d5f-ef2b222ecccc None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.011726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 590/1174] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:47.017111 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8321b0b-74d2-48cd-9a62-74e3984f4448 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.017539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8321b0b-74d2-48cd-9a62-74e3984f4448 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.017661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8321b0b-74d2-48cd-9a62-74e3984f4448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.036351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e8321b0b-74d2-48cd-9a62-74e3984f4448 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:47.037731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e8321b0b-74d2-48cd-9a62-74e3984f4448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:47.110683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 585/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:47.384731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37728250-8823-413c-8d5f-ef2b222ecccc None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:47.403018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:47.493561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37728250-8823-413c-8d5f-ef2b222ecccc None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:47.534815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e515e-389e-4259-b8cf-3b466d48d547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:47.535466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e515e-389e-4259-b8cf-3b466d48d547 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.535753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e515e-389e-4259-b8cf-3b466d48d547 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.537150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e515e-389e-4259-b8cf-3b466d48d547 None admin] PATH_INFO: `/v3/domains/5e82b0923a764064a5d84d59cba9de45` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.539149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e515e-389e-4259-b8cf-3b466d48d547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5e82b0923a764064a5d84d59cba9de45)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:47.539755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e515e-389e-4259-b8cf-3b466d48d547 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:47.541366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 591/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Sep 1 16:18:47 2022] GET /identity/v3/domains/5e82b0923a764064a5d84d59cba9de45 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:47.547653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8321b0b-74d2-48cd-9a62-74e3984f4448 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:47.638123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:47.647199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8321b0b-74d2-48cd-9a62-74e3984f4448 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:47.684853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cc3dc-39ea-449a-98d2-a45181d23fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:47.691811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cc3dc-39ea-449a-98d2-a45181d23fc0 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:47.691811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cc3dc-39ea-449a-98d2-a45181d23fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:47.691811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cc3dc-39ea-449a-98d2-a45181d23fc0 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:47.691811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cc3dc-39ea-449a-98d2-a45181d23fc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:47.691811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cc3dc-39ea-449a-98d2-a45181d23fc0 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:47.797581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 586/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:18:47 2022] POST /identity/v3/users => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:18:49.786556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ce743-7ee4-4fe4-956a-8950da9e5b78 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.787278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ce743-7ee4-4fe4-956a-8950da9e5b78 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.787278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ce743-7ee4-4fe4-956a-8950da9e5b78 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.788477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 592/1178] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:49.793990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801c0d-ad6d-4492-b30a-edbafa59b340 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:49.794423 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801c0d-ad6d-4492-b30a-edbafa59b340 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:49.794524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12801c0d-ad6d-4492-b30a-edbafa59b340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:49.814253 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-12801c0d-ad6d-4492-b30a-edbafa59b340 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:49.815446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-12801c0d-ad6d-4492-b30a-edbafa59b340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:49.883569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 587/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:50.154856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ce743-7ee4-4fe4-956a-8950da9e5b78 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.250599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.277755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ce743-7ee4-4fe4-956a-8950da9e5b78 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.320215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86392379-2b05-40eb-a2aa-36bfa7e1d578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.320859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86392379-2b05-40eb-a2aa-36bfa7e1d578 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.321135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86392379-2b05-40eb-a2aa-36bfa7e1d578 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.321407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86392379-2b05-40eb-a2aa-36bfa7e1d578 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.333187 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86392379-2b05-40eb-a2aa-36bfa7e1d578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-86392379-2b05-40eb-a2aa-36bfa7e1d578 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:50.338208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:50.339461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:50.340413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 593/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:50.345645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12801c0d-ad6d-4492-b30a-edbafa59b340 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.438102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.459828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12801c0d-ad6d-4492-b30a-edbafa59b340 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.493760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42f4b4-1bf3-4fc3-b608-bc1ffe0c9166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.494394 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42f4b4-1bf3-4fc3-b608-bc1ffe0c9166 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.494668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42f4b4-1bf3-4fc3-b608-bc1ffe0c9166 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.494934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42f4b4-1bf3-4fc3-b608-bc1ffe0c9166 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.495588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42f4b4-1bf3-4fc3-b608-bc1ffe0c9166 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:50.495882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42f4b4-1bf3-4fc3-b608-bc1ffe0c9166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.497224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42f4b4-1bf3-4fc3-b608-bc1ffe0c9166 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.506918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 588/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:50.512750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86392379-2b05-40eb-a2aa-36bfa7e1d578 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.620336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86392379-2b05-40eb-a2aa-36bfa7e1d578 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.655812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc41b4-f4f1-40a5-8994-203693b1141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.656444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc41b4-f4f1-40a5-8994-203693b1141d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.656722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc41b4-f4f1-40a5-8994-203693b1141d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.656991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc41b4-f4f1-40a5-8994-203693b1141d None admin] PATH_INFO: `/v3/users/04bfa1dfc808495ca9fe1584cc085d82` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.670637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.673064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc41b4-f4f1-40a5-8994-203693b1141d None admin] RBAC: Authorizing `identity:get_user(user_id=04bfa1dfc808495ca9fe1584cc085d82)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.674545 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc41b4-f4f1-40a5-8994-203693b1141d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:50.676242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 594/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/users/04bfa1dfc808495ca9fe1584cc085d82 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:50.683054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42f4b4-1bf3-4fc3-b608-bc1ffe0c9166 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:50.789042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42f4b4-1bf3-4fc3-b608-bc1ffe0c9166 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:50.824814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2a1a0-6f63-4626-b7fd-4939b42c0a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:50.825535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a1a0-6f63-4626-b7fd-4939b42c0a88 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:50.825695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a1a0-6f63-4626-b7fd-4939b42c0a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:50.826154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2a1a0-6f63-4626-b7fd-4939b42c0a88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:50.839067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:50.901486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2a1a0-6f63-4626-b7fd-4939b42c0a88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:50.902968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2a1a0-6f63-4626-b7fd-4939b42c0a88 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:51.012203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 589/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:18:51.018280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc41b4-f4f1-40a5-8994-203693b1141d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:51.127365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc41b4-f4f1-40a5-8994-203693b1141d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:51.168752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d250c3e-14dd-4eb9-a4d8-64c78908e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:51.169392 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d250c3e-14dd-4eb9-a4d8-64c78908e359 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:51.169674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d250c3e-14dd-4eb9-a4d8-64c78908e359 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:51.169973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d250c3e-14dd-4eb9-a4d8-64c78908e359 None admin] PATH_INFO: `/v3/projects/ed2b159f4fbd436b9acebf95a7e9a3a9` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:51.171107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d250c3e-14dd-4eb9-a4d8-64c78908e359 None admin] RBAC: Authorizing `identity:get_project(project_id=ed2b159f4fbd436b9acebf95a7e9a3a9)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:51.172537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d250c3e-14dd-4eb9-a4d8-64c78908e359 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:51.174233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 595/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:51 2022] GET /identity/v3/projects/ed2b159f4fbd436b9acebf95a7e9a3a9 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:51.180565 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2a1a0-6f63-4626-b7fd-4939b42c0a88 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:51.223107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:51.283003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2a1a0-6f63-4626-b7fd-4939b42c0a88 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:51.318027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ac203-ff01-4c8c-816c-42cf883bc804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:51.318618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ac203-ff01-4c8c-816c-42cf883bc804 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:51.318893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ac203-ff01-4c8c-816c-42cf883bc804 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:51.319157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ac203-ff01-4c8c-816c-42cf883bc804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:51.319913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ac203-ff01-4c8c-816c-42cf883bc804 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=ed2b159f4fbd436b9acebf95a7e9a3a9, user.id=04bfa1dfc808495ca9fe1584cc085d82) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:51.320216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ac203-ff01-4c8c-816c-42cf883bc804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:51.321616 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ac203-ff01-4c8c-816c-42cf883bc804 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:51.327106 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 590/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:51 2022] GET /identity/v3/role_assignments?user.id=04bfa1dfc808495ca9fe1584cc085d82&scope.project.id=ed2b159f4fbd436b9acebf95a7e9a3a9&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:53.222771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675180-c273-4621-bf69-008494b43aac None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.223818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675180-c273-4621-bf69-008494b43aac None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.223818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2675180-c273-4621-bf69-008494b43aac None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.225219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 596/1186] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:53.230899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cced1-aad8-4af9-99ae-903fd6b07a8b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.231376 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cced1-aad8-4af9-99ae-903fd6b07a8b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.231482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cced1-aad8-4af9-99ae-903fd6b07a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.251948 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-230cced1-aad8-4af9-99ae-903fd6b07a8b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:53.253143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-230cced1-aad8-4af9-99ae-903fd6b07a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:53.322109 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 591/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:18:53.593232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2675180-c273-4621-bf69-008494b43aac None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.668588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.703944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2675180-c273-4621-bf69-008494b43aac None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.740058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918f8f1-bb38-4782-babe-4cef9157f456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.740773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918f8f1-bb38-4782-babe-4cef9157f456 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.741047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918f8f1-bb38-4782-babe-4cef9157f456 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.741313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918f8f1-bb38-4782-babe-4cef9157f456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.751793 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918f8f1-bb38-4782-babe-4cef9157f456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-0918f8f1-bb38-4782-babe-4cef9157f456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:53.756831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:53.757987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:53.759018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:18:53.759961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 597/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:53.763989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cced1-aad8-4af9-99ae-903fd6b07a8b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:53.798042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:53.865506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cced1-aad8-4af9-99ae-903fd6b07a8b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:53.900670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661aabb-0c69-4dd8-8a60-bfc2052af199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:53.901277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aabb-0c69-4dd8-8a60-bfc2052af199 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:53.901554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aabb-0c69-4dd8-8a60-bfc2052af199 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:53.901826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e661aabb-0c69-4dd8-8a60-bfc2052af199 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:53.902613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661aabb-0c69-4dd8-8a60-bfc2052af199 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:53.902912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661aabb-0c69-4dd8-8a60-bfc2052af199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:53.904269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e661aabb-0c69-4dd8-8a60-bfc2052af199 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:53.913047 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 592/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:53.919928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918f8f1-bb38-4782-babe-4cef9157f456 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.033035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918f8f1-bb38-4782-babe-4cef9157f456 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.061069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:54.069512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5954d0-7611-4414-b80d-c303a3062db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.073509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5954d0-7611-4414-b80d-c303a3062db7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.073509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5954d0-7611-4414-b80d-c303a3062db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.073509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5954d0-7611-4414-b80d-c303a3062db7 None admin] PATH_INFO: `/v3/users/04bfa1dfc808495ca9fe1584cc085d82` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.073509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5954d0-7611-4414-b80d-c303a3062db7 None admin] RBAC: Authorizing `identity:get_user(user_id=04bfa1dfc808495ca9fe1584cc085d82)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:54.073509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5954d0-7611-4414-b80d-c303a3062db7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:54.074878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 598/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:53 2022] GET /identity/v3/users/04bfa1dfc808495ca9fe1584cc085d82 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:18:54.080775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661aabb-0c69-4dd8-8a60-bfc2052af199 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.193162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:54.199134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e661aabb-0c69-4dd8-8a60-bfc2052af199 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.233798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e394cd-7b38-4e65-9864-3f88c43f1773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.234516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e394cd-7b38-4e65-9864-3f88c43f1773 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.234719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e394cd-7b38-4e65-9864-3f88c43f1773 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.234985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e394cd-7b38-4e65-9864-3f88c43f1773 None admin] PATH_INFO: `/v3/projects/ed2b159f4fbd436b9acebf95a7e9a3a9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.236203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e394cd-7b38-4e65-9864-3f88c43f1773 None admin] RBAC: Authorizing `identity:get_project(project_id=ed2b159f4fbd436b9acebf95a7e9a3a9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:54.237621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e394cd-7b38-4e65-9864-3f88c43f1773 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:54.240199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 593/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:54 2022] GET /identity/v3/projects/ed2b159f4fbd436b9acebf95a7e9a3a9 => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:54.248456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5954d0-7611-4414-b80d-c303a3062db7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:54.359167 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5954d0-7611-4414-b80d-c303a3062db7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:54.394532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3d7b1-ba03-4730-974c-2dce7d772214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:54.395232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3d7b1-ba03-4730-974c-2dce7d772214 None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:54.395509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3d7b1-ba03-4730-974c-2dce7d772214 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:54.395783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3d7b1-ba03-4730-974c-2dce7d772214 None admin] PATH_INFO: `/v3/projects/ed2b159f4fbd436b9acebf95a7e9a3a9/users/04bfa1dfc808495ca9fe1584cc085d82/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:54.397693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3d7b1-ba03-4730-974c-2dce7d772214 None admin] RBAC: Authorizing `identity:create_grant(project_id=ed2b159f4fbd436b9acebf95a7e9a3a9, user_id=04bfa1dfc808495ca9fe1584cc085d82, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:54.399144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3d7b1-ba03-4730-974c-2dce7d772214 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:54.475524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 599/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:18:54 2022] PUT /identity/v3/projects/ed2b159f4fbd436b9acebf95a7e9a3a9/users/04bfa1dfc808495ca9fe1584cc085d82/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:18:56.376227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9b6a-298f-48be-94f8-4048d618cec2 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.376758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9b6a-298f-48be-94f8-4048d618cec2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.376758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb9b6a-298f-48be-94f8-4048d618cec2 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.378066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 594/1193] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:18:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:18:56.383466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a0c8-96f5-4c90-8480-1f0a168b5b53 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.383949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a0c8-96f5-4c90-8480-1f0a168b5b53 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.384051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a0c8-96f5-4c90-8480-1f0a168b5b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.402819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d9d6a0c8-96f5-4c90-8480-1f0a168b5b53 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:18:56.404019 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d9d6a0c8-96f5-4c90-8480-1f0a168b5b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:18:56.457189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:56.474774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 600/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:18:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:18:56.750791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb9b6a-298f-48be-94f8-4048d618cec2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:56.859883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb9b6a-298f-48be-94f8-4048d618cec2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:56.894147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaeb79-863a-4ccd-b4a7-35950e9a6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:56.894778 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaeb79-863a-4ccd-b4a7-35950e9a6bff None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:56.895693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaeb79-863a-4ccd-b4a7-35950e9a6bff None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:56.895974 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaeb79-863a-4ccd-b4a7-35950e9a6bff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:56.906926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaeb79-863a-4ccd-b4a7-35950e9a6bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-bbcaeb79-863a-4ccd-b4a7-35950e9a6bff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:18:56.911844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:18:56.912997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:18:56.914295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 595/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:18:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:18:56.919085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6a0c8-96f5-4c90-8480-1f0a168b5b53 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.027948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6a0c8-96f5-4c90-8480-1f0a168b5b53 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.063424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a459583-9251-4117-844d-5181c51f2831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.064037 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459583-9251-4117-844d-5181c51f2831 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.064316 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459583-9251-4117-844d-5181c51f2831 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.064586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a459583-9251-4117-844d-5181c51f2831 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.065245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a459583-9251-4117-844d-5181c51f2831 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:57.065544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a459583-9251-4117-844d-5181c51f2831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.067160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a459583-9251-4117-844d-5181c51f2831 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.076422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 601/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:18:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:57.082292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaeb79-863a-4ccd-b4a7-35950e9a6bff None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.113681 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.194262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaeb79-863a-4ccd-b4a7-35950e9a6bff None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.229573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b06347-82f3-495a-947f-05fc366437b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.230549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06347-82f3-495a-947f-05fc366437b6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.230831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06347-82f3-495a-947f-05fc366437b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.231105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b06347-82f3-495a-947f-05fc366437b6 None admin] PATH_INFO: `/v3/users/04bfa1dfc808495ca9fe1584cc085d82` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.232254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b06347-82f3-495a-947f-05fc366437b6 None admin] RBAC: Authorizing `identity:get_user(user_id=04bfa1dfc808495ca9fe1584cc085d82)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.233684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b06347-82f3-495a-947f-05fc366437b6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.235325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 596/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/users/04bfa1dfc808495ca9fe1584cc085d82 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:57.241484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a459583-9251-4117-844d-5181c51f2831 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.295955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.349718 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a459583-9251-4117-844d-5181c51f2831 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.384916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c6601-2896-44eb-bc8a-eec561293257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.385578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6601-2896-44eb-bc8a-eec561293257 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.385779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6601-2896-44eb-bc8a-eec561293257 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.386076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c6601-2896-44eb-bc8a-eec561293257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.456385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c6601-2896-44eb-bc8a-eec561293257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.458402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c6601-2896-44eb-bc8a-eec561293257 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.506394 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.559042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 602/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:18:57.564876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b06347-82f3-495a-947f-05fc366437b6 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.674666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:18:57.683595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b06347-82f3-495a-947f-05fc366437b6 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.719790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf314058-9b47-4986-a64d-9e428acd9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.720412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf314058-9b47-4986-a64d-9e428acd9da2 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.720688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf314058-9b47-4986-a64d-9e428acd9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.720955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf314058-9b47-4986-a64d-9e428acd9da2 None admin] PATH_INFO: `/v3/projects/ed2b159f4fbd436b9acebf95a7e9a3a9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.722081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf314058-9b47-4986-a64d-9e428acd9da2 None admin] RBAC: Authorizing `identity:get_project(project_id=ed2b159f4fbd436b9acebf95a7e9a3a9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.723537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf314058-9b47-4986-a64d-9e428acd9da2 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.725177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 597/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/projects/ed2b159f4fbd436b9acebf95a7e9a3a9 => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:18:57.731715 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c6601-2896-44eb-bc8a-eec561293257 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:18:57.833833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c6601-2896-44eb-bc8a-eec561293257 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:18:57.869850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815c86d-ee0c-4f99-987f-21d26a6689f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:18:57.870492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815c86d-ee0c-4f99-987f-21d26a6689f2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:18:57.870769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815c86d-ee0c-4f99-987f-21d26a6689f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:18:57.871038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815c86d-ee0c-4f99-987f-21d26a6689f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:18:57.871761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815c86d-ee0c-4f99-987f-21d26a6689f2 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=ed2b159f4fbd436b9acebf95a7e9a3a9, user.id=04bfa1dfc808495ca9fe1584cc085d82) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:18:57.872164 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815c86d-ee0c-4f99-987f-21d26a6689f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:18:57.873741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815c86d-ee0c-4f99-987f-21d26a6689f2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:18:57.880552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 603/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:18:57 2022] GET /identity/v3/role_assignments?user.id=04bfa1dfc808495ca9fe1584cc085d82&scope.project.id=ed2b159f4fbd436b9acebf95a7e9a3a9&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:19:07.715561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=20 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:19:07.877149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=94 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:11.765993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bd280-66e2-4eca-adb8-4ccb217004f1 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.766630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bd280-66e2-4eca-adb8-4ccb217004f1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.766630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bd280-66e2-4eca-adb8-4ccb217004f1 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.767877 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 598/1201] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:11.774347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d37e-31f4-40a5-bb77-17aa75c69007 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:11.774884 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d37e-31f4-40a5-bb77-17aa75c69007 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:11.774999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5d37e-31f4-40a5-bb77-17aa75c69007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:11.799242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a5d5d37e-31f4-40a5-bb77-17aa75c69007 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:11.800959 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a5d5d37e-31f4-40a5-bb77-17aa75c69007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:11.889365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 604/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:12.168088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bd280-66e2-4eca-adb8-4ccb217004f1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.281792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bd280-66e2-4eca-adb8-4ccb217004f1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.320960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b1d04-c3a2-4795-ba11-7aced8f66e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.321611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b1d04-c3a2-4795-ba11-7aced8f66e44 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.321914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b1d04-c3a2-4795-ba11-7aced8f66e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.322189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b1d04-c3a2-4795-ba11-7aced8f66e44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.333092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b1d04-c3a2-4795-ba11-7aced8f66e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.335227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b1d04-c3a2-4795-ba11-7aced8f66e44 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-589b1d04-c3a2-4795-ba11-7aced8f66e44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:12.352070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:12.353420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:12.354865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:12.354865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:12.354865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:12.354865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 599/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:12.359828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d37e-31f4-40a5-bb77-17aa75c69007 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.468907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5d37e-31f4-40a5-bb77-17aa75c69007 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.498966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.507450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a7c53-3369-4a6e-9e02-553c247df393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.507450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7c53-3369-4a6e-9e02-553c247df393 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.507450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7c53-3369-4a6e-9e02-553c247df393 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.507450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a7c53-3369-4a6e-9e02-553c247df393 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.507908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a7c53-3369-4a6e-9e02-553c247df393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:12.507908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a7c53-3369-4a6e-9e02-553c247df393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.508520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a7c53-3369-4a6e-9e02-553c247df393 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.520968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 605/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:12.530953 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b1d04-c3a2-4795-ba11-7aced8f66e44 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:12.603661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:12.651545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b1d04-c3a2-4795-ba11-7aced8f66e44 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:12.685239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce4db2-c7f4-4d8b-9c42-be28d6db659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:12.685849 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce4db2-c7f4-4d8b-9c42-be28d6db659f None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:12.686158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce4db2-c7f4-4d8b-9c42-be28d6db659f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:12.686428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce4db2-c7f4-4d8b-9c42-be28d6db659f None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:12.687065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce4db2-c7f4-4d8b-9c42-be28d6db659f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:12.688470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce4db2-c7f4-4d8b-9c42-be28d6db659f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:12.795114 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 600/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Sep 1 16:20:12 2022] POST /identity/v3/users => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:20:14.949727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5424c-6f92-4307-a41f-6bf3d16652ee None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.950434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5424c-6f92-4307-a41f-6bf3d16652ee None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.950434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5424c-6f92-4307-a41f-6bf3d16652ee None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.951648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 606/1206] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:14.957234 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f4364-9b9a-411e-abce-25a17c7c63a1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:14.957680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f4364-9b9a-411e-abce-25a17c7c63a1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:14.957782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f4364-9b9a-411e-abce-25a17c7c63a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:14.977551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a27f4364-9b9a-411e-abce-25a17c7c63a1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:14.978787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a27f4364-9b9a-411e-abce-25a17c7c63a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:15.054629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 601/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:15.330376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5424c-6f92-4307-a41f-6bf3d16652ee None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.442836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5424c-6f92-4307-a41f-6bf3d16652ee None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.479603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e288098-e314-4e98-9ca6-172f8edae304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.480287 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e288098-e314-4e98-9ca6-172f8edae304 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.480561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e288098-e314-4e98-9ca6-172f8edae304 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.480882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e288098-e314-4e98-9ca6-172f8edae304 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.492373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e288098-e314-4e98-9ca6-172f8edae304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-5e288098-e314-4e98-9ca6-172f8edae304 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:15.497053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:15.498317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:15.499234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 607/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:15.504585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f4364-9b9a-411e-abce-25a17c7c63a1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.551343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:15.611532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f4364-9b9a-411e-abce-25a17c7c63a1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.644925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8b7a1-ef46-4ae7-bdaf-40dfe39fcb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.645536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8b7a1-ef46-4ae7-bdaf-40dfe39fcb59 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.645816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8b7a1-ef46-4ae7-bdaf-40dfe39fcb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.646779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8b7a1-ef46-4ae7-bdaf-40dfe39fcb59 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.647435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8b7a1-ef46-4ae7-bdaf-40dfe39fcb59 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:15.647739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8b7a1-ef46-4ae7-bdaf-40dfe39fcb59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.649080 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8b7a1-ef46-4ae7-bdaf-40dfe39fcb59 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.656883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 602/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:15.663589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e288098-e314-4e98-9ca6-172f8edae304 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.713860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:15.763927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e288098-e314-4e98-9ca6-172f8edae304 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.797554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a1a03-3606-4369-979b-89a1b8983dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.806242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a1a03-3606-4369-979b-89a1b8983dfa None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.806242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a1a03-3606-4369-979b-89a1b8983dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.806242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a1a03-3606-4369-979b-89a1b8983dfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.812005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a1a03-3606-4369-979b-89a1b8983dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.813441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a1a03-3606-4369-979b-89a1b8983dfa None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4a9a1a03-3606-4369-979b-89a1b8983dfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:15.829920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:15.832018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:15.834533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:15.834533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:15.834533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:15.834533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 608/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:15.838432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8b7a1-ef46-4ae7-bdaf-40dfe39fcb59 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:15.954258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:15.957022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8b7a1-ef46-4ae7-bdaf-40dfe39fcb59 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:15.992058 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692c072-ff4a-4040-b7ce-9d308815d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:15.992786 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c072-ff4a-4040-b7ce-9d308815d988 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:15.993034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c072-ff4a-4040-b7ce-9d308815d988 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:15.993297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c072-ff4a-4040-b7ce-9d308815d988 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:15.993978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692c072-ff4a-4040-b7ce-9d308815d988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:15.994283 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692c072-ff4a-4040-b7ce-9d308815d988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:15.995710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692c072-ff4a-4040-b7ce-9d308815d988 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.008309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 603/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:16.014173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a1a03-3606-4369-979b-89a1b8983dfa None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.118262 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a1a03-3606-4369-979b-89a1b8983dfa None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.119838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.159749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b57913-85dc-4903-a924-0de2245b1f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.160379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b57913-85dc-4903-a924-0de2245b1f4d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.160654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b57913-85dc-4903-a924-0de2245b1f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.160920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b57913-85dc-4903-a924-0de2245b1f4d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.169568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b57913-85dc-4903-a924-0de2245b1f4d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.174594 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b57913-85dc-4903-a924-0de2245b1f4d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-54b57913-85dc-4903-a924-0de2245b1f4d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:16.183909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:16.185183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:16.186366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:16.186366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:16.186366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:16.186366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:16.186366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:16.186366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:16.186366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:16.186366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:16.186366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:16.186366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:16.186366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 609/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:16.191260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692c072-ff4a-4040-b7ce-9d308815d988 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.297986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692c072-ff4a-4040-b7ce-9d308815d988 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.333245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba123bf-5e1e-4662-a797-a8b51cfbafd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.334503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba123bf-5e1e-4662-a797-a8b51cfbafd1 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.334780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba123bf-5e1e-4662-a797-a8b51cfbafd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.335143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba123bf-5e1e-4662-a797-a8b51cfbafd1 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.335784 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba123bf-5e1e-4662-a797-a8b51cfbafd1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:16.336092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba123bf-5e1e-4662-a797-a8b51cfbafd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.337505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba123bf-5e1e-4662-a797-a8b51cfbafd1 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.356039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 604/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:16.362262 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b57913-85dc-4903-a924-0de2245b1f4d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.472327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b57913-85dc-4903-a924-0de2245b1f4d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.508495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b641-fb2e-43af-a903-9ad11bd40a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.509097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b641-fb2e-43af-a903-9ad11bd40a55 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.509373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b641-fb2e-43af-a903-9ad11bd40a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.509641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7b641-fb2e-43af-a903-9ad11bd40a55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.542142 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.583426 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7b641-fb2e-43af-a903-9ad11bd40a55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.585504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7b641-fb2e-43af-a903-9ad11bd40a55 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.685735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 610/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:16.695010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba123bf-5e1e-4662-a797-a8b51cfbafd1 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.715551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.799030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba123bf-5e1e-4662-a797-a8b51cfbafd1 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:16.834282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbed1e-b582-43ac-90ff-408462375587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:16.835194 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbed1e-b582-43ac-90ff-408462375587 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:16.835587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbed1e-b582-43ac-90ff-408462375587 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:16.835861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbed1e-b582-43ac-90ff-408462375587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:16.846032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbed1e-b582-43ac-90ff-408462375587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:16.847457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbed1e-b582-43ac-90ff-408462375587 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-fffbed1e-b582-43ac-90ff-408462375587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:16.862744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:16.863962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:16.865667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:16.865667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:16.865667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:16.865667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 605/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:16.869722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b641-fb2e-43af-a903-9ad11bd40a55 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:16.934174 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:16.972271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7b641-fb2e-43af-a903-9ad11bd40a55 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.010945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f5cfa-a2a4-43b0-810e-a89bf9ca3bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.011560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f5cfa-a2a4-43b0-810e-a89bf9ca3bef None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.011840 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f5cfa-a2a4-43b0-810e-a89bf9ca3bef None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.012111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f5cfa-a2a4-43b0-810e-a89bf9ca3bef None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.012752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f5cfa-a2a4-43b0-810e-a89bf9ca3bef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:17.013053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f5cfa-a2a4-43b0-810e-a89bf9ca3bef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.014447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f5cfa-a2a4-43b0-810e-a89bf9ca3bef None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.027746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 611/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:17.034148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbed1e-b582-43ac-90ff-408462375587 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.107916 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:17.142011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbed1e-b582-43ac-90ff-408462375587 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.179458 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c9a14-3124-4b0c-9eff-de3a66554f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.180067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9a14-3124-4b0c-9eff-de3a66554f5e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.180347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9a14-3124-4b0c-9eff-de3a66554f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.180617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c9a14-3124-4b0c-9eff-de3a66554f5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.187397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c9a14-3124-4b0c-9eff-de3a66554f5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.188823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c9a14-3124-4b0c-9eff-de3a66554f5e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-390c9a14-3124-4b0c-9eff-de3a66554f5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:17.200501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:17.203454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:17.204572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:17.204572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:17.204572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:17.204572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:17.204572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:17.204572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:17.204572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:17.204572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:17.204572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 606/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:17.207611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f5cfa-a2a4-43b0-810e-a89bf9ca3bef None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.310693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f5cfa-a2a4-43b0-810e-a89bf9ca3bef None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.335936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:17.347419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fe166-cadc-4540-94e1-5cf083652973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.348046 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe166-cadc-4540-94e1-5cf083652973 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.351946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe166-cadc-4540-94e1-5cf083652973 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.351946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fe166-cadc-4540-94e1-5cf083652973 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.351946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fe166-cadc-4540-94e1-5cf083652973 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:17.351946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fe166-cadc-4540-94e1-5cf083652973 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.351946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fe166-cadc-4540-94e1-5cf083652973 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.363342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 612/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:17.369475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c9a14-3124-4b0c-9eff-de3a66554f5e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:17.474403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c9a14-3124-4b0c-9eff-de3a66554f5e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:17.502510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:17.509011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c868d-5e41-4a9e-8015-9893adf25ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:17.509613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c868d-5e41-4a9e-8015-9893adf25ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:17.509903 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c868d-5e41-4a9e-8015-9893adf25ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:17.510184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c868d-5e41-4a9e-8015-9893adf25ed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:17.510914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c868d-5e41-4a9e-8015-9893adf25ed9 None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=61d15478ca864f49aae2301e2328fe23) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:17.511197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c868d-5e41-4a9e-8015-9893adf25ed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:17.512860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c868d-5e41-4a9e-8015-9893adf25ed9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:17.518337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 607/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:17 2022] GET /identity/v3/role_assignments?user.id=61d15478ca864f49aae2301e2328fe23&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:19.420966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862fd5-970b-4851-b0e9-7a9a65ae00e4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.421520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862fd5-970b-4851-b0e9-7a9a65ae00e4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.421520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862fd5-970b-4851-b0e9-7a9a65ae00e4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.422933 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 613/1220] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:19.428346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b0db-7ecc-46a5-80f4-94bb58ba9d34 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.428809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b0db-7ecc-46a5-80f4-94bb58ba9d34 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.428914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056b0db-7ecc-46a5-80f4-94bb58ba9d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.448391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a056b0db-7ecc-46a5-80f4-94bb58ba9d34 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:19.449577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a056b0db-7ecc-46a5-80f4-94bb58ba9d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:19.524210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 608/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:19.803768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34862fd5-970b-4851-b0e9-7a9a65ae00e4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:19.916049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34862fd5-970b-4851-b0e9-7a9a65ae00e4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:19.953220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36d1e2-4a43-4286-ba82-0b2065db086a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:19.953849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36d1e2-4a43-4286-ba82-0b2065db086a None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:19.954155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36d1e2-4a43-4286-ba82-0b2065db086a None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:19.954421 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36d1e2-4a43-4286-ba82-0b2065db086a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:19.965893 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36d1e2-4a43-4286-ba82-0b2065db086a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-4c36d1e2-4a43-4286-ba82-0b2065db086a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:19.970611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:19.971864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:19.973071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 614/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:19.978400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056b0db-7ecc-46a5-80f4-94bb58ba9d34 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.090216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056b0db-7ecc-46a5-80f4-94bb58ba9d34 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.115307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.126323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946350a7-56ad-42eb-acb1-af45cf347404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.126949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946350a7-56ad-42eb-acb1-af45cf347404 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.127228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946350a7-56ad-42eb-acb1-af45cf347404 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.127499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946350a7-56ad-42eb-acb1-af45cf347404 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.128168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946350a7-56ad-42eb-acb1-af45cf347404 None admin] RBAC: Adding query filter params (name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:20.128470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946350a7-56ad-42eb-acb1-af45cf347404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.129821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946350a7-56ad-42eb-acb1-af45cf347404 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.138931 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 609/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:20.144687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36d1e2-4a43-4286-ba82-0b2065db086a None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.193140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.257590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36d1e2-4a43-4286-ba82-0b2065db086a None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.296089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58189fa-34af-4dcc-9a62-83063c43e5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.296725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58189fa-34af-4dcc-9a62-83063c43e5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.297002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58189fa-34af-4dcc-9a62-83063c43e5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.297278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58189fa-34af-4dcc-9a62-83063c43e5d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.309009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58189fa-34af-4dcc-9a62-83063c43e5d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.310517 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58189fa-34af-4dcc-9a62-83063c43e5d2 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-b58189fa-34af-4dcc-9a62-83063c43e5d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:20.327341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:20.333163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:20.335249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:20.335249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:20.335249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:20.335249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 615/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:20.335530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946350a7-56ad-42eb-acb1-af45cf347404 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.437941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946350a7-56ad-42eb-acb1-af45cf347404 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.473046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdf398-e7cd-478d-aa11-a21ecf02626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.473658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdf398-e7cd-478d-aa11-a21ecf02626f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.473972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdf398-e7cd-478d-aa11-a21ecf02626f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.474925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdf398-e7cd-478d-aa11-a21ecf02626f None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.475827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdf398-e7cd-478d-aa11-a21ecf02626f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:20.476134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdf398-e7cd-478d-aa11-a21ecf02626f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.477484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbdf398-e7cd-478d-aa11-a21ecf02626f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.490662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 610/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:20.496389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58189fa-34af-4dcc-9a62-83063c43e5d2 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.594213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.602222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58189fa-34af-4dcc-9a62-83063c43e5d2 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.642772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600677f1-eeca-439a-8d11-799a9b7d0c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.643395 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600677f1-eeca-439a-8d11-799a9b7d0c15 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.643669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600677f1-eeca-439a-8d11-799a9b7d0c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.643936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600677f1-eeca-439a-8d11-799a9b7d0c15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.652168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600677f1-eeca-439a-8d11-799a9b7d0c15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.653717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600677f1-eeca-439a-8d11-799a9b7d0c15 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-600677f1-eeca-439a-8d11-799a9b7d0c15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:20.665911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:20.667140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:20.668431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:20.668431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:20.668431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:20.668431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:20.668431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:20.668431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:20.668431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:20.668431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:20.668431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:20.668431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:20.668431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 616/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:20.673033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdf398-e7cd-478d-aa11-a21ecf02626f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.724019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:20.781397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdf398-e7cd-478d-aa11-a21ecf02626f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.818093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cfdc2-a032-41e0-8ccd-d31fcfeded62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:20.818787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cfdc2-a032-41e0-8ccd-d31fcfeded62 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:20.819072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cfdc2-a032-41e0-8ccd-d31fcfeded62 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:20.819350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cfdc2-a032-41e0-8ccd-d31fcfeded62 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:20.820079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cfdc2-a032-41e0-8ccd-d31fcfeded62 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:20.820385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cfdc2-a032-41e0-8ccd-d31fcfeded62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:20.821794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cfdc2-a032-41e0-8ccd-d31fcfeded62 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:20.840524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 611/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:20.846221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600677f1-eeca-439a-8d11-799a9b7d0c15 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:20.965497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600677f1-eeca-439a-8d11-799a9b7d0c15 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:20.999926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64413b52-a623-4dcc-bea9-9c95a3e2e0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.000468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64413b52-a623-4dcc-bea9-9c95a3e2e0f7 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.000742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64413b52-a623-4dcc-bea9-9c95a3e2e0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.001006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64413b52-a623-4dcc-bea9-9c95a3e2e0f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.011615 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64413b52-a623-4dcc-bea9-9c95a3e2e0f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.013074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64413b52-a623-4dcc-bea9-9c95a3e2e0f7 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-64413b52-a623-4dcc-bea9-9c95a3e2e0f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:21.027724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:21.031667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:21.032842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:21.032842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:21.032842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:21.032842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 617/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:21.034773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cfdc2-a032-41e0-8ccd-d31fcfeded62 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.137614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cfdc2-a032-41e0-8ccd-d31fcfeded62 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.139989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.172056 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6897ad1-3d68-408c-a759-a3b13cbb074d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.172664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897ad1-3d68-408c-a759-a3b13cbb074d None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.172949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897ad1-3d68-408c-a759-a3b13cbb074d None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.173223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6897ad1-3d68-408c-a759-a3b13cbb074d None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.173920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6897ad1-3d68-408c-a759-a3b13cbb074d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:21.182119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6897ad1-3d68-408c-a759-a3b13cbb074d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.182119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6897ad1-3d68-408c-a759-a3b13cbb074d None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.187321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 612/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:21.193453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64413b52-a623-4dcc-bea9-9c95a3e2e0f7 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.203163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.299676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64413b52-a623-4dcc-bea9-9c95a3e2e0f7 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.336828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20b1a0-75b9-4192-b5f0-b37a29885ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.337462 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b1a0-75b9-4192-b5f0-b37a29885ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.337742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b1a0-75b9-4192-b5f0-b37a29885ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.338041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20b1a0-75b9-4192-b5f0-b37a29885ce4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.345967 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20b1a0-75b9-4192-b5f0-b37a29885ce4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.347406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20b1a0-75b9-4192-b5f0-b37a29885ce4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-5a20b1a0-75b9-4192-b5f0-b37a29885ce4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:21.359477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:21.360659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:21.361853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:21.361853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:21.361853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:21.361853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:21.361853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:21.361853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:21.361853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:21.361853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:21.361853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 618/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:21.367110 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6897ad1-3d68-408c-a759-a3b13cbb074d None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.477287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6897ad1-3d68-408c-a759-a3b13cbb074d None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.512975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a2b6c-aff5-4521-a643-3a99a3eb1a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.513589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a2b6c-aff5-4521-a643-3a99a3eb1a1f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.513864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a2b6c-aff5-4521-a643-3a99a3eb1a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.514154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a2b6c-aff5-4521-a643-3a99a3eb1a1f None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.514844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a2b6c-aff5-4521-a643-3a99a3eb1a1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:21.515146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a2b6c-aff5-4521-a643-3a99a3eb1a1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.516555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a2b6c-aff5-4521-a643-3a99a3eb1a1f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.530292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 613/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:21.536334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20b1a0-75b9-4192-b5f0-b37a29885ce4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:21.612463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:21.647741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20b1a0-75b9-4192-b5f0-b37a29885ce4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:21.685997 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60d574-88ad-4ecc-b867-2ba192fa43de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:21.686660 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60d574-88ad-4ecc-b867-2ba192fa43de None admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:21.686937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60d574-88ad-4ecc-b867-2ba192fa43de None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:21.687209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60d574-88ad-4ecc-b867-2ba192fa43de None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/61d15478ca864f49aae2301e2328fe23/roles/a5689ba8062a40f38b7a985af27c2f5c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:21.702297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60d574-88ad-4ecc-b867-2ba192fa43de None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=61d15478ca864f49aae2301e2328fe23, role_id=a5689ba8062a40f38b7a985af27c2f5c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:21.703791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60d574-88ad-4ecc-b867-2ba192fa43de None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:21.827025 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 619/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:21 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/61d15478ca864f49aae2301e2328fe23/roles/a5689ba8062a40f38b7a985af27c2f5c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:23.809267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9eab-e20c-46f2-94cf-997a1f5ffc12 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.809866 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9eab-e20c-46f2-94cf-997a1f5ffc12 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.809866 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9eab-e20c-46f2-94cf-997a1f5ffc12 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.811189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 614/1233] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:23.816400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa3af1-e91e-435b-858f-f8459cb1ed78 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:23.816791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa3af1-e91e-435b-858f-f8459cb1ed78 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:23.816935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa3af1-e91e-435b-858f-f8459cb1ed78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:23.836917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8dfa3af1-e91e-435b-858f-f8459cb1ed78 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:23.838262 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8dfa3af1-e91e-435b-858f-f8459cb1ed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:23.906451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 620/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:24.182500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa9eab-e20c-46f2-94cf-997a1f5ffc12 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.209844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.289023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa9eab-e20c-46f2-94cf-997a1f5ffc12 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.324092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5acb7-fec8-4d9c-b266-58a135bdb48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.324725 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5acb7-fec8-4d9c-b266-58a135bdb48e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.325004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5acb7-fec8-4d9c-b266-58a135bdb48e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.325272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5acb7-fec8-4d9c-b266-58a135bdb48e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.336443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5acb7-fec8-4d9c-b266-58a135bdb48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-41d5acb7-fec8-4d9c-b266-58a135bdb48e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:24.341207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:24.342337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:24.343183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 615/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:24.348605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa3af1-e91e-435b-858f-f8459cb1ed78 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.398310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.456021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa3af1-e91e-435b-858f-f8459cb1ed78 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.491542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef5d7-994d-41b0-810a-cf43668a1c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.492230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef5d7-994d-41b0-810a-cf43668a1c12 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.492517 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef5d7-994d-41b0-810a-cf43668a1c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.492788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cef5d7-994d-41b0-810a-cf43668a1c12 None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.493447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cef5d7-994d-41b0-810a-cf43668a1c12 None admin] RBAC: Adding query filter params (name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:24.493745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cef5d7-994d-41b0-810a-cf43668a1c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.495151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cef5d7-994d-41b0-810a-cf43668a1c12 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:24.503287 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 621/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:24.510297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5acb7-fec8-4d9c-b266-58a135bdb48e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.596830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.612684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5acb7-fec8-4d9c-b266-58a135bdb48e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.647353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80582e-a24c-414e-b98c-0474ed4d7d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.647978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80582e-a24c-414e-b98c-0474ed4d7d71 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.648254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80582e-a24c-414e-b98c-0474ed4d7d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.648572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce80582e-a24c-414e-b98c-0474ed4d7d71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.659184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80582e-a24c-414e-b98c-0474ed4d7d71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.660807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce80582e-a24c-414e-b98c-0474ed4d7d71 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-ce80582e-a24c-414e-b98c-0474ed4d7d71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:24.675045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:24.676288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:24.677863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:24.677863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:24.677863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:24.677863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 616/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:24.682994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef5d7-994d-41b0-810a-cf43668a1c12 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.789885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cef5d7-994d-41b0-810a-cf43668a1c12 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.798989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.823846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf1360-f473-44d8-9287-7ef5f7221acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.824449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1360-f473-44d8-9287-7ef5f7221acf None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.824705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1360-f473-44d8-9287-7ef5f7221acf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.824971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf1360-f473-44d8-9287-7ef5f7221acf None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.825604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf1360-f473-44d8-9287-7ef5f7221acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:24.825920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf1360-f473-44d8-9287-7ef5f7221acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.827267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf1360-f473-44d8-9287-7ef5f7221acf None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:24.838900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 622/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:24.845019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80582e-a24c-414e-b98c-0474ed4d7d71 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:24.948288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce80582e-a24c-414e-b98c-0474ed4d7d71 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:24.981709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14aa5f-a933-452d-9623-ece8b4651b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:24.982611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14aa5f-a933-452d-9623-ece8b4651b96 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:24.982886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14aa5f-a933-452d-9623-ece8b4651b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:24.983151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f14aa5f-a933-452d-9623-ece8b4651b96 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:24.985780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:24.990886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14aa5f-a933-452d-9623-ece8b4651b96 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:24.992318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f14aa5f-a933-452d-9623-ece8b4651b96 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-3f14aa5f-a933-452d-9623-ece8b4651b96 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:25.003276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:25.004277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:25.006188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:25.006188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:25.006188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:25.006188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:25.006188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:25.006188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:25.006188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:25.006188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:25.006188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:25.006188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:25.006188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 617/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:25.010819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf1360-f473-44d8-9287-7ef5f7221acf None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.112293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf1360-f473-44d8-9287-7ef5f7221acf None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.147418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c9c0f-e9ef-41d5-aa65-71abeae73875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.148068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c9c0f-e9ef-41d5-aa65-71abeae73875 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.148345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c9c0f-e9ef-41d5-aa65-71abeae73875 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.148610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c9c0f-e9ef-41d5-aa65-71abeae73875 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.149320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c9c0f-e9ef-41d5-aa65-71abeae73875 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:25.149616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c9c0f-e9ef-41d5-aa65-71abeae73875 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.151053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c9c0f-e9ef-41d5-aa65-71abeae73875 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.168873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 623/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:25.175129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14aa5f-a933-452d-9623-ece8b4651b96 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.281548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f14aa5f-a933-452d-9623-ece8b4651b96 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.316072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032fdce-d217-4b20-8b3b-e07ad55700c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.320940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032fdce-d217-4b20-8b3b-e07ad55700c7 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.320940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032fdce-d217-4b20-8b3b-e07ad55700c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.320940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032fdce-d217-4b20-8b3b-e07ad55700c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.379772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:25.386844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032fdce-d217-4b20-8b3b-e07ad55700c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.388261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032fdce-d217-4b20-8b3b-e07ad55700c7 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.488016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 618/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 16:20:25.495450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c9c0f-e9ef-41d5-aa65-71abeae73875 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.523886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:25.596623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c9c0f-e9ef-41d5-aa65-71abeae73875 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.632472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e0aab-82ff-4f65-b707-cc100bdbbd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.633745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e0aab-82ff-4f65-b707-cc100bdbbd14 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.633745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e0aab-82ff-4f65-b707-cc100bdbbd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.633745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e0aab-82ff-4f65-b707-cc100bdbbd14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.643910 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e0aab-82ff-4f65-b707-cc100bdbbd14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.645355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e0aab-82ff-4f65-b707-cc100bdbbd14 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-606e0aab-82ff-4f65-b707-cc100bdbbd14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:25.660261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:25.662111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:25.663348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:25.663348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:25.663348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:25.663348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 624/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:25.667934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032fdce-d217-4b20-8b3b-e07ad55700c7 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.760916 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:25.766587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032fdce-d217-4b20-8b3b-e07ad55700c7 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.799855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d69af1-b112-488b-9ff4-e6d2b5da7438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.800451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d69af1-b112-488b-9ff4-e6d2b5da7438 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.800724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d69af1-b112-488b-9ff4-e6d2b5da7438 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.800992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d69af1-b112-488b-9ff4-e6d2b5da7438 None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.801619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d69af1-b112-488b-9ff4-e6d2b5da7438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:25.801939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d69af1-b112-488b-9ff4-e6d2b5da7438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.804010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d69af1-b112-488b-9ff4-e6d2b5da7438 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.815190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 619/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:25.821119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e0aab-82ff-4f65-b707-cc100bdbbd14 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:25.901250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:25.922940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e0aab-82ff-4f65-b707-cc100bdbbd14 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:25.956221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bb23c-6ca5-4128-8964-57ce09d822d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:25.956847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bb23c-6ca5-4128-8964-57ce09d822d0 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:25.957126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bb23c-6ca5-4128-8964-57ce09d822d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:25.957397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bb23c-6ca5-4128-8964-57ce09d822d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:25.964973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bb23c-6ca5-4128-8964-57ce09d822d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:25.966867 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bb23c-6ca5-4128-8964-57ce09d822d0 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-c97bb23c-6ca5-4128-8964-57ce09d822d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:25.978901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:25.980029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:25.981271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:25.981271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:25.981271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:25.981271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:25.981271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:25.981271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:25.981271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:25.981271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:25.981271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 625/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:25.986573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d69af1-b112-488b-9ff4-e6d2b5da7438 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.088265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d69af1-b112-488b-9ff4-e6d2b5da7438 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.123160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead86eed-3193-4170-b562-17487cbbaf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.123767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86eed-3193-4170-b562-17487cbbaf93 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.124047 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86eed-3193-4170-b562-17487cbbaf93 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.124321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead86eed-3193-4170-b562-17487cbbaf93 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.125006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead86eed-3193-4170-b562-17487cbbaf93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.125310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead86eed-3193-4170-b562-17487cbbaf93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.126782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead86eed-3193-4170-b562-17487cbbaf93 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.139477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 620/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:26.145639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bb23c-6ca5-4128-8964-57ce09d822d0 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:26.250832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bb23c-6ca5-4128-8964-57ce09d822d0 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:26.284791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a31097-f1fb-4ba9-9dc1-10472cbee28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:26.285393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31097-f1fb-4ba9-9dc1-10472cbee28b None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:26.285672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31097-f1fb-4ba9-9dc1-10472cbee28b None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:26.285972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31097-f1fb-4ba9-9dc1-10472cbee28b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:26.287269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a31097-f1fb-4ba9-9dc1-10472cbee28b None admin] RBAC: Adding query filter params (role.id=a5689ba8062a40f38b7a985af27c2f5c, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=61d15478ca864f49aae2301e2328fe23) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:26.287624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a31097-f1fb-4ba9-9dc1-10472cbee28b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:26.289053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a31097-f1fb-4ba9-9dc1-10472cbee28b None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:26.294930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 626/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:26 2022] GET /identity/v3/role_assignments?user.id=61d15478ca864f49aae2301e2328fe23&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=a5689ba8062a40f38b7a985af27c2f5c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:28.274338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57a6ad-b5bb-4eff-8a90-6d1278bcc54e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.274887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57a6ad-b5bb-4eff-8a90-6d1278bcc54e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.274887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57a6ad-b5bb-4eff-8a90-6d1278bcc54e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.276228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 621/1247] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:28.281563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaba7d-4ee5-4462-87b7-7ff208f22ace None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.281968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaba7d-4ee5-4462-87b7-7ff208f22ace None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.282140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaba7d-4ee5-4462-87b7-7ff208f22ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.289456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:28.301527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ffcaba7d-4ee5-4462-87b7-7ff208f22ace None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:28.303215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ffcaba7d-4ee5-4462-87b7-7ff208f22ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:28.370080 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 627/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:28.644060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57a6ad-b5bb-4eff-8a90-6d1278bcc54e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.663808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:28.766422 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57a6ad-b5bb-4eff-8a90-6d1278bcc54e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.804271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d548d3-6e1d-4f26-bc9e-8262667ad0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.804910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d548d3-6e1d-4f26-bc9e-8262667ad0ab None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.805190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d548d3-6e1d-4f26-bc9e-8262667ad0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.805462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d548d3-6e1d-4f26-bc9e-8262667ad0ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.815904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d548d3-6e1d-4f26-bc9e-8262667ad0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-77d548d3-6e1d-4f26-bc9e-8262667ad0ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:28.821432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:28.824958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:28.826039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 622/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:28.828741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaba7d-4ee5-4462-87b7-7ff208f22ace None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:28.936304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaba7d-4ee5-4462-87b7-7ff208f22ace None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:28.967261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:28.971996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6a98b-3f89-44c1-b252-ca865ccc6fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:28.972609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a98b-3f89-44c1-b252-ca865ccc6fda None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:28.972904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a98b-3f89-44c1-b252-ca865ccc6fda None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:28.973241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6a98b-3f89-44c1-b252-ca865ccc6fda None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:28.973923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6a98b-3f89-44c1-b252-ca865ccc6fda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:28.974453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6a98b-3f89-44c1-b252-ca865ccc6fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:28.975740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d6a98b-3f89-44c1-b252-ca865ccc6fda None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:28.984278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 628/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:28.991037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d548d3-6e1d-4f26-bc9e-8262667ad0ab None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.076558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.100797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d548d3-6e1d-4f26-bc9e-8262667ad0ab None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.139925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95876c11-7425-49ba-9737-4b3bcdb364d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.140618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95876c11-7425-49ba-9737-4b3bcdb364d9 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.141004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95876c11-7425-49ba-9737-4b3bcdb364d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.141280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95876c11-7425-49ba-9737-4b3bcdb364d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.152036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95876c11-7425-49ba-9737-4b3bcdb364d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.153498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95876c11-7425-49ba-9737-4b3bcdb364d9 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-95876c11-7425-49ba-9737-4b3bcdb364d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:29.169123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:29.170284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:29.171365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:29.171365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:29.171365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:29.171365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 623/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:29.176513 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6a98b-3f89-44c1-b252-ca865ccc6fda None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.279610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6a98b-3f89-44c1-b252-ca865ccc6fda None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.314325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b3eab-6009-4330-b6c0-4f97cab00f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.314954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b3eab-6009-4330-b6c0-4f97cab00f96 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.315169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b3eab-6009-4330-b6c0-4f97cab00f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.315434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b3eab-6009-4330-b6c0-4f97cab00f96 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.316062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b3eab-6009-4330-b6c0-4f97cab00f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:29.316356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b3eab-6009-4330-b6c0-4f97cab00f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.317832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b3eab-6009-4330-b6c0-4f97cab00f96 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.329709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 629/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:29.335910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95876c11-7425-49ba-9737-4b3bcdb364d9 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.441356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95876c11-7425-49ba-9737-4b3bcdb364d9 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.480793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.488847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712de04-dda9-4f76-9bdd-36684c7b38dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.489476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712de04-dda9-4f76-9bdd-36684c7b38dc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.490518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712de04-dda9-4f76-9bdd-36684c7b38dc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.490892 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712de04-dda9-4f76-9bdd-36684c7b38dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.498294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712de04-dda9-4f76-9bdd-36684c7b38dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.499701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712de04-dda9-4f76-9bdd-36684c7b38dc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0712de04-dda9-4f76-9bdd-36684c7b38dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:29.510660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:29.511902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:29.513345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:29.513345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:29.513345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:29.513345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:29.513345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:29.513345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:29.513345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:29.513345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:29.513345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:29.513345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:29.513345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 624/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:29.518883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b3eab-6009-4330-b6c0-4f97cab00f96 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.576000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.622443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b3eab-6009-4330-b6c0-4f97cab00f96 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.658444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5d3f-56b2-4281-8177-3461162f50a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.659043 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5d3f-56b2-4281-8177-3461162f50a9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.659321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5d3f-56b2-4281-8177-3461162f50a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.659592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5d3f-56b2-4281-8177-3461162f50a9 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.660472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db5d3f-56b2-4281-8177-3461162f50a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:29.660638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db5d3f-56b2-4281-8177-3461162f50a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.662864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db5d3f-56b2-4281-8177-3461162f50a9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:29.686399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 630/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:29.692451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712de04-dda9-4f76-9bdd-36684c7b38dc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:29.799354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712de04-dda9-4f76-9bdd-36684c7b38dc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:29.836629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86316bb5-944d-46ef-9941-c54da316678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:29.837246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316bb5-944d-46ef-9941-c54da316678f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:29.837525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316bb5-944d-46ef-9941-c54da316678f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:29.837791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86316bb5-944d-46ef-9941-c54da316678f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:29.899663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:29.913913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86316bb5-944d-46ef-9941-c54da316678f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:29.915350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86316bb5-944d-46ef-9941-c54da316678f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.023190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 625/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:30.029242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5d3f-56b2-4281-8177-3461162f50a9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.141491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5d3f-56b2-4281-8177-3461162f50a9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.155690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:30.176406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540352d0-ede9-4f9d-98c9-2a83e38255bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.177109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540352d0-ede9-4f9d-98c9-2a83e38255bd None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.177718 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540352d0-ede9-4f9d-98c9-2a83e38255bd None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.178194 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540352d0-ede9-4f9d-98c9-2a83e38255bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.188313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540352d0-ede9-4f9d-98c9-2a83e38255bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.189746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540352d0-ede9-4f9d-98c9-2a83e38255bd None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-540352d0-ede9-4f9d-98c9-2a83e38255bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:30.205116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:30.212821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:30.214028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:30.214028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:30.214028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:30.214028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 631/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:30.214346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86316bb5-944d-46ef-9941-c54da316678f None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.302571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:30.314398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86316bb5-944d-46ef-9941-c54da316678f None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.362049 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bdb35-14ca-46b5-987c-6426f218be3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.363284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bdb35-14ca-46b5-987c-6426f218be3a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.363789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bdb35-14ca-46b5-987c-6426f218be3a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.364277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606bdb35-14ca-46b5-987c-6426f218be3a None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.365434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bdb35-14ca-46b5-987c-6426f218be3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:30.366081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bdb35-14ca-46b5-987c-6426f218be3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.368408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606bdb35-14ca-46b5-987c-6426f218be3a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.387571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 626/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:30.393258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540352d0-ede9-4f9d-98c9-2a83e38255bd None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.498101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540352d0-ede9-4f9d-98c9-2a83e38255bd None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.533516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d243-592d-4fb6-85d2-dd80f6f318f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.534173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d243-592d-4fb6-85d2-dd80f6f318f4 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.534448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d243-592d-4fb6-85d2-dd80f6f318f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.534715 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9947d243-592d-4fb6-85d2-dd80f6f318f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.541900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947d243-592d-4fb6-85d2-dd80f6f318f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.543874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9947d243-592d-4fb6-85d2-dd80f6f318f4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9947d243-592d-4fb6-85d2-dd80f6f318f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:30.555701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:30.557974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:30.559127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:30.559127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:30.559127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:30.559127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:30.559127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:30.559127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:30.559127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:30.559127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:30.559127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 632/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:30.562966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bdb35-14ca-46b5-987c-6426f218be3a None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.667029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606bdb35-14ca-46b5-987c-6426f218be3a None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.701321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf02f87-5b16-4aa1-a8f8-546d51a450d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.701947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf02f87-5b16-4aa1-a8f8-546d51a450d6 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.702227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf02f87-5b16-4aa1-a8f8-546d51a450d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.702496 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf02f87-5b16-4aa1-a8f8-546d51a450d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.703180 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf02f87-5b16-4aa1-a8f8-546d51a450d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:30.703479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf02f87-5b16-4aa1-a8f8-546d51a450d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.704873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf02f87-5b16-4aa1-a8f8-546d51a450d6 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.717614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 627/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:30.724063 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d243-592d-4fb6-85d2-dd80f6f318f4 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:30.756003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:30.833085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9947d243-592d-4fb6-85d2-dd80f6f318f4 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:30.874554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae35f2-0ebe-4b74-9c8d-539c977e158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:30.875198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae35f2-0ebe-4b74-9c8d-539c977e158d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:30.875478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae35f2-0ebe-4b74-9c8d-539c977e158d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:30.875749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae35f2-0ebe-4b74-9c8d-539c977e158d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:30.876525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae35f2-0ebe-4b74-9c8d-539c977e158d None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=61d15478ca864f49aae2301e2328fe23) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:30.876833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae35f2-0ebe-4b74-9c8d-539c977e158d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:30.878327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae35f2-0ebe-4b74-9c8d-539c977e158d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:30.885906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 633/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:30 2022] GET /identity/v3/role_assignments?user.id=61d15478ca864f49aae2301e2328fe23&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:32.796466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24af43-5548-4367-9041-ca76798d9b8b None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.797004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24af43-5548-4367-9041-ca76798d9b8b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.797004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24af43-5548-4367-9041-ca76798d9b8b None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.798507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 628/1261] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:32.803890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c93f-ca51-4f88-a7db-1502e8ce3c62 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:32.804302 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c93f-ca51-4f88-a7db-1502e8ce3c62 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:32.804471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44c93f-ca51-4f88-a7db-1502e8ce3c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:32.822786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6c44c93f-ca51-4f88-a7db-1502e8ce3c62 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:32.823990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6c44c93f-ca51-4f88-a7db-1502e8ce3c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:32.892491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 634/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:33.162100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24af43-5548-4367-9041-ca76798d9b8b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.173246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.266455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24af43-5548-4367-9041-ca76798d9b8b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.303026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420c28b-8019-4759-a5b2-fcee841bfdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.303688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420c28b-8019-4759-a5b2-fcee841bfdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.303957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420c28b-8019-4759-a5b2-fcee841bfdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.304234 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420c28b-8019-4759-a5b2-fcee841bfdd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.314384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420c28b-8019-4759-a5b2-fcee841bfdd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-c420c28b-8019-4759-a5b2-fcee841bfdd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:33.320057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:33.321062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:33.322102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 629/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:33.327234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44c93f-ca51-4f88-a7db-1502e8ce3c62 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.345464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.428083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44c93f-ca51-4f88-a7db-1502e8ce3c62 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.464245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76109da0-e5d7-428c-af48-a153242f0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.464855 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109da0-e5d7-428c-af48-a153242f0faf None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.465134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109da0-e5d7-428c-af48-a153242f0faf None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.465402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109da0-e5d7-428c-af48-a153242f0faf None admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.466160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76109da0-e5d7-428c-af48-a153242f0faf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:33.466464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76109da0-e5d7-428c-af48-a153242f0faf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.467812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76109da0-e5d7-428c-af48-a153242f0faf None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.476783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 635/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:33.483007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420c28b-8019-4759-a5b2-fcee841bfdd4 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.552766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.586978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420c28b-8019-4759-a5b2-fcee841bfdd4 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.621668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4d901-4ff8-4987-99d3-e20bcbf022a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.622322 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d901-4ff8-4987-99d3-e20bcbf022a8 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.622602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d901-4ff8-4987-99d3-e20bcbf022a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.622873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d901-4ff8-4987-99d3-e20bcbf022a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.633177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4d901-4ff8-4987-99d3-e20bcbf022a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.634631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4d901-4ff8-4987-99d3-e20bcbf022a8 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-a9c4d901-4ff8-4987-99d3-e20bcbf022a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:33.650947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:33.652187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:33.653122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:33.653122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:33.653122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:33.653122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 630/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:33.658130 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76109da0-e5d7-428c-af48-a153242f0faf None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.742906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.762279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76109da0-e5d7-428c-af48-a153242f0faf None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.797922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c0afb-d1e7-49c2-a132-12d0920eab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.799041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0afb-d1e7-49c2-a132-12d0920eab1d None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.799702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0afb-d1e7-49c2-a132-12d0920eab1d None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.800039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c0afb-d1e7-49c2-a132-12d0920eab1d None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.801178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c0afb-d1e7-49c2-a132-12d0920eab1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:33.801485 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c0afb-d1e7-49c2-a132-12d0920eab1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.803011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c0afb-d1e7-49c2-a132-12d0920eab1d None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.815339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 636/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:33.822334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4d901-4ff8-4987-99d3-e20bcbf022a8 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:33.926626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4d901-4ff8-4987-99d3-e20bcbf022a8 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:33.947118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:33.962060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3db45-6c69-4643-b1c0-bb273313fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:33.962691 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3db45-6c69-4643-b1c0-bb273313fa92 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:33.962969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3db45-6c69-4643-b1c0-bb273313fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:33.963239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3db45-6c69-4643-b1c0-bb273313fa92 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:33.971479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3db45-6c69-4643-b1c0-bb273313fa92 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:33.972945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3db45-6c69-4643-b1c0-bb273313fa92 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-aea3db45-6c69-4643-b1c0-bb273313fa92 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:33.985652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:33.992209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:33.993524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:33.993524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:33.993524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:33.993524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:33.993524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:33.993524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:33.993524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:33.993524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:33.993524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:33.993524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:33.993524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 631/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:33.994378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c0afb-d1e7-49c2-a132-12d0920eab1d None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.098804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c0afb-d1e7-49c2-a132-12d0920eab1d None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.136691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec7c00-aa75-4d2f-b576-beb251b7d2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.137306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7c00-aa75-4d2f-b576-beb251b7d2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.137582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7c00-aa75-4d2f-b576-beb251b7d2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.137847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7c00-aa75-4d2f-b576-beb251b7d2e9 None admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.138591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec7c00-aa75-4d2f-b576-beb251b7d2e9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:34.138978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec7c00-aa75-4d2f-b576-beb251b7d2e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.140374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec7c00-aa75-4d2f-b576-beb251b7d2e9 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.149751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:34.158452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 637/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 1 16:20:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:34.165060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3db45-6c69-4643-b1c0-bb273313fa92 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.267338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3db45-6c69-4643-b1c0-bb273313fa92 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.300479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ee033-2791-420a-b136-255528623b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.301112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ee033-2791-420a-b136-255528623b0c None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.301400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ee033-2791-420a-b136-255528623b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.301692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ee033-2791-420a-b136-255528623b0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.313999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ee033-2791-420a-b136-255528623b0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.315427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ee033-2791-420a-b136-255528623b0c None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-dc2ee033-2791-420a-b136-255528623b0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:34.330824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:34.331977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:34.333088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:34.333088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:34.333088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:34.333088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 632/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:34.337970 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec7c00-aa75-4d2f-b576-beb251b7d2e9 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.440555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec7c00-aa75-4d2f-b576-beb251b7d2e9 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.475813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d217e-38d8-44e3-86ba-5b4566f1c121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.480406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d217e-38d8-44e3-86ba-5b4566f1c121 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.480406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d217e-38d8-44e3-86ba-5b4566f1c121 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.480406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d217e-38d8-44e3-86ba-5b4566f1c121 None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.480406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d217e-38d8-44e3-86ba-5b4566f1c121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:34.480406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d217e-38d8-44e3-86ba-5b4566f1c121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.480406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d217e-38d8-44e3-86ba-5b4566f1c121 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.492234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 638/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:34.498034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ee033-2791-420a-b136-255528623b0c None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.535025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:34.598776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ee033-2791-420a-b136-255528623b0c None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.633571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ef7a2-fa76-4b48-bfe2-569dce25242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.634223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ef7a2-fa76-4b48-bfe2-569dce25242b None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.634500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ef7a2-fa76-4b48-bfe2-569dce25242b None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.634768 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ef7a2-fa76-4b48-bfe2-569dce25242b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.641262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ef7a2-fa76-4b48-bfe2-569dce25242b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.642697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ef7a2-fa76-4b48-bfe2-569dce25242b None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-0d3ef7a2-fa76-4b48-bfe2-569dce25242b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:34.653666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:34.654758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:34.656129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:34.656129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:34.656129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:34.656129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:34.656129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:34.656129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:34.656129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:34.656129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:34.656129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 633/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:34.660758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d217e-38d8-44e3-86ba-5b4566f1c121 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.719984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:34.762570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d217e-38d8-44e3-86ba-5b4566f1c121 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.799302 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda8f06-e911-4e62-b9fd-d0e994edda85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.799828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda8f06-e911-4e62-b9fd-d0e994edda85 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.800104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda8f06-e911-4e62-b9fd-d0e994edda85 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.800368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda8f06-e911-4e62-b9fd-d0e994edda85 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.801057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda8f06-e911-4e62-b9fd-d0e994edda85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:34.801353 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda8f06-e911-4e62-b9fd-d0e994edda85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.803185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda8f06-e911-4e62-b9fd-d0e994edda85 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:34.815839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 639/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:34.822770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ef7a2-fa76-4b48-bfe2-569dce25242b None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:34.922711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:34.933302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ef7a2-fa76-4b48-bfe2-569dce25242b None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:34.968720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9585b8-7ceb-4858-bef7-9b45c13a2e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:34.969402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9585b8-7ceb-4858-bef7-9b45c13a2e39 None admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:34.969977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9585b8-7ceb-4858-bef7-9b45c13a2e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:34.970452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9585b8-7ceb-4858-bef7-9b45c13a2e39 None admin] PATH_INFO: `/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/61d15478ca864f49aae2301e2328fe23/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:34.972764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9585b8-7ceb-4858-bef7-9b45c13a2e39 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc1930a713a48c693da6c8d6b2102a9, user_id=61d15478ca864f49aae2301e2328fe23, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:34.974594 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9585b8-7ceb-4858-bef7-9b45c13a2e39 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:35.085709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 634/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Sep 1 16:20:34 2022] PUT /identity/v3/projects/0bc1930a713a48c693da6c8d6b2102a9/users/61d15478ca864f49aae2301e2328fe23/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:20:37.066208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37958d-da9c-410c-b95a-2ec83b48ed3b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.066769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37958d-da9c-410c-b95a-2ec83b48ed3b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.066769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37958d-da9c-410c-b95a-2ec83b48ed3b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.068904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 640/1274] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:37.074230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba00dcc-961e-4347-b23a-dabdf41d9ee6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.074726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba00dcc-961e-4347-b23a-dabdf41d9ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.074834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba00dcc-961e-4347-b23a-dabdf41d9ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.093912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2ba00dcc-961e-4347-b23a-dabdf41d9ee6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:37.095106 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2ba00dcc-961e-4347-b23a-dabdf41d9ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:37.166380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 635/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:37.439262 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37958d-da9c-410c-b95a-2ec83b48ed3b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.548756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37958d-da9c-410c-b95a-2ec83b48ed3b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.568408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.586648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2304f30-8c0b-4aa1-879d-fe7b6eff8757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.587284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2304f30-8c0b-4aa1-879d-fe7b6eff8757 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.587577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2304f30-8c0b-4aa1-879d-fe7b6eff8757 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.587831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2304f30-8c0b-4aa1-879d-fe7b6eff8757 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.598012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2304f30-8c0b-4aa1-879d-fe7b6eff8757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-e2304f30-8c0b-4aa1-879d-fe7b6eff8757 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 16:20:37.603343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:37.604368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:37.605337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 641/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:37.610994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba00dcc-961e-4347-b23a-dabdf41d9ee6 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.700575 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:37.719228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba00dcc-961e-4347-b23a-dabdf41d9ee6 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.759695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38cf14-4dbc-4556-8cd0-540a2f5bc220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.760646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38cf14-4dbc-4556-8cd0-540a2f5bc220 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.760925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38cf14-4dbc-4556-8cd0-540a2f5bc220 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.761196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38cf14-4dbc-4556-8cd0-540a2f5bc220 None admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.762198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38cf14-4dbc-4556-8cd0-540a2f5bc220 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:37.762497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38cf14-4dbc-4556-8cd0-540a2f5bc220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.763887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38cf14-4dbc-4556-8cd0-540a2f5bc220 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.773528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 636/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:37.779178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2304f30-8c0b-4aa1-879d-fe7b6eff8757 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:37.882613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2304f30-8c0b-4aa1-879d-fe7b6eff8757 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:37.918646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88868fab-9943-452e-a472-271085d0b648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:37.919309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88868fab-9943-452e-a472-271085d0b648 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:37.919586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88868fab-9943-452e-a472-271085d0b648 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:37.919854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88868fab-9943-452e-a472-271085d0b648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:37.931445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88868fab-9943-452e-a472-271085d0b648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:37.932898 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88868fab-9943-452e-a472-271085d0b648 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-88868fab-9943-452e-a472-271085d0b648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:37.948133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:37.949332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:37.950484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:37.950484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:37.950484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:37.950484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 642/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:37.955386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38cf14-4dbc-4556-8cd0-540a2f5bc220 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.067164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38cf14-4dbc-4556-8cd0-540a2f5bc220 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.101588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245663-d873-4f22-8c89-5ece5e3e89fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.102226 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245663-d873-4f22-8c89-5ece5e3e89fc None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.102501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245663-d873-4f22-8c89-5ece5e3e89fc None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.102768 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245663-d873-4f22-8c89-5ece5e3e89fc None admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.103395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245663-d873-4f22-8c89-5ece5e3e89fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:38.103705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245663-d873-4f22-8c89-5ece5e3e89fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.105080 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245663-d873-4f22-8c89-5ece5e3e89fc None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.117857 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 637/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:38.124688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88868fab-9943-452e-a472-271085d0b648 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.158008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:38.228637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88868fab-9943-452e-a472-271085d0b648 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.268308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7d7ec-c8d1-42c0-bef5-35e2ee3fb7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.268973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7d7ec-c8d1-42c0-bef5-35e2ee3fb7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.269255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7d7ec-c8d1-42c0-bef5-35e2ee3fb7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.269525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7d7ec-c8d1-42c0-bef5-35e2ee3fb7b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.278672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7d7ec-c8d1-42c0-bef5-35e2ee3fb7b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.280135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7d7ec-c8d1-42c0-bef5-35e2ee3fb7b1 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9ee7d7ec-c8d1-42c0-bef5-35e2ee3fb7b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 16:20:38.293380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:38.294669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:38.295862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:38.295862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:38.295862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 16:20:38.295862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 16:20:38.295862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 16:20:38.295862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 16:20:38.295862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 16:20:38.295862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 16:20:38.295862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 16:20:38.295862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:38.295862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 643/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:38.301555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245663-d873-4f22-8c89-5ece5e3e89fc None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.306266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:38.406416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245663-d873-4f22-8c89-5ece5e3e89fc None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.441572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e8203-fb02-47b8-b7f2-985197f43601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.442490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e8203-fb02-47b8-b7f2-985197f43601 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.443018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e8203-fb02-47b8-b7f2-985197f43601 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.444335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e8203-fb02-47b8-b7f2-985197f43601 None admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.445133 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e8203-fb02-47b8-b7f2-985197f43601 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:38.445442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e8203-fb02-47b8-b7f2-985197f43601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.446884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e8203-fb02-47b8-b7f2-985197f43601 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.463902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 638/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:38.469835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7d7ec-c8d1-42c0-bef5-35e2ee3fb7b1 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.563429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:38.573238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7d7ec-c8d1-42c0-bef5-35e2ee3fb7b1 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.607779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f4dc7-da35-406c-8d4b-e846d2f25b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.608538 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f4dc7-da35-406c-8d4b-e846d2f25b11 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.608811 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f4dc7-da35-406c-8d4b-e846d2f25b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.609074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f4dc7-da35-406c-8d4b-e846d2f25b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.677023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f4dc7-da35-406c-8d4b-e846d2f25b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.679184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f4dc7-da35-406c-8d4b-e846d2f25b11 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.767197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:38.778998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 644/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 16:20:38.784978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e8203-fb02-47b8-b7f2-985197f43601 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:38.846529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:38.889104 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e8203-fb02-47b8-b7f2-985197f43601 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:38.928862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c939b1-83a9-4081-bb60-e90d9a2f799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:38.929533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c939b1-83a9-4081-bb60-e90d9a2f799e None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:38.929810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c939b1-83a9-4081-bb60-e90d9a2f799e None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:38.930107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c939b1-83a9-4081-bb60-e90d9a2f799e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:38.940578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c939b1-83a9-4081-bb60-e90d9a2f799e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:38.942014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c939b1-83a9-4081-bb60-e90d9a2f799e None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-98c939b1-83a9-4081-bb60-e90d9a2f799e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 16:20:38.957364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:38.963956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 16:20:38.964900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 16:20:38.964900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 16:20:38.964900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:38.964900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 639/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:38.965370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f4dc7-da35-406c-8d4b-e846d2f25b11 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:39.074849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f4dc7-da35-406c-8d4b-e846d2f25b11 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:39.114295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac369961-d879-43c4-a49f-988ac9a939bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:39.114954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369961-d879-43c4-a49f-988ac9a939bb None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.115223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369961-d879-43c4-a49f-988ac9a939bb None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.115489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac369961-d879-43c4-a49f-988ac9a939bb None admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.116133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac369961-d879-43c4-a49f-988ac9a939bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:39.116430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac369961-d879-43c4-a49f-988ac9a939bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:39.117810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac369961-d879-43c4-a49f-988ac9a939bb None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:39.131525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 645/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Sep 1 16:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:39.137248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c939b1-83a9-4081-bb60-e90d9a2f799e None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:39.248276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c939b1-83a9-4081-bb60-e90d9a2f799e None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:39.264454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:39.285343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e38ed-dab9-4983-9b19-3299a722d108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:39.285995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e38ed-dab9-4983-9b19-3299a722d108 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.286290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e38ed-dab9-4983-9b19-3299a722d108 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.286608 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e38ed-dab9-4983-9b19-3299a722d108 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.293267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e38ed-dab9-4983-9b19-3299a722d108 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:39.294755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e38ed-dab9-4983-9b19-3299a722d108 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application [None req-1c2e38ed-dab9-4983-9b19-3299a722d108 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 16:20:39.306885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:39.308103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:39.309215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 16:20:39.309215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 16:20:39.309215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 16:20:39.309215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 16:20:39.309215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 16:20:39.309215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 16:20:39.309215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 16:20:39.309215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: ERROR keystone.server.flask.application Sep 01 16:20:39.309215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 640/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Sep 1 16:20:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:39.314091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac369961-d879-43c4-a49f-988ac9a939bb None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:39.371479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:39.425459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac369961-d879-43c4-a49f-988ac9a939bb None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:39.461197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a948c7e-59bc-4deb-b855-e93d2a808337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:39.461812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a948c7e-59bc-4deb-b855-e93d2a808337 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.462123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a948c7e-59bc-4deb-b855-e93d2a808337 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.462397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a948c7e-59bc-4deb-b855-e93d2a808337 None admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.463123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a948c7e-59bc-4deb-b855-e93d2a808337 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:39.463456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a948c7e-59bc-4deb-b855-e93d2a808337 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:39.464911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a948c7e-59bc-4deb-b855-e93d2a808337 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:39.477268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 646/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Sep 1 16:20:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:39.483717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e38ed-dab9-4983-9b19-3299a722d108 None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:39.585625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e38ed-dab9-4983-9b19-3299a722d108 None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:39.620427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8f2d0-7774-4f97-88fc-f10f49ef86f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:39.621023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8f2d0-7774-4f97-88fc-f10f49ef86f3 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:39.621302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8f2d0-7774-4f97-88fc-f10f49ef86f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:39.621616 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8f2d0-7774-4f97-88fc-f10f49ef86f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:39.622311 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8f2d0-7774-4f97-88fc-f10f49ef86f3 None admin] RBAC: Adding query filter params (role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf, scope.project.id=0bc1930a713a48c693da6c8d6b2102a9, user.id=61d15478ca864f49aae2301e2328fe23) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:39.622615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8f2d0-7774-4f97-88fc-f10f49ef86f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:39.624008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8f2d0-7774-4f97-88fc-f10f49ef86f3 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:39.629652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 641/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Sep 1 16:20:39 2022] GET /identity/v3/role_assignments?user.id=61d15478ca864f49aae2301e2328fe23&scope.project.id=0bc1930a713a48c693da6c8d6b2102a9&role.id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:41.607052 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aea366-39b8-4bb0-b56e-26456e144021 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.607883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aea366-39b8-4bb0-b56e-26456e144021 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.607883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aea366-39b8-4bb0-b56e-26456e144021 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.609201 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 647/1288] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:20:41.615249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8921740-a77b-4538-b6a0-2930087589a1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:41.616414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8921740-a77b-4538-b6a0-2930087589a1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:41.616414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8921740-a77b-4538-b6a0-2930087589a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:41.635392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f8921740-a77b-4538-b6a0-2930087589a1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:41.636686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f8921740-a77b-4538-b6a0-2930087589a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:41.667312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:41.706975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 642/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:41.979203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aea366-39b8-4bb0-b56e-26456e144021 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:42.090208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aea366-39b8-4bb0-b56e-26456e144021 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:42.105028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:42.128709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c6cd9-8b98-4424-969b-8b6c99784927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:42.129344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c6cd9-8b98-4424-969b-8b6c99784927 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.129621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c6cd9-8b98-4424-969b-8b6c99784927 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.129906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c6cd9-8b98-4424-969b-8b6c99784927 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.131215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c6cd9-8b98-4424-969b-8b6c99784927 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:42.132877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c6cd9-8b98-4424-969b-8b6c99784927 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-9b8c6cd9-8b98-4424-969b-8b6c99784927 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:42.142007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:42.143333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:42.144229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 648/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:42.150524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8921740-a77b-4538-b6a0-2930087589a1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:42.261973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8921740-a77b-4538-b6a0-2930087589a1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:42.298412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8da11c-d8a1-4277-beef-9902670ad229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:42.299031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da11c-d8a1-4277-beef-9902670ad229 None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.299312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da11c-d8a1-4277-beef-9902670ad229 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.299581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8da11c-d8a1-4277-beef-9902670ad229 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.300239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8da11c-d8a1-4277-beef-9902670ad229 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:42.300537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8da11c-d8a1-4277-beef-9902670ad229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:42.301928 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8da11c-d8a1-4277-beef-9902670ad229 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:42.307689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 643/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Sep 1 16:20:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:20:42.313374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c6cd9-8b98-4424-969b-8b6c99784927 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:42.417125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c6cd9-8b98-4424-969b-8b6c99784927 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:42.452495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183261aa-6b20-4512-9fa9-ff1f678d4601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:42.453096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183261aa-6b20-4512-9fa9-ff1f678d4601 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:42.453371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183261aa-6b20-4512-9fa9-ff1f678d4601 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:42.453638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183261aa-6b20-4512-9fa9-ff1f678d4601 None admin] PATH_INFO: `/v3/services` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:42.454289 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183261aa-6b20-4512-9fa9-ff1f678d4601 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:42.454589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183261aa-6b20-4512-9fa9-ff1f678d4601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:42.455943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183261aa-6b20-4512-9fa9-ff1f678d4601 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:42.460608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 649/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Sep 1 16:20:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:44.401641 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe11c67-890d-4794-86db-06ef75fdd7ca None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.402251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe11c67-890d-4794-86db-06ef75fdd7ca None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.402251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe11c67-890d-4794-86db-06ef75fdd7ca None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:44.403494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 644/1293] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:44.408825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e86a5-c0ce-4fe9-89da-082a25af8168 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.409243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e86a5-c0ce-4fe9-89da-082a25af8168 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.409365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e86a5-c0ce-4fe9-89da-082a25af8168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:44.428805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-358e86a5-c0ce-4fe9-89da-082a25af8168 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:44.430030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-358e86a5-c0ce-4fe9-89da-082a25af8168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:44.459489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:44.496523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 650/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 16:20:44.763391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe11c67-890d-4794-86db-06ef75fdd7ca None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:44.796772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:44.875053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe11c67-890d-4794-86db-06ef75fdd7ca None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:44.916271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3a218-aa42-4475-87cc-9db9a452be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:44.917300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a218-aa42-4475-87cc-9db9a452be51 None admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:44.917754 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a218-aa42-4475-87cc-9db9a452be51 None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:44.918250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3a218-aa42-4475-87cc-9db9a452be51 None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:44.919396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3a218-aa42-4475-87cc-9db9a452be51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:44.922049 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3a218-aa42-4475-87cc-9db9a452be51 None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:44.999569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 645/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Sep 1 16:20:44 2022] POST /identity/v3/services => generated 246 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:20:46.984966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d6c73-e55c-42cb-8c89-8e4fb054e5c5 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.985575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d6c73-e55c-42cb-8c89-8e4fb054e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.985575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d6c73-e55c-42cb-8c89-8e4fb054e5c5 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:46.986893 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 651/1296] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:20:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:46.993199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e59a3-4941-42ef-a9d6-20f7bf16ec0b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:46.993649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e59a3-4941-42ef-a9d6-20f7bf16ec0b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:46.993754 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e59a3-4941-42ef-a9d6-20f7bf16ec0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.012057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-190e59a3-4941-42ef-a9d6-20f7bf16ec0b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:47.013254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-190e59a3-4941-42ef-a9d6-20f7bf16ec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:47.094224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 646/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:47.369858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d6c73-e55c-42cb-8c89-8e4fb054e5c5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:47.476491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d6c73-e55c-42cb-8c89-8e4fb054e5c5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:47.512424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9a385-73cc-4c99-843e-d78de03e43f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:47.513048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9a385-73cc-4c99-843e-d78de03e43f6 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.513323 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9a385-73cc-4c99-843e-d78de03e43f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.513586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9a385-73cc-4c99-843e-d78de03e43f6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.514184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9a385-73cc-4c99-843e-d78de03e43f6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:47.515549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9a385-73cc-4c99-843e-d78de03e43f6 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-3af9a385-73cc-4c99-843e-d78de03e43f6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:47.525284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:47.526694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:47.527712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 652/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 16:20:47.532547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e59a3-4941-42ef-a9d6-20f7bf16ec0b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:47.551003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:47.635425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e59a3-4941-42ef-a9d6-20f7bf16ec0b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:47.671396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072efd8-2308-4c6e-8e9a-dcb10eb2feca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:47.672004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072efd8-2308-4c6e-8e9a-dcb10eb2feca None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.672279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072efd8-2308-4c6e-8e9a-dcb10eb2feca None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.672546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072efd8-2308-4c6e-8e9a-dcb10eb2feca None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.673164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072efd8-2308-4c6e-8e9a-dcb10eb2feca None admin] RBAC: Adding query filter params (name=placement) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:47.673461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072efd8-2308-4c6e-8e9a-dcb10eb2feca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:47.674824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072efd8-2308-4c6e-8e9a-dcb10eb2feca None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:47.681044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 647/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Sep 1 16:20:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:47.687193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9a385-73cc-4c99-843e-d78de03e43f6 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:47.720598 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:47.790725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9a385-73cc-4c99-843e-d78de03e43f6 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:47.830005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80fe860-4027-4261-96a6-7a62e679e263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:47.830615 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe860-4027-4261-96a6-7a62e679e263 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.830894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe860-4027-4261-96a6-7a62e679e263 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.831164 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80fe860-4027-4261-96a6-7a62e679e263 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.831854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fe860-4027-4261-96a6-7a62e679e263 None admin] RBAC: Adding query filter params (interface=public, service_id=95248e17e31f4786a0e8eb5e087e7c51, region_id=RegionOne) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:47.832156 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fe860-4027-4261-96a6-7a62e679e263 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:47.833618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80fe860-4027-4261-96a6-7a62e679e263 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:47.838701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 653/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Sep 1 16:20:47 2022] GET /identity/v3/endpoints?service_id=95248e17e31f4786a0e8eb5e087e7c51&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:47.844428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072efd8-2308-4c6e-8e9a-dcb10eb2feca None admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:47.926484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:47.947152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072efd8-2308-4c6e-8e9a-dcb10eb2feca None admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:47.983359 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967644-1a33-4a99-b3be-ddf96fc2032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:47.983963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967644-1a33-4a99-b3be-ddf96fc2032f None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:47.984238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967644-1a33-4a99-b3be-ddf96fc2032f None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:47.984508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967644-1a33-4a99-b3be-ddf96fc2032f None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:47.985104 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967644-1a33-4a99-b3be-ddf96fc2032f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:47.986473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967644-1a33-4a99-b3be-ddf96fc2032f None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:47.994154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 648/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Sep 1 16:20:47 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:20:49.924584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62d74b-5349-46fe-915c-ae0e1a006610 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.962949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62d74b-5349-46fe-915c-ae0e1a006610 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.962949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62d74b-5349-46fe-915c-ae0e1a006610 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.962949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 654/1302] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:20:49.963270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853ec0-4b40-4d5a-8538-c399148144b1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:49.963270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853ec0-4b40-4d5a-8538-c399148144b1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:49.963270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853ec0-4b40-4d5a-8538-c399148144b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:49.963270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-53853ec0-4b40-4d5a-8538-c399148144b1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:20:49.963270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-53853ec0-4b40-4d5a-8538-c399148144b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:20:50.025844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 649/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:20:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 16:20:50.295322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62d74b-5349-46fe-915c-ae0e1a006610 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:50.410275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:50.418831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62d74b-5349-46fe-915c-ae0e1a006610 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:50.454928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d95a9-e1b8-43d4-8172-489205d14026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:50.455569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d95a9-e1b8-43d4-8172-489205d14026 None admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.455846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d95a9-e1b8-43d4-8172-489205d14026 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.456116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d95a9-e1b8-43d4-8172-489205d14026 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.456698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d95a9-e1b8-43d4-8172-489205d14026 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:50.458085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d95a9-e1b8-43d4-8172-489205d14026 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application [None req-fa1d95a9-e1b8-43d4-8172-489205d14026 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 16:20:50.467260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 16:20:50.470146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application with Lock( Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self._enter() Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application return self.creator() Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application created_value = creator( Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: ERROR keystone.server.flask.application Sep 01 16:20:50.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 655/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Sep 1 16:20:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 16:20:50.475029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53853ec0-4b40-4d5a-8538-c399148144b1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:50.557003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:20:50.579614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53853ec0-4b40-4d5a-8538-c399148144b1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:50.616004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36093-bee3-4a80-983d-e2b3959f0c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:50.616627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36093-bee3-4a80-983d-e2b3959f0c5a None admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.616907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36093-bee3-4a80-983d-e2b3959f0c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.617179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36093-bee3-4a80-983d-e2b3959f0c5a None admin] PATH_INFO: `/v3/services` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.617812 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36093-bee3-4a80-983d-e2b3959f0c5a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:20:50.618143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36093-bee3-4a80-983d-e2b3959f0c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:50.619501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36093-bee3-4a80-983d-e2b3959f0c5a None admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:50.625315 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 650/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Sep 1 16:20:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:20:50.631237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d95a9-e1b8-43d4-8172-489205d14026 None admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:20:50.741445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d95a9-e1b8-43d4-8172-489205d14026 None admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:20:50.777553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f3e7b-8bdb-4ab7-b455-1f8c58456cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:20:50.778210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f3e7b-8bdb-4ab7-b455-1f8c58456cc4 None admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:20:50.778491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f3e7b-8bdb-4ab7-b455-1f8c58456cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:20:50.778764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f3e7b-8bdb-4ab7-b455-1f8c58456cc4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:20:50.779466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f3e7b-8bdb-4ab7-b455-1f8c58456cc4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:20:50.780839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f3e7b-8bdb-4ab7-b455-1f8c58456cc4 None admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:20:50.879687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 656/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:20:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:21:00.622412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=30 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:21:00.874649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:59.146493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fae662-b88b-4fe5-981c-37c47fab36d7 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.147682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fae662-b88b-4fe5-981c-37c47fab36d7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.148388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fae662-b88b-4fe5-981c-37c47fab36d7 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.157943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e258-d776-466c-8923-f9aeb79b5b49 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.158975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e258-d776-466c-8923-f9aeb79b5b49 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.159645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613e258-d776-466c-8923-f9aeb79b5b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.162547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 651/1307] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:26:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:59.284159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e613e258-d776-466c-8923-f9aeb79b5b49 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:59.286233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e613e258-d776-466c-8923-f9aeb79b5b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:59.457061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 657/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:59.758119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af453-fc41-4cca-b714-5e1822691c56 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.758421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af453-fc41-4cca-b714-5e1822691c56 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.759571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2af453-fc41-4cca-b714-5e1822691c56 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.761315 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 652/1309] 10.222.0.15 () {54 vars in 965 bytes} [Thu Sep 1 16:26:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:26:59.768146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de3d78-f0c7-43de-badf-bc5d07c08e2d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:26:59.768423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de3d78-f0c7-43de-badf-bc5d07c08e2d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:26:59.770670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de3d78-f0c7-43de-badf-bc5d07c08e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:26:59.863300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-30de3d78-f0c7-43de-badf-bc5d07c08e2d None None] MFA Rules not processed for user `02432d1312a34273813856362cada1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:26:59.864560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-30de3d78-f0c7-43de-badf-bc5d07c08e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:26:59.888979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:26:59.948311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 658/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Thu Sep 1 16:26:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:26:59.957415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2af453-fc41-4cca-b714-5e1822691c56 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:26:59.959270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fd2af453-fc41-4cca-b714-5e1822691c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:00.091512 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2af453-fc41-4cca-b714-5e1822691c56 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:00.182347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba58c82-4284-4b1a-802d-939bd4bd0586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:00.183833 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58c82-4284-4b1a-802d-939bd4bd0586 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:00.184310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58c82-4284-4b1a-802d-939bd4bd0586 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:00.184800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba58c82-4284-4b1a-802d-939bd4bd0586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:00.186938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fba58c82-4284-4b1a-802d-939bd4bd0586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:00.251487 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:00.316133 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba58c82-4284-4b1a-802d-939bd4bd0586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:00.317948 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba58c82-4284-4b1a-802d-939bd4bd0586 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:00.343969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 653/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:26:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:02.643695 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976a0e5-6e40-430b-8c08-da5d896abea2 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:02.644204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976a0e5-6e40-430b-8c08-da5d896abea2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:02.644204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976a0e5-6e40-430b-8c08-da5d896abea2 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:02.645494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 659/1312] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:02.650986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd26c-7733-4e35-adcd-f8442b7ae439 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:02.651450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd26c-7733-4e35-adcd-f8442b7ae439 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:02.651535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cd26c-7733-4e35-adcd-f8442b7ae439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:02.735465 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ed6cd26c-7733-4e35-adcd-f8442b7ae439 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:02.736674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ed6cd26c-7733-4e35-adcd-f8442b7ae439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:02.834065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 654/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:03.162689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b933e98-aaf7-42ed-a589-8f9ab78ba306 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.163009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b933e98-aaf7-42ed-a589-8f9ab78ba306 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.163281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b933e98-aaf7-42ed-a589-8f9ab78ba306 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.164656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 660/1314] 10.222.0.15 () {54 vars in 965 bytes} [Thu Sep 1 16:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:03.170698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1df012-407f-4540-81ac-9a2efce474de None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.170978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1df012-407f-4540-81ac-9a2efce474de None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.171245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1df012-407f-4540-81ac-9a2efce474de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.182958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:03.248877 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4d1df012-407f-4540-81ac-9a2efce474de None None] MFA Rules not processed for user `02432d1312a34273813856362cada1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:03.250124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4d1df012-407f-4540-81ac-9a2efce474de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:03.336504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 655/1315] 10.222.0.15 () {58 vars in 1062 bytes} [Thu Sep 1 16:27:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:03.346002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b933e98-aaf7-42ed-a589-8f9ab78ba306 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:03.347552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1b933e98-aaf7-42ed-a589-8f9ab78ba306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:03.450909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b933e98-aaf7-42ed-a589-8f9ab78ba306 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:03.529499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:03.532115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccfd31-625b-41e1-b807-91f7790d3aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:03.532718 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccfd31-625b-41e1-b807-91f7790d3aeb service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:03.532994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccfd31-625b-41e1-b807-91f7790d3aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:03.533262 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccfd31-625b-41e1-b807-91f7790d3aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:03.534895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-dcccfd31-625b-41e1-b807-91f7790d3aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:03.655228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccfd31-625b-41e1-b807-91f7790d3aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:03.656657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcccfd31-625b-41e1-b807-91f7790d3aeb service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:03.675285 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 661/1316] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:06.374491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63091f4-935f-4fff-8497-4b860c8bad2e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:06.375034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63091f4-935f-4fff-8497-4b860c8bad2e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:06.375034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63091f4-935f-4fff-8497-4b860c8bad2e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:06.376301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 656/1317] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:06.381311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f94d54-8516-4462-933c-1ccd8dafd94f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:06.381704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f94d54-8516-4462-933c-1ccd8dafd94f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:06.381849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f94d54-8516-4462-933c-1ccd8dafd94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:06.448707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-39f94d54-8516-4462-933c-1ccd8dafd94f None None] MFA Rules not processed for user `9611bb4995f64db69f45fd939815f531`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:06.449950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-39f94d54-8516-4462-933c-1ccd8dafd94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:06.502358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:06.549217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 662/1318] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:06.845613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63091f4-935f-4fff-8497-4b860c8bad2e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:06.847198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f63091f4-935f-4fff-8497-4b860c8bad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:06.949687 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63091f4-935f-4fff-8497-4b860c8bad2e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:06.952419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:07.025722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafde8e-b0b9-4fc2-984a-6a7a5db4eb7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:07.026352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafde8e-b0b9-4fc2-984a-6a7a5db4eb7b service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:07.026627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafde8e-b0b9-4fc2-984a-6a7a5db4eb7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:07.026893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafde8e-b0b9-4fc2-984a-6a7a5db4eb7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:07.028474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4cafde8e-b0b9-4fc2-984a-6a7a5db4eb7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:07.136798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafde8e-b0b9-4fc2-984a-6a7a5db4eb7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:07.138282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafde8e-b0b9-4fc2-984a-6a7a5db4eb7b service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:07.156711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 657/1319] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:06 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:10.117305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8272dc-400c-49f0-8dab-9441dcdf00a2 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.117766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8272dc-400c-49f0-8dab-9441dcdf00a2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.117909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8272dc-400c-49f0-8dab-9441dcdf00a2 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:10.119251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 663/1320] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:10.124402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4ff4e-32d7-4cbc-b239-2b28c153bc68 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.124843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4ff4e-32d7-4cbc-b239-2b28c153bc68 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.124950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4ff4e-32d7-4cbc-b239-2b28c153bc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:10.167047 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:10.192087 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-93a4ff4e-32d7-4cbc-b239-2b28c153bc68 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:10.193305 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-93a4ff4e-32d7-4cbc-b239-2b28c153bc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:10.294491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 658/1321] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:10.586991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8272dc-400c-49f0-8dab-9441dcdf00a2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:10.588765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7e8272dc-400c-49f0-8dab-9441dcdf00a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:10.696967 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8272dc-400c-49f0-8dab-9441dcdf00a2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:10.773264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad9e28-a18b-4b2b-8d1f-8535efdd3b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:10.773891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9e28-a18b-4b2b-8d1f-8535efdd3b3b service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:10.774172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9e28-a18b-4b2b-8d1f-8535efdd3b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:10.774435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9e28-a18b-4b2b-8d1f-8535efdd3b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:10.776572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b5ad9e28-a18b-4b2b-8d1f-8535efdd3b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:10.784203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:10.891826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad9e28-a18b-4b2b-8d1f-8535efdd3b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:10.893374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad9e28-a18b-4b2b-8d1f-8535efdd3b3b service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:10.912065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 664/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:14.022513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636904c-a327-4b9b-8dd4-98bd0e19a326 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.023135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636904c-a327-4b9b-8dd4-98bd0e19a326 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.023135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636904c-a327-4b9b-8dd4-98bd0e19a326 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.024472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 659/1323] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:14.029818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85ea27-9abf-4091-9e63-a84f866ae24b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.030309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85ea27-9abf-4091-9e63-a84f866ae24b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.030419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85ea27-9abf-4091-9e63-a84f866ae24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.097275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4e85ea27-9abf-4091-9e63-a84f866ae24b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:14.098523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4e85ea27-9abf-4091-9e63-a84f866ae24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:14.161015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:14.201682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 665/1324] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:14.485931 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636904c-a327-4b9b-8dd4-98bd0e19a326 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:14.487503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b636904c-a327-4b9b-8dd4-98bd0e19a326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:14.598030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636904c-a327-4b9b-8dd4-98bd0e19a326 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:14.610838 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:14.673832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2e6fb-e251-4b15-87ec-e2ebbaf2f32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:14.674463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2e6fb-e251-4b15-87ec-e2ebbaf2f32a service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:14.674735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2e6fb-e251-4b15-87ec-e2ebbaf2f32a service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:14.674997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2e6fb-e251-4b15-87ec-e2ebbaf2f32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:14.676569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-42d2e6fb-e251-4b15-87ec-e2ebbaf2f32a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:14.790092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2e6fb-e251-4b15-87ec-e2ebbaf2f32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:14.792056 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d2e6fb-e251-4b15-87ec-e2ebbaf2f32a service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:14.811958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 660/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:16.824804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e80160-e68c-47bf-b671-4d968111e5db None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.825367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e80160-e68c-47bf-b671-4d968111e5db None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.825367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e80160-e68c-47bf-b671-4d968111e5db None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.826733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 666/1326] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:16.832061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc088-2764-42a4-9284-8e6a66cfc72b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:16.832611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc088-2764-42a4-9284-8e6a66cfc72b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:16.832722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc088-2764-42a4-9284-8e6a66cfc72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:16.881285 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:16.899827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1dcdc088-2764-42a4-9284-8e6a66cfc72b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:16.901534 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1dcdc088-2764-42a4-9284-8e6a66cfc72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:17.000928 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 661/1327] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:27:17.304058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e80160-e68c-47bf-b671-4d968111e5db None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:17.305625 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-83e80160-e68c-47bf-b671-4d968111e5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:17.414397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e80160-e68c-47bf-b671-4d968111e5db None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:17.498972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd2e79-5250-4a33-b71d-c845e58f891e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:17.499682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd2e79-5250-4a33-b71d-c845e58f891e service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:17.499871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd2e79-5250-4a33-b71d-c845e58f891e service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:17.500138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd2e79-5250-4a33-b71d-c845e58f891e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:17.501739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3bbd2e79-5250-4a33-b71d-c845e58f891e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:17.520250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:17.614715 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd2e79-5250-4a33-b71d-c845e58f891e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:17.616191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd2e79-5250-4a33-b71d-c845e58f891e service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:17.635481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 667/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:19.870597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264d926-78f5-448a-8a1f-b7b5f3b5be64 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.871162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264d926-78f5-448a-8a1f-b7b5f3b5be64 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.871309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264d926-78f5-448a-8a1f-b7b5f3b5be64 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.872560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 662/1329] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:27:19.878435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2400006-7b38-4b65-b5b1-8e773deea6c1 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:19.878899 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2400006-7b38-4b65-b5b1-8e773deea6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:19.879066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2400006-7b38-4b65-b5b1-8e773deea6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:19.971938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c2400006-7b38-4b65-b5b1-8e773deea6c1 None None] MFA Rules not processed for user `9611bb4995f64db69f45fd939815f531`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:19.973139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c2400006-7b38-4b65-b5b1-8e773deea6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:20.042035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:20.073464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 668/1330] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:20.358739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264d926-78f5-448a-8a1f-b7b5f3b5be64 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:20.360552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a264d926-78f5-448a-8a1f-b7b5f3b5be64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:20.466990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264d926-78f5-448a-8a1f-b7b5f3b5be64 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:20.486709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:20.543174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc0fec-00df-4323-a2f6-e873825ff67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:20.543784 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc0fec-00df-4323-a2f6-e873825ff67f service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:20.544060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc0fec-00df-4323-a2f6-e873825ff67f service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:20.544380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc0fec-00df-4323-a2f6-e873825ff67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:20.546001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c1dc0fec-00df-4323-a2f6-e873825ff67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:20.655794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc0fec-00df-4323-a2f6-e873825ff67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:20.657207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc0fec-00df-4323-a2f6-e873825ff67f service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:20.675839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 663/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:23.068284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6a34-a861-4441-b3a6-4916353ed8a2 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.068820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6a34-a861-4441-b3a6-4916353ed8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.068820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f6a34-a861-4441-b3a6-4916353ed8a2 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.070133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 669/1332] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:23.076031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701113-855c-48fa-b189-19cd81ebf850 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.076464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701113-855c-48fa-b189-19cd81ebf850 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.076587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8701113-855c-48fa-b189-19cd81ebf850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.142842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:23.145528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a8701113-855c-48fa-b189-19cd81ebf850 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:23.146759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a8701113-855c-48fa-b189-19cd81ebf850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:23.249435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 664/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:23.533054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f6a34-a861-4441-b3a6-4916353ed8a2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:23.534613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5b3f6a34-a861-4441-b3a6-4916353ed8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:23.640177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f6a34-a861-4441-b3a6-4916353ed8a2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:23.713624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e86bde-3fe9-468b-8088-9161454a4225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:23.714255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e86bde-3fe9-468b-8088-9161454a4225 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:23.714534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e86bde-3fe9-468b-8088-9161454a4225 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:23.714801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e86bde-3fe9-468b-8088-9161454a4225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:23.716390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c8e86bde-3fe9-468b-8088-9161454a4225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:23.743632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:23.825801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e86bde-3fe9-468b-8088-9161454a4225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:23.827192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e86bde-3fe9-468b-8088-9161454a4225 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:23.845775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 670/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:25.847639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91d822-57ac-4aa2-83ad-e7c0adb0649a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:25.848181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91d822-57ac-4aa2-83ad-e7c0adb0649a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:25.848181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91d822-57ac-4aa2-83ad-e7c0adb0649a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:25.849548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 665/1335] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:25.854965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af4229-4038-4d93-81dd-560a5be9faba None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:25.855443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af4229-4038-4d93-81dd-560a5be9faba None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:25.855717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af4229-4038-4d93-81dd-560a5be9faba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:25.923405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-82af4229-4038-4d93-81dd-560a5be9faba None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:25.924696 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-82af4229-4038-4d93-81dd-560a5be9faba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:26.003830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:26.027039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 671/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:27:26.310942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91d822-57ac-4aa2-83ad-e7c0adb0649a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:26.312723 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7f91d822-57ac-4aa2-83ad-e7c0adb0649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:26.415356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91d822-57ac-4aa2-83ad-e7c0adb0649a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:26.442961 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:26.489896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a619309-6abc-407b-a8ac-c966a3530a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:26.490510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a619309-6abc-407b-a8ac-c966a3530a05 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:26.490788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a619309-6abc-407b-a8ac-c966a3530a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:26.491062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a619309-6abc-407b-a8ac-c966a3530a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:26.492654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8a619309-6abc-407b-a8ac-c966a3530a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:26.602107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a619309-6abc-407b-a8ac-c966a3530a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:26.604093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a619309-6abc-407b-a8ac-c966a3530a05 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:26.622523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 666/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:27:29.117648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3f8b-4598-4233-9a2e-a557c3a53b3f None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.118229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3f8b-4598-4233-9a2e-a557c3a53b3f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.118229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d3f8b-4598-4233-9a2e-a557c3a53b3f None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.119600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 672/1338] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:29.124709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870368-fefc-4f4c-b0de-94b2a918f2f2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.125161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870368-fefc-4f4c-b0de-94b2a918f2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.125265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870368-fefc-4f4c-b0de-94b2a918f2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.191520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7a870368-fefc-4f4c-b0de-94b2a918f2f2 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:29.192736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7a870368-fefc-4f4c-b0de-94b2a918f2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:29.202004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:29.293075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 667/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:29.579146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d3f8b-4598-4233-9a2e-a557c3a53b3f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:29.580700 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-210d3f8b-4598-4233-9a2e-a557c3a53b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:29.686296 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d3f8b-4598-4233-9a2e-a557c3a53b3f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:29.761539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cecd4-12bb-4d73-b262-95c69b2b7a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:29.762165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cecd4-12bb-4d73-b262-95c69b2b7a49 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:29.762440 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cecd4-12bb-4d73-b262-95c69b2b7a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:29.762709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cecd4-12bb-4d73-b262-95c69b2b7a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:29.764295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b87cecd4-12bb-4d73-b262-95c69b2b7a49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:29.800271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:29.873007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cecd4-12bb-4d73-b262-95c69b2b7a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:29.874463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cecd4-12bb-4d73-b262-95c69b2b7a49 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:29.893303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 673/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:34.205176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ca36d-1772-49c0-9b55-d6cf55a68218 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:34.205742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ca36d-1772-49c0-9b55-d6cf55a68218 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:34.205742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ca36d-1772-49c0-9b55-d6cf55a68218 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:34.207257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 668/1341] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:34.212181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24622d01-92ed-4927-903c-e49d3f224b60 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:34.213162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24622d01-92ed-4927-903c-e49d3f224b60 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:34.213405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24622d01-92ed-4927-903c-e49d3f224b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:34.280967 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-24622d01-92ed-4927-903c-e49d3f224b60 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:34.282207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-24622d01-92ed-4927-903c-e49d3f224b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:34.374078 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:34.389986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 674/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:34.705081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ca36d-1772-49c0-9b55-d6cf55a68218 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:34.708118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0d6ca36d-1772-49c0-9b55-d6cf55a68218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:34.834807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ca36d-1772-49c0-9b55-d6cf55a68218 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:34.875344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:34.927026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6a834-dd27-4a22-a5c5-00863730a9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:34.927637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6a834-dd27-4a22-a5c5-00863730a9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:34.927915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6a834-dd27-4a22-a5c5-00863730a9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:34.928183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6a834-dd27-4a22-a5c5-00863730a9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:34.929779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e7b6a834-dd27-4a22-a5c5-00863730a9b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:35.051112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6a834-dd27-4a22-a5c5-00863730a9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:35.052454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6a834-dd27-4a22-a5c5-00863730a9b0 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:35.071816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 669/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:38.081036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951debd-7ba0-48a9-8f47-2885650d2d6d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:38.081547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951debd-7ba0-48a9-8f47-2885650d2d6d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:38.081547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951debd-7ba0-48a9-8f47-2885650d2d6d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:38.082880 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 675/1344] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:38.088910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97765-6a6f-4c8e-803a-dff56db8a2ff None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:38.089382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97765-6a6f-4c8e-803a-dff56db8a2ff None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:38.089635 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea97765-6a6f-4c8e-803a-dff56db8a2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:38.160897 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2ea97765-6a6f-4c8e-803a-dff56db8a2ff None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:38.162162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2ea97765-6a6f-4c8e-803a-dff56db8a2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:38.185909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:38.266421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 670/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:38.547783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951debd-7ba0-48a9-8f47-2885650d2d6d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:38.549388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3951debd-7ba0-48a9-8f47-2885650d2d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:38.657839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951debd-7ba0-48a9-8f47-2885650d2d6d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:38.739931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3719c-df93-44c3-94c8-edcbd99ca035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:38.740544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3719c-df93-44c3-94c8-edcbd99ca035 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:38.740825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3719c-df93-44c3-94c8-edcbd99ca035 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:38.741096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3719c-df93-44c3-94c8-edcbd99ca035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:38.742825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-86d3719c-df93-44c3-94c8-edcbd99ca035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:38.793654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:38.862476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3719c-df93-44c3-94c8-edcbd99ca035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:38.864045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3719c-df93-44c3-94c8-edcbd99ca035 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:38.883106 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 676/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:43.299108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298518c9-0cc4-487d-9a03-0feb1d330912 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:43.299688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298518c9-0cc4-487d-9a03-0feb1d330912 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:43.299688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298518c9-0cc4-487d-9a03-0feb1d330912 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:43.301016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 671/1347] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:43.307100 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6e22e-56cb-45a6-ba0d-e7aeb9afee3a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:43.307640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6e22e-56cb-45a6-ba0d-e7aeb9afee3a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:43.307640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6e22e-56cb-45a6-ba0d-e7aeb9afee3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:43.379803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-26a6e22e-56cb-45a6-ba0d-e7aeb9afee3a None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:43.381010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-26a6e22e-56cb-45a6-ba0d-e7aeb9afee3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:43.491940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:43.494548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 677/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:43.781575 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298518c9-0cc4-487d-9a03-0feb1d330912 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:43.783167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-298518c9-0cc4-487d-9a03-0feb1d330912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:43.888538 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298518c9-0cc4-487d-9a03-0feb1d330912 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:43.938053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:43.964723 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3939d-08e6-4c43-afaf-ab9e3c4605f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:43.965335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3939d-08e6-4c43-afaf-ab9e3c4605f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:43.965612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3939d-08e6-4c43-afaf-ab9e3c4605f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:43.965915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3939d-08e6-4c43-afaf-ab9e3c4605f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:43.967554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c6a3939d-08e6-4c43-afaf-ab9e3c4605f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:44.076610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3939d-08e6-4c43-afaf-ab9e3c4605f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:27:44.078072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3939d-08e6-4c43-afaf-ab9e3c4605f8 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:27:44.097379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 672/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:27:49.098670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f06e0-e09d-4d7c-b588-5f6da114101b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:49.099547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f06e0-e09d-4d7c-b588-5f6da114101b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:49.100044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f06e0-e09d-4d7c-b588-5f6da114101b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:49.108750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 678/1350] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 1 16:27:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:49.110514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473979-7941-4109-9358-e559dceebde1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:49.111375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473979-7941-4109-9358-e559dceebde1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:49.111876 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94473979-7941-4109-9358-e559dceebde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:49.237813 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-94473979-7941-4109-9358-e559dceebde1 None None] MFA Rules not processed for user `61d15478ca864f49aae2301e2328fe23`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:49.242127 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-94473979-7941-4109-9358-e559dceebde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:49.269082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:49.380996 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 673/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 1 16:27:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:53.614570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8403-ca55-48c4-9262-69911629c598 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:53.615122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8403-ca55-48c4-9262-69911629c598 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:53.615309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8403-ca55-48c4-9262-69911629c598 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:53.617223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 679/1352] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 1 16:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:53.622884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03229d1-0267-47dd-acc5-b56a2b848d63 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:53.623300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03229d1-0267-47dd-acc5-b56a2b848d63 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:53.623472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03229d1-0267-47dd-acc5-b56a2b848d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:53.711043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a03229d1-0267-47dd-acc5-b56a2b848d63 None None] MFA Rules not processed for user `61d15478ca864f49aae2301e2328fe23`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:53.712263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a03229d1-0267-47dd-acc5-b56a2b848d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:53.789395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:53.833476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 674/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 1 16:27:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:55.227707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a38d-9e59-436d-9f0c-9fd75cc2de52 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.229235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a38d-9e59-436d-9f0c-9fd75cc2de52 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.229509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2a38d-9e59-436d-9f0c-9fd75cc2de52 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.231072 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 680/1354] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 1 16:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:55.237266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1538-74d4-4dbb-8df1-6ae33d28e4ff None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:55.237706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1538-74d4-4dbb-8df1-6ae33d28e4ff None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:55.237841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb1538-74d4-4dbb-8df1-6ae33d28e4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:55.318831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e3eb1538-74d4-4dbb-8df1-6ae33d28e4ff None None] MFA Rules not processed for user `61d15478ca864f49aae2301e2328fe23`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:55.320027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e3eb1538-74d4-4dbb-8df1-6ae33d28e4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:55.429545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 675/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 1 16:27:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:58.879859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fbc35-6b9a-40ca-8400-60b34a62d3d0 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:58.880445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fbc35-6b9a-40ca-8400-60b34a62d3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:58.880445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fbc35-6b9a-40ca-8400-60b34a62d3d0 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:58.881751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 681/1356] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:58.888078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bd411-4d11-48e1-9af0-733530b8bddd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:58.888529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bd411-4d11-48e1-9af0-733530b8bddd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:58.888629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bd411-4d11-48e1-9af0-733530b8bddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:58.942077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:58.975022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0a8bd411-4d11-48e1-9af0-733530b8bddd None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:58.976333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0a8bd411-4d11-48e1-9af0-733530b8bddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:59.109182 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 676/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:27:59.420739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610588f6-adcd-4882-b909-9df3e3faa6d2 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:59.421451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610588f6-adcd-4882-b909-9df3e3faa6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:59.422001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610588f6-adcd-4882-b909-9df3e3faa6d2 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:59.423609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 682/1358] 10.222.0.15 () {54 vars in 962 bytes} [Thu Sep 1 16:27:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:27:59.433676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1ee7-4fa7-40e8-b311-7301d73ffcf0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:59.434019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1ee7-4fa7-40e8-b311-7301d73ffcf0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:59.434427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb1ee7-4fa7-40e8-b311-7301d73ffcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:59.537523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7bcb1ee7-4fa7-40e8-b311-7301d73ffcf0 None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:27:59.538900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7bcb1ee7-4fa7-40e8-b311-7301d73ffcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:59.597288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:59.672677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 677/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Sep 1 16:27:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:27:59.680532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610588f6-adcd-4882-b909-9df3e3faa6d2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:27:59.682154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-610588f6-adcd-4882-b909-9df3e3faa6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:27:59.842322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610588f6-adcd-4882-b909-9df3e3faa6d2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:27:59.920886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:27:59.969566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4904f62-9a5a-48cf-a742-cc89549bf77b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:27:59.970383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4904f62-9a5a-48cf-a742-cc89549bf77b service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:27:59.970753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4904f62-9a5a-48cf-a742-cc89549bf77b service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:27:59.971117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4904f62-9a5a-48cf-a742-cc89549bf77b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:27:59.972814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f4904f62-9a5a-48cf-a742-cc89549bf77b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:00.069977 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4904f62-9a5a-48cf-a742-cc89549bf77b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:00.072406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4904f62-9a5a-48cf-a742-cc89549bf77b service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:00.093835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 683/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:02.303539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a9e44-a8ba-42a3-80d2-01545de60050 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:02.304081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a9e44-a8ba-42a3-80d2-01545de60050 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:02.304081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a9e44-a8ba-42a3-80d2-01545de60050 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:02.305501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 678/1361] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:02.310803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe82a-c912-476c-bb9b-43ba2c282785 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:02.311243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe82a-c912-476c-bb9b-43ba2c282785 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:02.311324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe82a-c912-476c-bb9b-43ba2c282785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:02.394414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-dafbe82a-c912-476c-bb9b-43ba2c282785 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:02.395603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-dafbe82a-c912-476c-bb9b-43ba2c282785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:02.437473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:02.506160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 684/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:28:02.799658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a9e44-a8ba-42a3-80d2-01545de60050 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:02.804014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4f8a9e44-a8ba-42a3-80d2-01545de60050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:02.972824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a9e44-a8ba-42a3-80d2-01545de60050 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:02.983566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:03.101784 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f051-8816-44cc-88ab-98515bdc448d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:03.104319 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f051-8816-44cc-88ab-98515bdc448d service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:03.104767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f051-8816-44cc-88ab-98515bdc448d service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:03.105219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f051-8816-44cc-88ab-98515bdc448d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:03.106924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8cc6f051-8816-44cc-88ab-98515bdc448d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:03.227037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6f051-8816-44cc-88ab-98515bdc448d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:03.228729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6f051-8816-44cc-88ab-98515bdc448d service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:03.248416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 679/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:05.787345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6806e29-2c9d-45f3-a4c3-7f27ea157825 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:05.787915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6806e29-2c9d-45f3-a4c3-7f27ea157825 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:05.787915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6806e29-2c9d-45f3-a4c3-7f27ea157825 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:05.789250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 685/1364] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:05.795779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffc22f-0bb5-4daa-a143-bacacefbc41b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:05.796248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffc22f-0bb5-4daa-a143-bacacefbc41b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:05.796375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bffc22f-0bb5-4daa-a143-bacacefbc41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:05.812801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:05.867738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6bffc22f-0bb5-4daa-a143-bacacefbc41b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:05.870018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6bffc22f-0bb5-4daa-a143-bacacefbc41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:05.982398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 680/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:06.288963 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e0036-cb91-4825-a85b-7739a560d08b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:06.289387 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e0036-cb91-4825-a85b-7739a560d08b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:06.289510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e0036-cb91-4825-a85b-7739a560d08b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:06.292504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 686/1366] 10.222.0.15 () {54 vars in 962 bytes} [Thu Sep 1 16:28:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:06.298729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c06bad-ede7-4a70-ac4b-7ae95026b4b8 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:06.312824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c06bad-ede7-4a70-ac4b-7ae95026b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:06.312824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c06bad-ede7-4a70-ac4b-7ae95026b4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:06.390108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-04c06bad-ede7-4a70-ac4b-7ae95026b4b8 None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:06.391368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-04c06bad-ede7-4a70-ac4b-7ae95026b4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:06.434005 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:06.543936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 681/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Sep 1 16:28:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:06.551863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e0036-cb91-4825-a85b-7739a560d08b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:06.553365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-554e0036-cb91-4825-a85b-7739a560d08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:06.726065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e0036-cb91-4825-a85b-7739a560d08b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:06.750105 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:06.875465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b412aeb-2179-4bb2-8bbf-29e4b2a5cd48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:06.876136 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412aeb-2179-4bb2-8bbf-29e4b2a5cd48 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:06.876405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412aeb-2179-4bb2-8bbf-29e4b2a5cd48 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:06.876755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b412aeb-2179-4bb2-8bbf-29e4b2a5cd48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:06.878541 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0b412aeb-2179-4bb2-8bbf-29e4b2a5cd48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:06.979447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b412aeb-2179-4bb2-8bbf-29e4b2a5cd48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:06.981146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b412aeb-2179-4bb2-8bbf-29e4b2a5cd48 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:07.001169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 687/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:07.405550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ff97-75a7-4bbf-8122-188235010362 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:07.406095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ff97-75a7-4bbf-8122-188235010362 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:07.406209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4ff97-75a7-4bbf-8122-188235010362 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:07.407624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 682/1369] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:07.412809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b36a75-c9c9-43c5-9f88-eac440e5e38c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:07.413099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b36a75-c9c9-43c5-9f88-eac440e5e38c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:07.413374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b36a75-c9c9-43c5-9f88-eac440e5e38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:07.453769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:07.495014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-54b36a75-c9c9-43c5-9f88-eac440e5e38c None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:07.496685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-54b36a75-c9c9-43c5-9f88-eac440e5e38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:07.617758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 688/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:08.221548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a8193-da37-48a1-af0f-715b348defca None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:08.221827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a8193-da37-48a1-af0f-715b348defca None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:08.222127 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a8193-da37-48a1-af0f-715b348defca None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:08.223639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 683/1371] 10.222.0.15 () {54 vars in 964 bytes} [Thu Sep 1 16:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:08.230983 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f03d2-6720-4d2b-94b6-58c53e9e1159 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:08.230983 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f03d2-6720-4d2b-94b6-58c53e9e1159 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:08.230983 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f03d2-6720-4d2b-94b6-58c53e9e1159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:08.328422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ae3f03d2-6720-4d2b-94b6-58c53e9e1159 None None] MFA Rules not processed for user `1947d85a08e944f3a1e7451ee7847b74`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:08.329817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ae3f03d2-6720-4d2b-94b6-58c53e9e1159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:08.390229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:08.425203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 689/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Sep 1 16:28:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:08.432851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a8193-da37-48a1-af0f-715b348defca None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:08.434556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c86a8193-da37-48a1-af0f-715b348defca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:08.562962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a8193-da37-48a1-af0f-715b348defca None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:08.622911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:08.671816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab95fa-c83c-4411-bc2a-b72916e5d1b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:08.672294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab95fa-c83c-4411-bc2a-b72916e5d1b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:08.672573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab95fa-c83c-4411-bc2a-b72916e5d1b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:08.672838 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab95fa-c83c-4411-bc2a-b72916e5d1b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:08.674638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c2ab95fa-c83c-4411-bc2a-b72916e5d1b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:08.827281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab95fa-c83c-4411-bc2a-b72916e5d1b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:08.828718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab95fa-c83c-4411-bc2a-b72916e5d1b5 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:08.855523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 684/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:09.347152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809f39b-f171-4cf3-9936-bf8089f1d543 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:09.347675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809f39b-f171-4cf3-9936-bf8089f1d543 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:09.347675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809f39b-f171-4cf3-9936-bf8089f1d543 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:09.349038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 690/1374] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:09.354891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd95ff5-dea2-457d-ad18-1f94fc94a484 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:09.355352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd95ff5-dea2-457d-ad18-1f94fc94a484 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:09.355630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd95ff5-dea2-457d-ad18-1f94fc94a484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:09.423672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7bd95ff5-dea2-457d-ad18-1f94fc94a484 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:09.424809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7bd95ff5-dea2-457d-ad18-1f94fc94a484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:09.448292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:09.549915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 685/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:09.857127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809f39b-f171-4cf3-9936-bf8089f1d543 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:09.858798 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8809f39b-f171-4cf3-9936-bf8089f1d543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:10.026565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809f39b-f171-4cf3-9936-bf8089f1d543 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:10.091371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:10.157245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283646-882a-41d2-931f-bbf1a1ace140 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:10.157846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283646-882a-41d2-931f-bbf1a1ace140 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:10.158156 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283646-882a-41d2-931f-bbf1a1ace140 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:10.158420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283646-882a-41d2-931f-bbf1a1ace140 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:10.159986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-47283646-882a-41d2-931f-bbf1a1ace140 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:10.266734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283646-882a-41d2-931f-bbf1a1ace140 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:10.268332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47283646-882a-41d2-931f-bbf1a1ace140 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:10.287013 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 691/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:12.397724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b84ea-8b87-4658-b0d9-a0c2b9c74040 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:12.398281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b84ea-8b87-4658-b0d9-a0c2b9c74040 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:12.398281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b84ea-8b87-4658-b0d9-a0c2b9c74040 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:12.399654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 686/1377] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:12.406530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70bb1-d808-408c-8558-916dcfc41a2e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:12.407461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70bb1-d808-408c-8558-916dcfc41a2e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:12.407844 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f70bb1-d808-408c-8558-916dcfc41a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:12.475775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d8f70bb1-d808-408c-8558-916dcfc41a2e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:12.476979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d8f70bb1-d808-408c-8558-916dcfc41a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:12.483837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:12.581066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 692/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:28:12.901550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b84ea-8b87-4658-b0d9-a0c2b9c74040 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:12.903079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-821b84ea-8b87-4658-b0d9-a0c2b9c74040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:13.062477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b84ea-8b87-4658-b0d9-a0c2b9c74040 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:13.066469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:13.199923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1acaa-e022-40bd-a0ff-ab55e8f0fec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:13.200826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1acaa-e022-40bd-a0ff-ab55e8f0fec4 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:13.201267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1acaa-e022-40bd-a0ff-ab55e8f0fec4 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:13.201696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1acaa-e022-40bd-a0ff-ab55e8f0fec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:13.203600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c2b1acaa-e022-40bd-a0ff-ab55e8f0fec4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:13.302478 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1acaa-e022-40bd-a0ff-ab55e8f0fec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:13.304547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1acaa-e022-40bd-a0ff-ab55e8f0fec4 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:13.328797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 687/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:15.450900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242efd0-1a94-4663-855e-d54f17d06522 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:15.451697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242efd0-1a94-4663-855e-d54f17d06522 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:15.451697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242efd0-1a94-4663-855e-d54f17d06522 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:15.452803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 693/1380] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:28:15.458637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163af0f0-2a73-49f4-9b03-fdee6656b06c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:15.459478 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163af0f0-2a73-49f4-9b03-fdee6656b06c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:15.459744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163af0f0-2a73-49f4-9b03-fdee6656b06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:15.472726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:15.545290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-163af0f0-2a73-49f4-9b03-fdee6656b06c None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:15.547166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-163af0f0-2a73-49f4-9b03-fdee6656b06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:15.688293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 688/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:28:15.983109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242efd0-1a94-4663-855e-d54f17d06522 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:15.984969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6242efd0-1a94-4663-855e-d54f17d06522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:16.142930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:16.154938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242efd0-1a94-4663-855e-d54f17d06522 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:16.306687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4edf0-a167-4a3e-8482-61394ef8dc2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:16.307370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4edf0-a167-4a3e-8482-61394ef8dc2d service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:16.307728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4edf0-a167-4a3e-8482-61394ef8dc2d service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:16.307997 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4edf0-a167-4a3e-8482-61394ef8dc2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:16.309646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-01b4edf0-a167-4a3e-8482-61394ef8dc2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:16.422355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4edf0-a167-4a3e-8482-61394ef8dc2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:16.423981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4edf0-a167-4a3e-8482-61394ef8dc2d service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:16.437333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:16.447027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 694/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:18.572245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf2a2d-3f72-4772-bb35-b6dab28ad328 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:18.573056 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf2a2d-3f72-4772-bb35-b6dab28ad328 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:18.573056 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf2a2d-3f72-4772-bb35-b6dab28ad328 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:18.574179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 689/1383] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:18.580726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1207d4-8a18-4291-8c0e-aecd65a24b87 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:18.581356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1207d4-8a18-4291-8c0e-aecd65a24b87 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:18.581356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1207d4-8a18-4291-8c0e-aecd65a24b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:18.661810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ff1207d4-8a18-4291-8c0e-aecd65a24b87 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:18.663054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ff1207d4-8a18-4291-8c0e-aecd65a24b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:18.788840 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 695/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:19.081808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf2a2d-3f72-4772-bb35-b6dab28ad328 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:19.083872 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9abf2a2d-3f72-4772-bb35-b6dab28ad328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:19.193587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:19.260507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf2a2d-3f72-4772-bb35-b6dab28ad328 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:19.423919 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6fdfd-fe24-461a-9377-a04e6b9699ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:19.424996 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6fdfd-fe24-461a-9377-a04e6b9699ac service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:19.425569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6fdfd-fe24-461a-9377-a04e6b9699ac service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:19.426098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6fdfd-fe24-461a-9377-a04e6b9699ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:19.429435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b0d6fdfd-fe24-461a-9377-a04e6b9699ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:19.497040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:19.541953 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6fdfd-fe24-461a-9377-a04e6b9699ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:19.543550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6fdfd-fe24-461a-9377-a04e6b9699ac service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:19.564931 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 690/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:21.813119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92327975-cb72-4b28-a815-f86366f53499 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:21.813669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92327975-cb72-4b28-a815-f86366f53499 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:21.813761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92327975-cb72-4b28-a815-f86366f53499 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:21.815134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 696/1386] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:21.820794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec1399-78e6-4ee8-9dbe-de7715c0c33f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:21.821730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec1399-78e6-4ee8-9dbe-de7715c0c33f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:21.822166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec1399-78e6-4ee8-9dbe-de7715c0c33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:21.909451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-afec1399-78e6-4ee8-9dbe-de7715c0c33f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:21.910718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-afec1399-78e6-4ee8-9dbe-de7715c0c33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:22.017970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 691/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:22.349250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92327975-cb72-4b28-a815-f86366f53499 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:22.350805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-92327975-cb72-4b28-a815-f86366f53499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:22.451663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:22.542332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92327975-cb72-4b28-a815-f86366f53499 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:22.672173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734c14c4-bd87-4432-aebb-6f718409d945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:22.672946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c14c4-bd87-4432-aebb-6f718409d945 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:22.673226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c14c4-bd87-4432-aebb-6f718409d945 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:22.673496 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734c14c4-bd87-4432-aebb-6f718409d945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:22.675144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-734c14c4-bd87-4432-aebb-6f718409d945 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:22.716461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:22.772847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c14c4-bd87-4432-aebb-6f718409d945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:22.774565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734c14c4-bd87-4432-aebb-6f718409d945 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:22.792788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 697/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:24.870559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62036077-d208-469e-b7eb-a19126159cf4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:24.871115 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62036077-d208-469e-b7eb-a19126159cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:24.871115 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62036077-d208-469e-b7eb-a19126159cf4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:24.872430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 692/1389] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:24.877632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca0fe-54f5-4543-aede-fe5f4add7830 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:24.878081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca0fe-54f5-4543-aede-fe5f4add7830 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:24.878207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca0fe-54f5-4543-aede-fe5f4add7830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:24.940633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d3c81-ae5a-42e1-a825-7396193acb1d None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:24.940935 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d3c81-ae5a-42e1-a825-7396193acb1d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:24.941201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d3c81-ae5a-42e1-a825-7396193acb1d None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:24.942602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 693/1390] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:24.948410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a49e7-855b-483e-b043-775ff0d9fef7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:24.948691 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a49e7-855b-483e-b043-775ff0d9fef7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:24.949138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a49e7-855b-483e-b043-775ff0d9fef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:24.949705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-51eca0fe-54f5-4543-aede-fe5f4add7830 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:24.950949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-51eca0fe-54f5-4543-aede-fe5f4add7830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:24.985743 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:25.020614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-dd0a49e7-855b-483e-b043-775ff0d9fef7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:25.023516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dd0a49e7-855b-483e-b043-775ff0d9fef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:25.057638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 698/1391] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:25.134007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 694/1392] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:28:25.360765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cc553-3f39-4380-8c4f-e894ea53d7c4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:25.361050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cc553-3f39-4380-8c4f-e894ea53d7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:25.361327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cc553-3f39-4380-8c4f-e894ea53d7c4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:25.362716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 699/1393] 10.222.0.15 () {54 vars in 967 bytes} [Thu Sep 1 16:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:25.368044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a6bf-23ca-47fc-a76a-31d56ec71906 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:25.369141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a6bf-23ca-47fc-a76a-31d56ec71906 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:25.369420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a6bf-23ca-47fc-a76a-31d56ec71906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:25.425484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cc553-3f39-4380-8c4f-e894ea53d7c4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:25.427094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0e5cc553-3f39-4380-8c4f-e894ea53d7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:25.441864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:25.450703 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7265a6bf-23ca-47fc-a76a-31d56ec71906 None None] MFA Rules not processed for user `18a16e6246fb4693b044bf939bce8244`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:25.451922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7265a6bf-23ca-47fc-a76a-31d56ec71906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:25.510444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:25.539125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 695/1394] 10.222.0.15 () {58 vars in 1064 bytes} [Thu Sep 1 16:28:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:25.547357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a6bf-23ca-47fc-a76a-31d56ec71906 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:25.554800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a6bf-23ca-47fc-a76a-31d56ec71906 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:25.581640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cc553-3f39-4380-8c4f-e894ea53d7c4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:25.632878 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640f2cf-62ea-4d59-96c5-acef7eb1670b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a16e6246fb4693b044bf939bce8244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:25.633413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f2cf-62ea-4d59-96c5-acef7eb1670b service glance] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:25.634286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f2cf-62ea-4d59-96c5-acef7eb1670b service glance] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:25.634560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f2cf-62ea-4d59-96c5-acef7eb1670b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:25.636356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c640f2cf-62ea-4d59-96c5-acef7eb1670b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:25.671402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:25.699791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a09e2-857f-4f9d-948e-d72b32f632a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:25.700401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a09e2-857f-4f9d-948e-d72b32f632a7 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:25.700674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a09e2-857f-4f9d-948e-d72b32f632a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:25.700945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a09e2-857f-4f9d-948e-d72b32f632a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:25.702673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d81a09e2-857f-4f9d-948e-d72b32f632a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:25.749547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640f2cf-62ea-4d59-96c5-acef7eb1670b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:25.751013 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640f2cf-62ea-4d59-96c5-acef7eb1670b service glance] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:25.766227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:25.771655 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 696/1395] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:28:25.802324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a09e2-857f-4f9d-948e-d72b32f632a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:25.804026 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a09e2-857f-4f9d-948e-d72b32f632a7 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:25.825998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 700/1396] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:28:26.699293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6652a7-6cf9-4ab6-9c37-66119a621440 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:26.699804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6652a7-6cf9-4ab6-9c37-66119a621440 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:26.699898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6652a7-6cf9-4ab6-9c37-66119a621440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:26.778510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3b6652a7-6cf9-4ab6-9c37-66119a621440 None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:26.779750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3b6652a7-6cf9-4ab6-9c37-66119a621440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:26.886427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 697/1397] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:28:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:26.923767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576be1f-11b0-44b4-b6e3-ebca21cb59e8 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:26.924850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576be1f-11b0-44b4-b6e3-ebca21cb59e8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:26.924850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576be1f-11b0-44b4-b6e3-ebca21cb59e8 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:26.927093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 701/1398] 10.222.0.15 () {54 vars in 943 bytes} [Thu Sep 1 16:28:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:26.935381 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04eaa-3c7f-45e2-b8ce-44fb820f8404 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:26.935797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04eaa-3c7f-45e2-b8ce-44fb820f8404 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:26.936220 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04eaa-3c7f-45e2-b8ce-44fb820f8404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:27.022773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3cb04eaa-3c7f-45e2-b8ce-44fb820f8404 None None] MFA Rules not processed for user `589e62c8d27044eea16e7c1f803e1393`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:27.024005 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3cb04eaa-3c7f-45e2-b8ce-44fb820f8404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:27.055728 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:27.150884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 698/1399] 10.222.0.15 () {58 vars in 1040 bytes} [Thu Sep 1 16:28:26 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:27.160883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576be1f-11b0-44b4-b6e3-ebca21cb59e8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:27.162616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7576be1f-11b0-44b4-b6e3-ebca21cb59e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:27.280413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:27.330265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576be1f-11b0-44b4-b6e3-ebca21cb59e8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:27.449326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26885662-fa77-43d0-9778-a5d683458a33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:27.449975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885662-fa77-43d0-9778-a5d683458a33 service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:27.450251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885662-fa77-43d0-9778-a5d683458a33 service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:27.450518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26885662-fa77-43d0-9778-a5d683458a33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:27.452153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-26885662-fa77-43d0-9778-a5d683458a33 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:27.560222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26885662-fa77-43d0-9778-a5d683458a33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:27.562191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26885662-fa77-43d0-9778-a5d683458a33 service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:27.565661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:27.571467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 702/1400] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:28:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:28:28.017871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871627-5676-4d2d-bc02-d55e20762c41 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:28.018475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871627-5676-4d2d-bc02-d55e20762c41 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:28.018475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4871627-5676-4d2d-bc02-d55e20762c41 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:28.023822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 699/1401] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:28.025786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a988cf-064d-489f-9a5e-9bf7bd23087a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:28.026306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a988cf-064d-489f-9a5e-9bf7bd23087a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:28.026493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a988cf-064d-489f-9a5e-9bf7bd23087a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:28.106122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f8a988cf-064d-489f-9a5e-9bf7bd23087a None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:28.107367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f8a988cf-064d-489f-9a5e-9bf7bd23087a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:28.239120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 703/1402] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:28.552624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4871627-5676-4d2d-bc02-d55e20762c41 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:28.553293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b4871627-5676-4d2d-bc02-d55e20762c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:28.770637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4871627-5676-4d2d-bc02-d55e20762c41 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:28.773607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:28.919701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6722f0-e6b1-4b60-8a94-f38f8d22c2ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:28.920326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6722f0-e6b1-4b60-8a94-f38f8d22c2ea service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:28.920600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6722f0-e6b1-4b60-8a94-f38f8d22c2ea service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:28.923020 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6722f0-e6b1-4b60-8a94-f38f8d22c2ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:28.923020 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bc6722f0-e6b1-4b60-8a94-f38f8d22c2ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:29.059383 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6722f0-e6b1-4b60-8a94-f38f8d22c2ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:29.061588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6722f0-e6b1-4b60-8a94-f38f8d22c2ea service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:29.094554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 700/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:28:31.857750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a8437-9893-4168-8826-2e0a741f29e4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:31.858876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a8437-9893-4168-8826-2e0a741f29e4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:31.859237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a8437-9893-4168-8826-2e0a741f29e4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:31.860866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 704/1404] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:31.866622 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a4c24-28e5-4037-898a-8a86e49b677e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:31.867183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a4c24-28e5-4037-898a-8a86e49b677e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:31.867183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a4c24-28e5-4037-898a-8a86e49b677e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:31.882217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:31.954564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4f5a4c24-28e5-4037-898a-8a86e49b677e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:31.955795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4f5a4c24-28e5-4037-898a-8a86e49b677e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:32.087289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 701/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:32.394347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a8437-9893-4168-8826-2e0a741f29e4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:32.396307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-532a8437-9893-4168-8826-2e0a741f29e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:32.532655 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:32.668038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a8437-9893-4168-8826-2e0a741f29e4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:32.854639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03592426-d1b7-4dec-87b4-32fcb692b916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:32.855558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592426-d1b7-4dec-87b4-32fcb692b916 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:32.855973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592426-d1b7-4dec-87b4-32fcb692b916 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:32.856429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03592426-d1b7-4dec-87b4-32fcb692b916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:32.859089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-03592426-d1b7-4dec-87b4-32fcb692b916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:32.928562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:33.017831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03592426-d1b7-4dec-87b4-32fcb692b916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:33.020722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03592426-d1b7-4dec-87b4-32fcb692b916 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:33.049685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 705/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:35.696069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b7b5-3acd-48d7-8e75-e502b88237a5 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:35.696985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b7b5-3acd-48d7-8e75-e502b88237a5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:35.697299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b7b5-3acd-48d7-8e75-e502b88237a5 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:35.698761 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 702/1407] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:35.705120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bab31-d982-430c-b969-d5796f5d9478 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:35.705917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bab31-d982-430c-b969-d5796f5d9478 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:35.705917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bab31-d982-430c-b969-d5796f5d9478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:35.824872 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c76bab31-d982-430c-b969-d5796f5d9478 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:35.826803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c76bab31-d982-430c-b969-d5796f5d9478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:36.034015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 706/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:28:36.560167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24b7b5-3acd-48d7-8e75-e502b88237a5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:36.563008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6c24b7b5-3acd-48d7-8e75-e502b88237a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:36.730484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:36.826557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24b7b5-3acd-48d7-8e75-e502b88237a5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:37.006762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525403b-443c-43bf-801e-f4cba5226d52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:37.007438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525403b-443c-43bf-801e-f4cba5226d52 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:37.007724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525403b-443c-43bf-801e-f4cba5226d52 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:37.008029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525403b-443c-43bf-801e-f4cba5226d52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:37.009753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1525403b-443c-43bf-801e-f4cba5226d52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:37.120092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:37.202808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525403b-443c-43bf-801e-f4cba5226d52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:37.204581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525403b-443c-43bf-801e-f4cba5226d52 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:37.235141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 703/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:46.030152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=93 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:47.232657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=24 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:54.337720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a702f-568e-46fd-b7ba-c5590207023e None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:54.338331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a702f-568e-46fd-b7ba-c5590207023e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:54.338331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a702f-568e-46fd-b7ba-c5590207023e None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:54.339637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 707/1410] 10.222.0.15 () {54 vars in 918 bytes} [Thu Sep 1 16:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:54.345181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ad3eb-1a06-4669-bb6c-0b9887426c25 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:54.345649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ad3eb-1a06-4669-bb6c-0b9887426c25 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:54.345779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ad3eb-1a06-4669-bb6c-0b9887426c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:54.428053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9d2ad3eb-1a06-4669-bb6c-0b9887426c25 None None] MFA Rules not processed for user `61d15478ca864f49aae2301e2328fe23`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:54.429249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9d2ad3eb-1a06-4669-bb6c-0b9887426c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:54.539195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 704/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Sep 1 16:28:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:54.554606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d9c39-9d01-4191-968f-6f3bf306bfdf None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:54.554890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d9c39-9d01-4191-968f-6f3bf306bfdf None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:54.555691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d9c39-9d01-4191-968f-6f3bf306bfdf None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:54.557056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 708/1412] 10.222.0.15 () {54 vars in 918 bytes} [Thu Sep 1 16:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:54.561656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcdaf9-470d-46a7-b619-662bc89d0df7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:54.561973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcdaf9-470d-46a7-b619-662bc89d0df7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:54.562250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcdaf9-470d-46a7-b619-662bc89d0df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:54.636521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:54.639536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-76dcdaf9-470d-46a7-b619-662bc89d0df7 None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:54.640752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-76dcdaf9-470d-46a7-b619-662bc89d0df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:54.759416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 705/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Sep 1 16:28:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:57.180347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047944b-7592-46ed-a94c-44b8e42330de None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:57.181032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047944b-7592-46ed-a94c-44b8e42330de None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:57.181032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047944b-7592-46ed-a94c-44b8e42330de None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:57.182446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:57.187731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397cbb-2959-4835-8557-d2c9c6085204 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:57.188150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397cbb-2959-4835-8557-d2c9c6085204 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:57.188280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5397cbb-2959-4835-8557-d2c9c6085204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:57.254828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e5397cbb-2959-4835-8557-d2c9c6085204 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:57.256029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e5397cbb-2959-4835-8557-d2c9c6085204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:57.312213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:57.354927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:57.642810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047944b-7592-46ed-a94c-44b8e42330de None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:57.644328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5047944b-7592-46ed-a94c-44b8e42330de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:57.793012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047944b-7592-46ed-a94c-44b8e42330de None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:57.867429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:57.907730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79667fc1-1f48-4a88-a95e-0238e2a1e973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:57.908390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667fc1-1f48-4a88-a95e-0238e2a1e973 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:57.908669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667fc1-1f48-4a88-a95e-0238e2a1e973 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:57.909135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79667fc1-1f48-4a88-a95e-0238e2a1e973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:57.911280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-79667fc1-1f48-4a88-a95e-0238e2a1e973 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:58.003831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79667fc1-1f48-4a88-a95e-0238e2a1e973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:58.005437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79667fc1-1f48-4a88-a95e-0238e2a1e973 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:58.024350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 710/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:28:58.918781 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f39a2-e249-4dc9-9b3a-36b9f693df4a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:58.919344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f39a2-e249-4dc9-9b3a-36b9f693df4a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:58.919344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f39a2-e249-4dc9-9b3a-36b9f693df4a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:58.920668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:28:58.925502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585043b6-9226-4ad5-a346-90d32a487b16 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:58.925953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585043b6-9226-4ad5-a346-90d32a487b16 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:58.926091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585043b6-9226-4ad5-a346-90d32a487b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:59.004543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-585043b6-9226-4ad5-a346-90d32a487b16 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:28:59.005751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-585043b6-9226-4ad5-a346-90d32a487b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:59.033639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:59.105553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:28:59.254643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f39a2-e249-4dc9-9b3a-36b9f693df4a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:28:59.256182 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f36f39a2-e249-4dc9-9b3a-36b9f693df4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:59.416510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f39a2-e249-4dc9-9b3a-36b9f693df4a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:28:59.460462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:59.534646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538361f-f8e9-4ee5-9592-e87057cc2492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:28:59.535259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538361f-f8e9-4ee5-9592-e87057cc2492 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:28:59.535538 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538361f-f8e9-4ee5-9592-e87057cc2492 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:28:59.535805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538361f-f8e9-4ee5-9592-e87057cc2492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:28:59.537398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6538361f-f8e9-4ee5-9592-e87057cc2492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:28:59.648491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538361f-f8e9-4ee5-9592-e87057cc2492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:28:59.651102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538361f-f8e9-4ee5-9592-e87057cc2492 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:28:59.670097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 708/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:28:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:00.577780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9aaaf-1471-40bc-ba7f-9445e9726ea6 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:00.578399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9aaaf-1471-40bc-ba7f-9445e9726ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:00.578495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9aaaf-1471-40bc-ba7f-9445e9726ea6 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:00.579772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:00.584631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f577b-74fd-4934-82ac-41e9dca708a6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:00.585101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f577b-74fd-4934-82ac-41e9dca708a6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:00.585205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f577b-74fd-4934-82ac-41e9dca708a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:00.644355 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:00.666984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-051f577b-74fd-4934-82ac-41e9dca708a6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:00.668261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-051f577b-74fd-4934-82ac-41e9dca708a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:00.766025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:00.918213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9aaaf-1471-40bc-ba7f-9445e9726ea6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:00.919714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9ee9aaaf-1471-40bc-ba7f-9445e9726ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:01.075560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9aaaf-1471-40bc-ba7f-9445e9726ea6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:01.088637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:01.192411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bae013-3998-4c16-b0c1-4779e32118a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:01.192944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bae013-3998-4c16-b0c1-4779e32118a7 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:01.193220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bae013-3998-4c16-b0c1-4779e32118a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:01.193489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bae013-3998-4c16-b0c1-4779e32118a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:01.195116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c2bae013-3998-4c16-b0c1-4779e32118a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:01.285739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bae013-3998-4c16-b0c1-4779e32118a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:01.287374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bae013-3998-4c16-b0c1-4779e32118a7 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:01.306198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 713/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:02.188428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fc0d5-4c02-4c3f-a32e-40a57185ce8c None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:02.188994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fc0d5-4c02-4c3f-a32e-40a57185ce8c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:02.188994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fc0d5-4c02-4c3f-a32e-40a57185ce8c None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:02.190373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:02.195265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26518045-5481-4797-bc66-f9799c673a04 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:02.196208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26518045-5481-4797-bc66-f9799c673a04 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:02.196460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26518045-5481-4797-bc66-f9799c673a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:02.217051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:02.275393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-26518045-5481-4797-bc66-f9799c673a04 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:02.276597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-26518045-5481-4797-bc66-f9799c673a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:02.379093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:02.528694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fc0d5-4c02-4c3f-a32e-40a57185ce8c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:02.530472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b48fc0d5-4c02-4c3f-a32e-40a57185ce8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:02.642046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:02.678429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fc0d5-4c02-4c3f-a32e-40a57185ce8c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:02.798656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11655541-74b7-4756-a900-a38ce85028f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:02.799270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11655541-74b7-4756-a900-a38ce85028f7 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:02.799545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11655541-74b7-4756-a900-a38ce85028f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:02.799812 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11655541-74b7-4756-a900-a38ce85028f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:02.801396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-11655541-74b7-4756-a900-a38ce85028f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:02.890431 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:02.906834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11655541-74b7-4756-a900-a38ce85028f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:02.906834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11655541-74b7-4756-a900-a38ce85028f7 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:02.924570 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 711/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:03.816926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230818-3e28-4d03-a637-7c284b13b83b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:03.817510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230818-3e28-4d03-a637-7c284b13b83b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:03.817510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1230818-3e28-4d03-a637-7c284b13b83b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:03.818861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:03.824894 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beef86e-fe80-48b5-ad1c-0558b9f47500 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:03.825361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beef86e-fe80-48b5-ad1c-0558b9f47500 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:03.825462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beef86e-fe80-48b5-ad1c-0558b9f47500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:03.906787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-2beef86e-fe80-48b5-ad1c-0558b9f47500 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:03.908014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2beef86e-fe80-48b5-ad1c-0558b9f47500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:04.006421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:04.157248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1230818-3e28-4d03-a637-7c284b13b83b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:04.158851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c1230818-3e28-4d03-a637-7c284b13b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:04.243344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:04.305443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1230818-3e28-4d03-a637-7c284b13b83b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:04.433232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b51374-3289-47e5-8287-3652e090cfb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:04.433840 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51374-3289-47e5-8287-3652e090cfb8 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:04.434142 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51374-3289-47e5-8287-3652e090cfb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:04.434402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b51374-3289-47e5-8287-3652e090cfb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:04.435976 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-78b51374-3289-47e5-8287-3652e090cfb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:04.485889 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:04.528155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b51374-3289-47e5-8287-3652e090cfb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:04.529758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b51374-3289-47e5-8287-3652e090cfb8 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:04.548255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 716/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:05.438792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607146cd-4340-4b09-a4e1-1958df39e048 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:05.439345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607146cd-4340-4b09-a4e1-1958df39e048 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:05.439345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607146cd-4340-4b09-a4e1-1958df39e048 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:05.440750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:05.446309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc4b6-7c5d-427c-9a90-2ed349863705 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:05.446961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc4b6-7c5d-427c-9a90-2ed349863705 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:05.446961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc4b6-7c5d-427c-9a90-2ed349863705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:05.524232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-290bc4b6-7c5d-427c-9a90-2ed349863705 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:05.525411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-290bc4b6-7c5d-427c-9a90-2ed349863705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:05.622137 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:29:05.778108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607146cd-4340-4b09-a4e1-1958df39e048 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:05.779666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-607146cd-4340-4b09-a4e1-1958df39e048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:05.829944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:05.931550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607146cd-4340-4b09-a4e1-1958df39e048 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:06.046177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35193f65-7f70-4114-b233-accbb16d9303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:06.046706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35193f65-7f70-4114-b233-accbb16d9303 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:06.046984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35193f65-7f70-4114-b233-accbb16d9303 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:06.047250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35193f65-7f70-4114-b233-accbb16d9303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:06.048845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-35193f65-7f70-4114-b233-accbb16d9303 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:06.056282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:06.140580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35193f65-7f70-4114-b233-accbb16d9303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:06.142198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35193f65-7f70-4114-b233-accbb16d9303 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:06.160476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 714/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:07.065851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528758-fea2-472d-9a6c-a67371503c5c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:07.066399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528758-fea2-472d-9a6c-a67371503c5c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:07.066399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04528758-fea2-472d-9a6c-a67371503c5c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:07.067718 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:07.072802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a6f6-d7a6-4cad-973d-2096972baf48 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:07.073239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a6f6-d7a6-4cad-973d-2096972baf48 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:07.073357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a6f6-d7a6-4cad-973d-2096972baf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:07.152363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-aa86a6f6-d7a6-4cad-973d-2096972baf48 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:07.153573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-aa86a6f6-d7a6-4cad-973d-2096972baf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:07.222909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:07.252521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:07.421773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04528758-fea2-472d-9a6c-a67371503c5c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:07.423364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-04528758-fea2-472d-9a6c-a67371503c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:07.441988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:07.573763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04528758-fea2-472d-9a6c-a67371503c5c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:07.662276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:07.689175 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba672b49-a014-4ca6-acfe-8a34c99b53d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:07.689707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba672b49-a014-4ca6-acfe-8a34c99b53d6 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:07.690021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba672b49-a014-4ca6-acfe-8a34c99b53d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:07.690292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba672b49-a014-4ca6-acfe-8a34c99b53d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:07.691890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ba672b49-a014-4ca6-acfe-8a34c99b53d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:07.792900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba672b49-a014-4ca6-acfe-8a34c99b53d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:07.794551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba672b49-a014-4ca6-acfe-8a34c99b53d6 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:07.812359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 719/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:08.741243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034832c-f4f6-4419-8ab6-7d588ee61125 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:08.741910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034832c-f4f6-4419-8ab6-7d588ee61125 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:08.741910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034832c-f4f6-4419-8ab6-7d588ee61125 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:08.743192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:08.748227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf53016-c908-4eee-b744-fe975e32a102 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:08.748635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf53016-c908-4eee-b744-fe975e32a102 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:08.748780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf53016-c908-4eee-b744-fe975e32a102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:08.829336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4cf53016-c908-4eee-b744-fe975e32a102 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:08.830576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4cf53016-c908-4eee-b744-fe975e32a102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:08.874572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:08.932326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:09.093635 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034832c-f4f6-4419-8ab6-7d588ee61125 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:09.095152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4034832c-f4f6-4419-8ab6-7d588ee61125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:09.245791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034832c-f4f6-4419-8ab6-7d588ee61125 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:09.301048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:09.362088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83153b5b-1e72-48c6-a70c-a9c5d63b3fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:09.362627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83153b5b-1e72-48c6-a70c-a9c5d63b3fde service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:09.362906 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83153b5b-1e72-48c6-a70c-a9c5d63b3fde service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:09.363174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83153b5b-1e72-48c6-a70c-a9c5d63b3fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:09.364777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-83153b5b-1e72-48c6-a70c-a9c5d63b3fde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:09.455995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83153b5b-1e72-48c6-a70c-a9c5d63b3fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:09.457594 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83153b5b-1e72-48c6-a70c-a9c5d63b3fde service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:09.475444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 717/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:10.367213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6a982-eb6d-4ef9-993d-47b087a7cf8f None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:10.367806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6a982-eb6d-4ef9-993d-47b087a7cf8f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:10.367806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d6a982-eb6d-4ef9-993d-47b087a7cf8f None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:10.369224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:10.374593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1434d3-7196-490b-87d4-fa61eed075be None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:10.375040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1434d3-7196-490b-87d4-fa61eed075be None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:10.375152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1434d3-7196-490b-87d4-fa61eed075be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:10.452639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7b1434d3-7196-490b-87d4-fa61eed075be None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:10.453914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7b1434d3-7196-490b-87d4-fa61eed075be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:10.456240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:10.557715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:10.708978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6a982-eb6d-4ef9-993d-47b087a7cf8f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:10.710519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a4d6a982-eb6d-4ef9-993d-47b087a7cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:10.856413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d6a982-eb6d-4ef9-993d-47b087a7cf8f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:10.884108 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:10.976328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281e90f-18db-4a14-82ed-ab5fe98df431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:10.977351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281e90f-18db-4a14-82ed-ab5fe98df431 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:10.977628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281e90f-18db-4a14-82ed-ab5fe98df431 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:10.977938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281e90f-18db-4a14-82ed-ab5fe98df431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:10.979535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b281e90f-18db-4a14-82ed-ab5fe98df431 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:11.081226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281e90f-18db-4a14-82ed-ab5fe98df431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:11.082920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281e90f-18db-4a14-82ed-ab5fe98df431 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:11.105153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 722/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:12.974573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efceb0-7d14-4653-be65-6b480451cecf None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:12.975165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efceb0-7d14-4653-be65-6b480451cecf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:12.975165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efceb0-7d14-4653-be65-6b480451cecf None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:12.976459 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:12.982833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a8864-9cd4-44da-99dc-fd27442d7bba None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:12.983383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a8864-9cd4-44da-99dc-fd27442d7bba None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:12.983383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a8864-9cd4-44da-99dc-fd27442d7bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:13.028574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:13.058249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-238a8864-9cd4-44da-99dc-fd27442d7bba None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:13.059410 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-238a8864-9cd4-44da-99dc-fd27442d7bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:13.197511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:13.481700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efceb0-7d14-4653-be65-6b480451cecf None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:13.483280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c1efceb0-7d14-4653-be65-6b480451cecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:13.590698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efceb0-7d14-4653-be65-6b480451cecf None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:13.625331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:13.672169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e614d6-cac4-4ad8-bea1-65a7ffbf8e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:13.672783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e614d6-cac4-4ad8-bea1-65a7ffbf8e4b service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:13.673059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e614d6-cac4-4ad8-bea1-65a7ffbf8e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:13.673328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e614d6-cac4-4ad8-bea1-65a7ffbf8e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:13.674956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b2e614d6-cac4-4ad8-bea1-65a7ffbf8e4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:13.793118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e614d6-cac4-4ad8-bea1-65a7ffbf8e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:13.795552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e614d6-cac4-4ad8-bea1-65a7ffbf8e4b service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:13.815490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 720/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:15.905512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c23671-e039-42e4-a371-120979963b0d None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:15.906135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c23671-e039-42e4-a371-120979963b0d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:15.906135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c23671-e039-42e4-a371-120979963b0d None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:15.907509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:15.912772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94fee-8d95-407d-b6fc-56b126d1720f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:15.913169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94fee-8d95-407d-b6fc-56b126d1720f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:15.913422 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d94fee-8d95-407d-b6fc-56b126d1720f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:15.981211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-15d94fee-8d95-407d-b6fc-56b126d1720f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:15.982436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-15d94fee-8d95-407d-b6fc-56b126d1720f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:15.996113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:16.084905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:16.376898 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c23671-e039-42e4-a371-120979963b0d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:16.378491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b5c23671-e039-42e4-a371-120979963b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:16.487907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c23671-e039-42e4-a371-120979963b0d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:16.501330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:16.566148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c55cc7-db38-4eed-b255-1dbc545e2475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:16.566758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c55cc7-db38-4eed-b255-1dbc545e2475 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:16.567036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c55cc7-db38-4eed-b255-1dbc545e2475 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:16.567305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c55cc7-db38-4eed-b255-1dbc545e2475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:16.568909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f7c55cc7-db38-4eed-b255-1dbc545e2475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:16.679410 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c55cc7-db38-4eed-b255-1dbc545e2475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:16.681527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c55cc7-db38-4eed-b255-1dbc545e2475 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:16.699430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 725/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:19.085057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77759d38-99a4-4ece-a2c1-96fd1728b149 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:19.085610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77759d38-99a4-4ece-a2c1-96fd1728b149 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:19.085610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77759d38-99a4-4ece-a2c1-96fd1728b149 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:19.086967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:29:19.092653 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5357ce-338b-4342-87df-e9dbc5e3d426 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:19.093144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5357ce-338b-4342-87df-e9dbc5e3d426 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:19.093239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5357ce-338b-4342-87df-e9dbc5e3d426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:19.145715 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:19.165930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0a5357ce-338b-4342-87df-e9dbc5e3d426 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:19.167159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0a5357ce-338b-4342-87df-e9dbc5e3d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:19.282637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:19.570929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77759d38-99a4-4ece-a2c1-96fd1728b149 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:19.572476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-77759d38-99a4-4ece-a2c1-96fd1728b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:19.684879 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77759d38-99a4-4ece-a2c1-96fd1728b149 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:19.727531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:19.763942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1a051-b6c3-44d2-ba88-1e029f72763d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:19.764552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a051-b6c3-44d2-ba88-1e029f72763d service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:19.764832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a051-b6c3-44d2-ba88-1e029f72763d service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:19.765165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1a051-b6c3-44d2-ba88-1e029f72763d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:19.767579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c7a1a051-b6c3-44d2-ba88-1e029f72763d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:20.014377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1a051-b6c3-44d2-ba88-1e029f72763d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:20.015809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1a051-b6c3-44d2-ba88-1e029f72763d service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:20.035376 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 723/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:22.235361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2546f24-baee-4629-ac5e-71c3fa0aaf96 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:22.235938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2546f24-baee-4629-ac5e-71c3fa0aaf96 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:22.235938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2546f24-baee-4629-ac5e-71c3fa0aaf96 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:22.237352 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:22.244051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585445-59f4-464c-bd05-b125f6ff4ae1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:22.244560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585445-59f4-464c-bd05-b125f6ff4ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:22.244560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585445-59f4-464c-bd05-b125f6ff4ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:22.318940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-26585445-59f4-464c-bd05-b125f6ff4ae1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:22.320166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-26585445-59f4-464c-bd05-b125f6ff4ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:22.342877 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:22.428121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:22.728298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2546f24-baee-4629-ac5e-71c3fa0aaf96 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:22.729836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c2546f24-baee-4629-ac5e-71c3fa0aaf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:22.840356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2546f24-baee-4629-ac5e-71c3fa0aaf96 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:22.861677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:22.918864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33f518-a356-448a-91f4-f115caa64957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:22.919477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f518-a356-448a-91f4-f115caa64957 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:22.919754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f518-a356-448a-91f4-f115caa64957 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:22.920027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f518-a356-448a-91f4-f115caa64957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:22.921632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1f33f518-a356-448a-91f4-f115caa64957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:23.038303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33f518-a356-448a-91f4-f115caa64957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:23.040856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33f518-a356-448a-91f4-f115caa64957 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:23.061773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 728/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:29:25.153638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050d8a-914a-489a-b0b2-87a0d56b1a02 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:25.154279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050d8a-914a-489a-b0b2-87a0d56b1a02 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:25.154279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050d8a-914a-489a-b0b2-87a0d56b1a02 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:25.155545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:25.160779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52315a-5404-415f-8d27-7f414d9a5783 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:25.161266 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52315a-5404-415f-8d27-7f414d9a5783 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:25.161383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52315a-5404-415f-8d27-7f414d9a5783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:25.232161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:25.235167 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8a52315a-5404-415f-8d27-7f414d9a5783 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:25.236407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8a52315a-5404-415f-8d27-7f414d9a5783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:25.353427 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:25.647853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec050d8a-914a-489a-b0b2-87a0d56b1a02 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:25.653203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ec050d8a-914a-489a-b0b2-87a0d56b1a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:25.762578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec050d8a-914a-489a-b0b2-87a0d56b1a02 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:25.817168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:25.843753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f930f-2527-4b96-b38b-b37555e943ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:25.844300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f930f-2527-4b96-b38b-b37555e943ed service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:25.844583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f930f-2527-4b96-b38b-b37555e943ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:25.845054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f930f-2527-4b96-b38b-b37555e943ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:25.846852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-006f930f-2527-4b96-b38b-b37555e943ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:25.971765 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f930f-2527-4b96-b38b-b37555e943ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:25.973205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f930f-2527-4b96-b38b-b37555e943ed service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:25.994871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 726/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:28.039646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0056e0d-b246-4320-8310-193b295f217b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:28.040229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0056e0d-b246-4320-8310-193b295f217b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:28.040229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0056e0d-b246-4320-8310-193b295f217b None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:28.045091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:28.047238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141accd-b450-47b7-88c2-c9feea5a8b32 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:28.047928 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141accd-b450-47b7-88c2-c9feea5a8b32 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:28.048218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141accd-b450-47b7-88c2-c9feea5a8b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:28.121610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a141accd-b450-47b7-88c2-c9feea5a8b32 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:28.122873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a141accd-b450-47b7-88c2-c9feea5a8b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:28.159470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:28.230028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:28.515981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0056e0d-b246-4320-8310-193b295f217b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:28.517518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f0056e0d-b246-4320-8310-193b295f217b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:28.633164 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0056e0d-b246-4320-8310-193b295f217b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:28.663832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:28.710787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febfafb-dc1a-42dd-b5c7-33a3a7bc7f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:28.711627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febfafb-dc1a-42dd-b5c7-33a3a7bc7f8e service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:28.712004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febfafb-dc1a-42dd-b5c7-33a3a7bc7f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:28.712276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febfafb-dc1a-42dd-b5c7-33a3a7bc7f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:28.713922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6febfafb-dc1a-42dd-b5c7-33a3a7bc7f8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:28.829389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febfafb-dc1a-42dd-b5c7-33a3a7bc7f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:28.830949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febfafb-dc1a-42dd-b5c7-33a3a7bc7f8e service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:28.850347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 731/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:30.857491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55379c9-1b99-4a58-ab14-a6142582f4f5 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:30.858064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55379c9-1b99-4a58-ab14-a6142582f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:30.858064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55379c9-1b99-4a58-ab14-a6142582f4f5 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:30.859418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:30.865578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413c007-1d28-45d4-983d-fdd0f08aee5c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:30.866370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413c007-1d28-45d4-983d-fdd0f08aee5c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:30.866589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413c007-1d28-45d4-983d-fdd0f08aee5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:30.941249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9413c007-1d28-45d4-983d-fdd0f08aee5c None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:30.942584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9413c007-1d28-45d4-983d-fdd0f08aee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:30.951733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:31.064645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:31.366664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55379c9-1b99-4a58-ab14-a6142582f4f5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:31.369139 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e55379c9-1b99-4a58-ab14-a6142582f4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:31.476224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55379c9-1b99-4a58-ab14-a6142582f4f5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:31.534279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:31.553287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409f80e-c482-4d35-8a6e-2786869ef10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:31.554731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409f80e-c482-4d35-8a6e-2786869ef10c service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:31.554731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409f80e-c482-4d35-8a6e-2786869ef10c service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:31.554731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409f80e-c482-4d35-8a6e-2786869ef10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:31.556234 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5409f80e-c482-4d35-8a6e-2786869ef10c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:31.668991 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409f80e-c482-4d35-8a6e-2786869ef10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:31.670465 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409f80e-c482-4d35-8a6e-2786869ef10c service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:31.689360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 729/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:33.716016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943eb18-a2a5-4bab-b710-ebd0f939a268 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:33.716603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943eb18-a2a5-4bab-b710-ebd0f939a268 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:33.716790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943eb18-a2a5-4bab-b710-ebd0f939a268 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:33.718898 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:33.724789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4091-df4b-4b85-81b3-b7e633f07d81 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:33.725299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4091-df4b-4b85-81b3-b7e633f07d81 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:33.725299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a4091-df4b-4b85-81b3-b7e633f07d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:33.798172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d20a4091-df4b-4b85-81b3-b7e633f07d81 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:33.799396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d20a4091-df4b-4b85-81b3-b7e633f07d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:33.840968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:33.901861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:34.191014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943eb18-a2a5-4bab-b710-ebd0f939a268 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:34.192569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8943eb18-a2a5-4bab-b710-ebd0f939a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:34.312741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943eb18-a2a5-4bab-b710-ebd0f939a268 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:34.357788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:34.393329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d66bb2-b438-41d1-b588-6804b63082f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:34.393987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66bb2-b438-41d1-b588-6804b63082f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:34.394264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66bb2-b438-41d1-b588-6804b63082f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:34.394528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d66bb2-b438-41d1-b588-6804b63082f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:34.396126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-78d66bb2-b438-41d1-b588-6804b63082f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:34.512718 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d66bb2-b438-41d1-b588-6804b63082f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:34.514189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d66bb2-b438-41d1-b588-6804b63082f7 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:34.532550 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 734/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:36.603042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe024-c21e-42f0-9921-5f7080329df8 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:36.607417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe024-c21e-42f0-9921-5f7080329df8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:36.607417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cbe024-c21e-42f0-9921-5f7080329df8 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:36.607417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:36.610343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d4c3-1f32-4c53-a107-0f4ddde9e2e9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:36.610756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d4c3-1f32-4c53-a107-0f4ddde9e2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:36.610899 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19d4c3-1f32-4c53-a107-0f4ddde9e2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:36.684695 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0f19d4c3-1f32-4c53-a107-0f4ddde9e2e9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:36.685947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0f19d4c3-1f32-4c53-a107-0f4ddde9e2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:36.704271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:36.783814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:37.070389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbe024-c21e-42f0-9921-5f7080329df8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:37.072050 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-19cbe024-c21e-42f0-9921-5f7080329df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:37.191995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cbe024-c21e-42f0-9921-5f7080329df8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:37.263601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:37.274069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ade20-e554-4849-a168-e44909a605aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:37.275117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ade20-e554-4849-a168-e44909a605aa service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:37.275598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ade20-e554-4849-a168-e44909a605aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:37.276070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ade20-e554-4849-a168-e44909a605aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:37.279122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-352ade20-e554-4849-a168-e44909a605aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:37.410655 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ade20-e554-4849-a168-e44909a605aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:37.412082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ade20-e554-4849-a168-e44909a605aa service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:37.431733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 732/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:39.485025 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e52ff4-ab99-43e8-90d3-1cda4e4e5f82 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:39.485595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e52ff4-ab99-43e8-90d3-1cda4e4e5f82 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:39.485595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e52ff4-ab99-43e8-90d3-1cda4e4e5f82 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:39.486952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:29:39.494063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c510-424a-4c70-9e85-4aa3a6ecf458 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:39.494629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c510-424a-4c70-9e85-4aa3a6ecf458 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:39.494629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c510-424a-4c70-9e85-4aa3a6ecf458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:39.572836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4ed1c510-424a-4c70-9e85-4aa3a6ecf458 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:29:39.574093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4ed1c510-424a-4c70-9e85-4aa3a6ecf458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:39.629259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:39.680223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:29:39.970149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e52ff4-ab99-43e8-90d3-1cda4e4e5f82 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:29:39.971808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c8e52ff4-ab99-43e8-90d3-1cda4e4e5f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:40.081748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e52ff4-ab99-43e8-90d3-1cda4e4e5f82 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:29:40.132217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:40.162322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a235485-905c-44f7-a693-834702e1c3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:29:40.162942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a235485-905c-44f7-a693-834702e1c3bc service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:29:40.163223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a235485-905c-44f7-a693-834702e1c3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:29:40.163497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a235485-905c-44f7-a693-834702e1c3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:29:40.165945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6a235485-905c-44f7-a693-834702e1c3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:29:40.299706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a235485-905c-44f7-a693-834702e1c3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:29:40.301075 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a235485-905c-44f7-a693-834702e1c3bc service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:29:40.322308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 737/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:29:49.783879 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=22 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:29:50.319572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=66 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:00.367922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3127f-f52f-43c1-bb1b-b5207959af81 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:00.368452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3127f-f52f-43c1-bb1b-b5207959af81 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:00.368452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3127f-f52f-43c1-bb1b-b5207959af81 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:00.369713 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 734/1471] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:00.374992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0932ec-f2cb-4274-8fc4-44c2687c5bcc None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:00.375415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0932ec-f2cb-4274-8fc4-44c2687c5bcc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:00.375566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0932ec-f2cb-4274-8fc4-44c2687c5bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:00.444019 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7c0932ec-f2cb-4274-8fc4-44c2687c5bcc None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:00.446033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7c0932ec-f2cb-4274-8fc4-44c2687c5bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:00.547050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 738/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:00.851167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ec424-6e00-4d85-b1b4-f7e681a58a80 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:00.852518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ec424-6e00-4d85-b1b4-f7e681a58a80 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:00.852518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ec424-6e00-4d85-b1b4-f7e681a58a80 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:00.853128 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 735/1473] 10.222.0.15 () {54 vars in 967 bytes} [Thu Sep 1 16:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:00.858555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b47d6-4625-43fa-b459-124855d64283 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:00.858835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b47d6-4625-43fa-b459-124855d64283 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:00.859100 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b47d6-4625-43fa-b459-124855d64283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:00.957600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a87b47d6-4625-43fa-b459-124855d64283 None None] MFA Rules not processed for user `18a16e6246fb4693b044bf939bce8244`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:00.958841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a87b47d6-4625-43fa-b459-124855d64283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:00.984362 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:01.043052 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 739/1474] 10.222.0.15 () {58 vars in 1064 bytes} [Thu Sep 1 16:30:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:01.050559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ec424-6e00-4d85-b1b4-f7e681a58a80 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:01.052250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-391ec424-6e00-4d85-b1b4-f7e681a58a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:01.161458 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ec424-6e00-4d85-b1b4-f7e681a58a80 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:01.235895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c92a1f-a119-496b-8a8c-23fdbca64ea4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a16e6246fb4693b044bf939bce8244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:01.236509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c92a1f-a119-496b-8a8c-23fdbca64ea4 service glance] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:01.236788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c92a1f-a119-496b-8a8c-23fdbca64ea4 service glance] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:01.237059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c92a1f-a119-496b-8a8c-23fdbca64ea4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:01.238709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-31c92a1f-a119-496b-8a8c-23fdbca64ea4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:01.297345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:01.354545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c92a1f-a119-496b-8a8c-23fdbca64ea4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:01.356147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c92a1f-a119-496b-8a8c-23fdbca64ea4 service glance] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:01.374956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 736/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:03.405333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2d9ea-0bb8-48d9-a281-ef0e5026f3a9 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:03.405898 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2d9ea-0bb8-48d9-a281-ef0e5026f3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:03.405898 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2d9ea-0bb8-48d9-a281-ef0e5026f3a9 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:03.407275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 740/1476] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:30:03.412590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14b537-2f63-4e1c-afad-88fca300593a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:03.413003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14b537-2f63-4e1c-afad-88fca300593a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:03.413165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14b537-2f63-4e1c-afad-88fca300593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:03.479716 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-af14b537-2f63-4e1c-afad-88fca300593a None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:03.480913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-af14b537-2f63-4e1c-afad-88fca300593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:03.579610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 737/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:03.860034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2d9ea-0bb8-48d9-a281-ef0e5026f3a9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:03.861491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-00b2d9ea-0bb8-48d9-a281-ef0e5026f3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:03.989109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b2d9ea-0bb8-48d9-a281-ef0e5026f3a9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:04.041495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:04.087154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f572dd-f0b9-4548-8c31-3cf9525c7217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:04.087761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f572dd-f0b9-4548-8c31-3cf9525c7217 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:04.088044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f572dd-f0b9-4548-8c31-3cf9525c7217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:04.088313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f572dd-f0b9-4548-8c31-3cf9525c7217 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:04.088947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f572dd-f0b9-4548-8c31-3cf9525c7217 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:04.091011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-a1f572dd-f0b9-4548-8c31-3cf9525c7217 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:30:04.091011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: warnings.warn(msg) Sep 01 16:30:04.091011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: Sep 01 16:30:04.096851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f572dd-f0b9-4548-8c31-3cf9525c7217 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:04.113527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 741/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Sep 1 16:30:03 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:30:06.051950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeff7b4-bf58-48fc-ab86-462565eabe7f None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:06.052522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeff7b4-bf58-48fc-ab86-462565eabe7f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:06.052522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeff7b4-bf58-48fc-ab86-462565eabe7f None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:06.053902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 738/1479] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:06.059819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8491c50-4b9f-481f-9f38-c40f93fc78c4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:06.060261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8491c50-4b9f-481f-9f38-c40f93fc78c4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:06.060364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8491c50-4b9f-481f-9f38-c40f93fc78c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:06.127882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a8491c50-4b9f-481f-9f38-c40f93fc78c4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:06.129114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a8491c50-4b9f-481f-9f38-c40f93fc78c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:06.227356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 742/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:06.531054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeff7b4-bf58-48fc-ab86-462565eabe7f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:06.532551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0aeff7b4-bf58-48fc-ab86-462565eabe7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:06.545491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:06.683753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeff7b4-bf58-48fc-ab86-462565eabe7f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:06.764506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:06.797465 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38be84-d25d-448f-af77-bfbc3b6efec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:06.798026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38be84-d25d-448f-af77-bfbc3b6efec9 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:06.798314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38be84-d25d-448f-af77-bfbc3b6efec9 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:06.798683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38be84-d25d-448f-af77-bfbc3b6efec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:06.800907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2a38be84-d25d-448f-af77-bfbc3b6efec9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:06.892127 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38be84-d25d-448f-af77-bfbc3b6efec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:06.893718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38be84-d25d-448f-af77-bfbc3b6efec9 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:06.911991 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 739/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:09.030591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5061a-118e-4969-b15a-b3b634601c35 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:09.031163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5061a-118e-4969-b15a-b3b634601c35 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:09.031163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5061a-118e-4969-b15a-b3b634601c35 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:09.032518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 743/1482] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:09.037790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ae211-4ef5-4d20-9adb-06b36f1c25af None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:09.038230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ae211-4ef5-4d20-9adb-06b36f1c25af None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:09.038946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ae211-4ef5-4d20-9adb-06b36f1c25af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:09.112310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4b3ae211-4ef5-4d20-9adb-06b36f1c25af None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:09.113518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4b3ae211-4ef5-4d20-9adb-06b36f1c25af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:09.161328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:09.211017 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 740/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:09.508895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5061a-118e-4969-b15a-b3b634601c35 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:09.510535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2cd5061a-118e-4969-b15a-b3b634601c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:09.534379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:09.618231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5061a-118e-4969-b15a-b3b634601c35 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:09.699317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d821f6-9167-4aee-93ed-c20fac764011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:09.700195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d821f6-9167-4aee-93ed-c20fac764011 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:09.700604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d821f6-9167-4aee-93ed-c20fac764011 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:09.700998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d821f6-9167-4aee-93ed-c20fac764011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:09.703546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-78d821f6-9167-4aee-93ed-c20fac764011 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:09.794356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:09.828662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d821f6-9167-4aee-93ed-c20fac764011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:09.830446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d821f6-9167-4aee-93ed-c20fac764011 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:09.972095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 744/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:30:11.985076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106cb7-76b8-4714-abca-2eaa80ecd48a None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:11.985625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106cb7-76b8-4714-abca-2eaa80ecd48a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:11.985625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106cb7-76b8-4714-abca-2eaa80ecd48a None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:11.987028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 741/1485] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:11.992972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4256f-c3f6-4f9d-8fa4-59f10dfd2caf None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:11.993441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4256f-c3f6-4f9d-8fa4-59f10dfd2caf None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:11.993706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4256f-c3f6-4f9d-8fa4-59f10dfd2caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:12.074041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c7f4256f-c3f6-4f9d-8fa4-59f10dfd2caf None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:12.075295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c7f4256f-c3f6-4f9d-8fa4-59f10dfd2caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:12.180180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 745/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:12.478311 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd106cb7-76b8-4714-abca-2eaa80ecd48a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:12.479959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bd106cb7-76b8-4714-abca-2eaa80ecd48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:12.589334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd106cb7-76b8-4714-abca-2eaa80ecd48a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:12.668271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:12.670098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00620e55-2950-45fd-9812-9cf683c8928d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:12.670707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00620e55-2950-45fd-9812-9cf683c8928d service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:12.670987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00620e55-2950-45fd-9812-9cf683c8928d service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:12.671258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00620e55-2950-45fd-9812-9cf683c8928d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:12.672847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-00620e55-2950-45fd-9812-9cf683c8928d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:12.782764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00620e55-2950-45fd-9812-9cf683c8928d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:12.784098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00620e55-2950-45fd-9812-9cf683c8928d service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:12.802609 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 742/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:14.863156 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c822-ba27-4231-87aa-0b21d013f980 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:14.863678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c822-ba27-4231-87aa-0b21d013f980 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:14.863678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c822-ba27-4231-87aa-0b21d013f980 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:14.865069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 746/1488] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:14.871288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27cc3-b4ec-455f-94de-a9122d47f241 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:14.871768 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27cc3-b4ec-455f-94de-a9122d47f241 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:14.871881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a27cc3-b4ec-455f-94de-a9122d47f241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:14.940191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-31a27cc3-b4ec-455f-94de-a9122d47f241 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:14.941419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-31a27cc3-b4ec-455f-94de-a9122d47f241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:14.996121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:15.042048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 743/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:30:15.335938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c822-ba27-4231-87aa-0b21d013f980 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:15.337458 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ea49c822-ba27-4231-87aa-0b21d013f980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:15.373828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:15.442665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c822-ba27-4231-87aa-0b21d013f980 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:15.516430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3185bd4-038f-4c28-b029-5ee53eb50bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:15.517030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185bd4-038f-4c28-b029-5ee53eb50bdd service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:15.517300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185bd4-038f-4c28-b029-5ee53eb50bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:15.517563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3185bd4-038f-4c28-b029-5ee53eb50bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:15.519156 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e3185bd4-038f-4c28-b029-5ee53eb50bdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:15.598991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:15.631078 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3185bd4-038f-4c28-b029-5ee53eb50bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:15.632458 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3185bd4-038f-4c28-b029-5ee53eb50bdd service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:15.650315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 747/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:18.067412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dab3a6-57b6-4155-927b-38230b73ccd4 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:18.068007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dab3a6-57b6-4155-927b-38230b73ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:18.068007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dab3a6-57b6-4155-927b-38230b73ccd4 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:18.069340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 744/1491] 10.222.0.15 () {54 vars in 927 bytes} [Thu Sep 1 16:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:30:18.074968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2544a7-f666-4ee9-8466-55c5b1ef9540 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:18.075407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2544a7-f666-4ee9-8466-55c5b1ef9540 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:18.075527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2544a7-f666-4ee9-8466-55c5b1ef9540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:18.142929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9e2544a7-f666-4ee9-8466-55c5b1ef9540 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:30:18.144150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9e2544a7-f666-4ee9-8466-55c5b1ef9540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:18.242026 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 748/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Thu Sep 1 16:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:30:18.533943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dab3a6-57b6-4155-927b-38230b73ccd4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:30:18.535517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a1dab3a6-57b6-4155-927b-38230b73ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:18.643870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dab3a6-57b6-4155-927b-38230b73ccd4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:30:18.719653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d4eb1-a7bc-4726-910e-569d65cb508d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:30:18.720243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d4eb1-a7bc-4726-910e-569d65cb508d service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:30:18.720517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d4eb1-a7bc-4726-910e-569d65cb508d service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:30:18.720783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d4eb1-a7bc-4726-910e-569d65cb508d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:30:18.722494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-428d4eb1-a7bc-4726-910e-569d65cb508d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:30:18.731870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:18.832563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d4eb1-a7bc-4726-910e-569d65cb508d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:30:18.834318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d4eb1-a7bc-4726-910e-569d65cb508d service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:30:18.853968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 745/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:30:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:30:28.239591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=82 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:28.850653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=50 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:45.045394 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c554e-ac43-422d-826d-8e6302914250 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:45.046036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c554e-ac43-422d-826d-8e6302914250 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:45.046036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c554e-ac43-422d-826d-8e6302914250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:45.130151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4e0c554e-ac43-422d-826d-8e6302914250 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:31:45.131855 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4e0c554e-ac43-422d-826d-8e6302914250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:45.231473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 749/1494] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:31:45.246583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418056fd-92eb-4a33-bda9-49a5bf13bbe1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:45.247175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418056fd-92eb-4a33-bda9-49a5bf13bbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:45.247288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418056fd-92eb-4a33-bda9-49a5bf13bbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:45.352776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-418056fd-92eb-4a33-bda9-49a5bf13bbe1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:31:45.354047 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-418056fd-92eb-4a33-bda9-49a5bf13bbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:45.459637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 746/1495] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:31:45.464448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c554e-ac43-422d-826d-8e6302914250 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:31:45.465668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4e0c554e-ac43-422d-826d-8e6302914250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:45.478008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c554e-ac43-422d-826d-8e6302914250 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:31:45.541783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:45.581770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961e45b-bc11-4a0d-a154-242ff34ea55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:31:45.582419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961e45b-bc11-4a0d-a154-242ff34ea55d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:45.582698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961e45b-bc11-4a0d-a154-242ff34ea55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:45.582966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961e45b-bc11-4a0d-a154-242ff34ea55d admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:45.583605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961e45b-bc11-4a0d-a154-242ff34ea55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:31:45.584181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961e45b-bc11-4a0d-a154-242ff34ea55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:31:45.585207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-8961e45b-bc11-4a0d-a154-242ff34ea55d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:31:45.585207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: warnings.warn(msg) Sep 01 16:31:45.585207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: Sep 01 16:31:45.586181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8961e45b-bc11-4a0d-a154-242ff34ea55d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:31:45.598343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 750/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:31:45.607702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418056fd-92eb-4a33-bda9-49a5bf13bbe1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:31:45.617615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418056fd-92eb-4a33-bda9-49a5bf13bbe1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:31:45.682436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:45.733081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e5391-216e-45f9-967a-70eacba5ebc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:31:45.733686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5391-216e-45f9-967a-70eacba5ebc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:45.733992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5391-216e-45f9-967a-70eacba5ebc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:45.734263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e5391-216e-45f9-967a-70eacba5ebc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:45.734955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e5391-216e-45f9-967a-70eacba5ebc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:31:45.736683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-1d4e5391-216e-45f9-967a-70eacba5ebc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:31:45.736683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: warnings.warn(msg) Sep 01 16:31:45.736683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: Sep 01 16:31:45.737898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e5391-216e-45f9-967a-70eacba5ebc0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:31:45.955751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 747/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:31:45 2022] POST /identity/v3/projects => generated 379 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:31:45.960396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961e45b-bc11-4a0d-a154-242ff34ea55d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:31:45.961966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8961e45b-bc11-4a0d-a154-242ff34ea55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:46.002041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961e45b-bc11-4a0d-a154-242ff34ea55d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:31:46.109819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064fe01-1b2c-4cbe-812e-27b8dde1c5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:31:46.110549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064fe01-1b2c-4cbe-812e-27b8dde1c5ab admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:46.110828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064fe01-1b2c-4cbe-812e-27b8dde1c5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:46.111094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064fe01-1b2c-4cbe-812e-27b8dde1c5ab admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:46.111713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064fe01-1b2c-4cbe-812e-27b8dde1c5ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:31:46.112720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-0064fe01-1b2c-4cbe-812e-27b8dde1c5ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:31:46.112720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: warnings.warn(msg) Sep 01 16:31:46.112720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: Sep 01 16:31:46.113946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064fe01-1b2c-4cbe-812e-27b8dde1c5ab admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:31:46.224387 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 751/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:31:45 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:31:46.229061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e5391-216e-45f9-967a-70eacba5ebc0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:31:46.230696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1d4e5391-216e-45f9-967a-70eacba5ebc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:46.295281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e5391-216e-45f9-967a-70eacba5ebc0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:31:46.394205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:46.405674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623db7fd-d7be-40cb-a979-f8b3673d87ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:31:46.408471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db7fd-d7be-40cb-a979-f8b3673d87ad admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:46.408471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db7fd-d7be-40cb-a979-f8b3673d87ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:46.408471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623db7fd-d7be-40cb-a979-f8b3673d87ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:46.408471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623db7fd-d7be-40cb-a979-f8b3673d87ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:31:46.408879 dv-cinder-836027-9-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-623db7fd-d7be-40cb-a979-f8b3673d87ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:31:46.408879 dv-cinder-836027-9-smb devstack@keystone.service[81784]: warnings.warn(msg) Sep 01 16:31:46.408879 dv-cinder-836027-9-smb devstack@keystone.service[81784]: Sep 01 16:31:46.409400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623db7fd-d7be-40cb-a979-f8b3673d87ad admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:31:46.422810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 748/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:31:46.427556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064fe01-1b2c-4cbe-812e-27b8dde1c5ab admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:31:46.429776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0064fe01-1b2c-4cbe-812e-27b8dde1c5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:46.441251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064fe01-1b2c-4cbe-812e-27b8dde1c5ab admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:31:46.468747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:46.545230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f76b0-24a3-4932-a6ac-54d88c941f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:31:46.545790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f76b0-24a3-4932-a6ac-54d88c941f5f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:46.546242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f76b0-24a3-4932-a6ac-54d88c941f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:46.546514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f76b0-24a3-4932-a6ac-54d88c941f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:46.547183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f76b0-24a3-4932-a6ac-54d88c941f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:31:46.548231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-550f76b0-24a3-4932-a6ac-54d88c941f5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:31:46.548231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: warnings.warn(msg) Sep 01 16:31:46.548231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: Sep 01 16:31:46.549192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f76b0-24a3-4932-a6ac-54d88c941f5f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:31:46.563241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 752/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:31:46.569997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623db7fd-d7be-40cb-a979-f8b3673d87ad admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:31:46.571563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-623db7fd-d7be-40cb-a979-f8b3673d87ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:46.606695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623db7fd-d7be-40cb-a979-f8b3673d87ad admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:31:46.716258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d62097-4475-4ced-bda0-39266468c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:31:46.716925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62097-4475-4ced-bda0-39266468c521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:46.717212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62097-4475-4ced-bda0-39266468c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:46.717479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62097-4475-4ced-bda0-39266468c521 admin admin] PATH_INFO: `/v3/projects/fd7632b35cc74483aab35f72a5e244f7/users/c65882a72c5a45edb19d7d940476cda5/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:46.746918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d62097-4475-4ced-bda0-39266468c521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7632b35cc74483aab35f72a5e244f7, user_id=c65882a72c5a45edb19d7d940476cda5, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:31:46.747940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-f8d62097-4475-4ced-bda0-39266468c521 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:31:46.747940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: warnings.warn(msg) Sep 01 16:31:46.747940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: Sep 01 16:31:46.758354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d62097-4475-4ced-bda0-39266468c521 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:31:46.869007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 749/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:31:46 2022] PUT /identity/v3/projects/fd7632b35cc74483aab35f72a5e244f7/users/c65882a72c5a45edb19d7d940476cda5/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:31:46.882522 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a0845-5597-4008-9289-25d69d5958bc None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:46.882817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a0845-5597-4008-9289-25d69d5958bc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:46.883338 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a0845-5597-4008-9289-25d69d5958bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:46.952219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-965a0845-5597-4008-9289-25d69d5958bc None None] MFA Rules not processed for user `c65882a72c5a45edb19d7d940476cda5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:31:46.953484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-965a0845-5597-4008-9289-25d69d5958bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:47.040831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 753/1502] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:31:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:31:47.055739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cdd57-2e08-443e-97bd-c6def4d33e2e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:47.056064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cdd57-2e08-443e-97bd-c6def4d33e2e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:47.056374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cdd57-2e08-443e-97bd-c6def4d33e2e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:47.057789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 750/1503] 10.222.0.15 () {54 vars in 964 bytes} [Thu Sep 1 16:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:31:47.062959 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55ebe9-089d-455b-b678-041632d0dfb7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:47.063241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55ebe9-089d-455b-b678-041632d0dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:47.063511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55ebe9-089d-455b-b678-041632d0dfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:47.102892 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:47.156680 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2d55ebe9-089d-455b-b678-041632d0dfb7 None None] MFA Rules not processed for user `1947d85a08e944f3a1e7451ee7847b74`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:31:47.157959 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2d55ebe9-089d-455b-b678-041632d0dfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:47.245945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 754/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Sep 1 16:31:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:31:47.256271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cdd57-2e08-443e-97bd-c6def4d33e2e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:31:47.258469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-080cdd57-2e08-443e-97bd-c6def4d33e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:47.314568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:47.371962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cdd57-2e08-443e-97bd-c6def4d33e2e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:31:47.454124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba4018-e1b7-4483-af53-0346bebc763e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:31:47.454661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba4018-e1b7-4483-af53-0346bebc763e service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:47.454938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba4018-e1b7-4483-af53-0346bebc763e service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:47.455208 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba4018-e1b7-4483-af53-0346bebc763e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:47.456870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-80ba4018-e1b7-4483-af53-0346bebc763e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:47.572246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba4018-e1b7-4483-af53-0346bebc763e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:31:47.573685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba4018-e1b7-4483-af53-0346bebc763e service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:31:47.577482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:47.593320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 751/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:31:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:31:47.643708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6300b78-109a-4d97-b7f2-76d058458b4c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:47.644040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6300b78-109a-4d97-b7f2-76d058458b4c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:47.644354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6300b78-109a-4d97-b7f2-76d058458b4c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:47.645690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 755/1506] 10.222.0.15 () {52 vars in 830 bytes} [Thu Sep 1 16:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:31:47.650770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba4018-e1b7-4483-af53-0346bebc763e service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:31:47.652896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-80ba4018-e1b7-4483-af53-0346bebc763e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:47.772505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba4018-e1b7-4483-af53-0346bebc763e service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:31:47.874242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:31:47.874878 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:47.875154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:47.875422 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] PATH_INFO: `/v3/users/c65882a72c5a45edb19d7d940476cda5` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:47.888852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c65882a72c5a45edb19d7d940476cda5)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:31:47.889870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:31:47.889870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: warnings.warn(msg) Sep 01 16:31:47.889870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: Sep 01 16:31:47.891125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:31:47.901459 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:48.177255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65882a72c5a45edb19d7d940476cda5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:31:48.194617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65882a72c5a45edb19d7d940476cda5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:31:48.195209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65882a72c5a45edb19d7d940476cda5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:31:48.307535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65882a72c5a45edb19d7d940476cda5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:31:48.308031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65882a72c5a45edb19d7d940476cda5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:31:48.338644 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 752/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:31:47 2022] DELETE /identity/v3/users/c65882a72c5a45edb19d7d940476cda5 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:31:48.343321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e19dd-75b6-4fd4-ab80-e4729dda1881 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:48.343769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e19dd-75b6-4fd4-ab80-e4729dda1881 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:48.343863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e19dd-75b6-4fd4-ab80-e4729dda1881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:48.406433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f92e19dd-75b6-4fd4-ab80-e4729dda1881 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:31:48.407654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f92e19dd-75b6-4fd4-ab80-e4729dda1881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:48.487916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:48.504330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 756/1508] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:31:48.516255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:31:48.517650 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:48.638132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93bced7-154d-4ab0-99c2-7b20b4ac845c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:31:48.722086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:48.742320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533d10e-a846-42f9-9b75-0b28deafca95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:31:48.742941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533d10e-a846-42f9-9b75-0b28deafca95 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:48.743222 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533d10e-a846-42f9-9b75-0b28deafca95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:48.743753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533d10e-a846-42f9-9b75-0b28deafca95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:48.745351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3533d10e-a846-42f9-9b75-0b28deafca95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:48.875269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533d10e-a846-42f9-9b75-0b28deafca95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:31:48.876716 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533d10e-a846-42f9-9b75-0b28deafca95 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:31:48.897380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 753/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:31:49.462443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e19dd-75b6-4fd4-ab80-e4729dda1881 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:31:49.463948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f92e19dd-75b6-4fd4-ab80-e4729dda1881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:31:49.479524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e19dd-75b6-4fd4-ab80-e4729dda1881 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:31:49.612339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:31:49.613035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:31:49.613366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:31:49.613637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] PATH_INFO: `/v3/projects/fd7632b35cc74483aab35f72a5e244f7` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:31:49.625409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7632b35cc74483aab35f72a5e244f7)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:31:49.626502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:31:49.626502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: warnings.warn(msg) Sep 01 16:31:49.626502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: Sep 01 16:31:49.634802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:31:49.758418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7632b35cc74483aab35f72a5e244f7', 'request_id': 'req-44a1e683-9e11-4086-aca0-9982c24585c7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:31:49.773869 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7632b35cc74483aab35f72a5e244f7', 'request_id': 'req-44a1e683-9e11-4086-aca0-9982c24585c7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:31:49.839610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7632b35cc74483aab35f72a5e244f7', 'request_id': 'req-44a1e683-9e11-4086-aca0-9982c24585c7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:31:49.872168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] The token cache is being invalidate because project fd7632b35cc74483aab35f72a5e244f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:31:49.872534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:31:49.873009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-44a1e683-9e11-4086-aca0-9982c24585c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:31:49.874744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 757/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:31:49 2022] DELETE /identity/v3/projects/fd7632b35cc74483aab35f72a5e244f7 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:31:58.894544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=62 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:59.869860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:34.485266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75c60-bf41-4b8b-a341-17be1278c4d0 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.485871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75c60-bf41-4b8b-a341-17be1278c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.485871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace75c60-bf41-4b8b-a341-17be1278c4d0 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.487254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:34.492911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d3ad-15cc-4902-bcfa-33ce9bc5b0c1 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:34.493369 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d3ad-15cc-4902-bcfa-33ce9bc5b0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:34.493480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31d3ad-15cc-4902-bcfa-33ce9bc5b0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:34.601103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8d31d3ad-15cc-4902-bcfa-33ce9bc5b0c1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:34.602563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8d31d3ad-15cc-4902-bcfa-33ce9bc5b0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:34.734213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:34.938373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace75c60-bf41-4b8b-a341-17be1278c4d0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:34.940587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ace75c60-bf41-4b8b-a341-17be1278c4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:35.090366 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace75c60-bf41-4b8b-a341-17be1278c4d0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:35.096077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3b4fa-78cd-4434-8bab-441fcfb16116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:35.096698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3b4fa-78cd-4434-8bab-441fcfb16116 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.096978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3b4fa-78cd-4434-8bab-441fcfb16116 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.097250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3b4fa-78cd-4434-8bab-441fcfb16116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.107720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3b4fa-78cd-4434-8bab-441fcfb16116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:35.109359 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3b4fa-78cd-4434-8bab-441fcfb16116 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:35.120219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 755/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:35.675304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88b4b7-f68c-429f-88d7-ca76d68d1a6b None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.675909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88b4b7-f68c-429f-88d7-ca76d68d1a6b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.675909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88b4b7-f68c-429f-88d7-ca76d68d1a6b None None] PATH_INFO: `/v3` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.677596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 759/1514] 10.222.0.17 () {54 vars in 925 bytes} [Thu Sep 1 16:33:35 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:33:35.686274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef07dc-59ae-4a01-965e-40cf8a6a6869 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:35.686855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef07dc-59ae-4a01-965e-40cf8a6a6869 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:35.686855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef07dc-59ae-4a01-965e-40cf8a6a6869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:35.771478 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-73ef07dc-59ae-4a01-965e-40cf8a6a6869 None None] MFA Rules not processed for user `61d15478ca864f49aae2301e2328fe23`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:35.773294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-73ef07dc-59ae-4a01-965e-40cf8a6a6869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:35.866889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:35.873618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 756/1515] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Sep 1 16:33:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:36.045473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b2e5-328a-488d-a578-d034cd37557c None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:36.045689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b2e5-328a-488d-a578-d034cd37557c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:36.047400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933b2e5-328a-488d-a578-d034cd37557c None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:36.047548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 760/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:33:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:36.054050 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9b6c7-b55e-4606-9684-a830ccf41afe None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:36.054417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9b6c7-b55e-4606-9684-a830ccf41afe None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:36.054697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9b6c7-b55e-4606-9684-a830ccf41afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:36.081819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-8bb9b6c7-b55e-4606-9684-a830ccf41afe None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:36.083793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8bb9b6c7-b55e-4606-9684-a830ccf41afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:36.095902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 757/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:36.275131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933b2e5-328a-488d-a578-d034cd37557c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:36.291701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933b2e5-328a-488d-a578-d034cd37557c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:36.298592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371584ab-aff7-4e1c-bb9c-19a8642c7e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:36.299153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371584ab-aff7-4e1c-bb9c-19a8642c7e03 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:36.299430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371584ab-aff7-4e1c-bb9c-19a8642c7e03 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:36.299708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371584ab-aff7-4e1c-bb9c-19a8642c7e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:36.310069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371584ab-aff7-4e1c-bb9c-19a8642c7e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:36.311665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371584ab-aff7-4e1c-bb9c-19a8642c7e03 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:36.323304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 761/1518] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:40.200611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230004f-b866-4527-a67b-3552ac5859d9 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:40.201146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230004f-b866-4527-a67b-3552ac5859d9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:40.201146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230004f-b866-4527-a67b-3552ac5859d9 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:40.202608 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 758/1519] 10.222.0.15 () {54 vars in 961 bytes} [Thu Sep 1 16:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:40.207765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffb2fd-6822-49bc-ba8b-819a786f298f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:40.208319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffb2fd-6822-49bc-ba8b-819a786f298f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:40.208433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffb2fd-6822-49bc-ba8b-819a786f298f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:40.229460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-abffb2fd-6822-49bc-ba8b-819a786f298f None None] MFA Rules not processed for user `61d15478ca864f49aae2301e2328fe23`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:40.230710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-abffb2fd-6822-49bc-ba8b-819a786f298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:40.239817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 762/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Sep 1 16:33:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:40.247874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230004f-b866-4527-a67b-3552ac5859d9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:40.263736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230004f-b866-4527-a67b-3552ac5859d9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:40.269371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ff07a-9381-40be-80b0-9c2b4c8b77aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d15478ca864f49aae2301e2328fe23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:40.270022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ff07a-9381-40be-80b0-9c2b4c8b77aa service placement] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:40.270312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ff07a-9381-40be-80b0-9c2b4c8b77aa service placement] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:40.270654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ff07a-9381-40be-80b0-9c2b4c8b77aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:40.281568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ff07a-9381-40be-80b0-9c2b4c8b77aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:40.284056 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ff07a-9381-40be-80b0-9c2b4c8b77aa service placement] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:40.295015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 759/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:47.662374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb7367-c870-49da-9043-9a6338e83841 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:47.662982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb7367-c870-49da-9043-9a6338e83841 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:47.662982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cb7367-c870-49da-9043-9a6338e83841 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:47.664266 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:47.669098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71090446-0249-47a5-9615-6cdf436f4ae0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:47.669506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71090446-0249-47a5-9615-6cdf436f4ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:47.669636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71090446-0249-47a5-9615-6cdf436f4ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:47.691779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-71090446-0249-47a5-9615-6cdf436f4ae0 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:47.693197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-71090446-0249-47a5-9615-6cdf436f4ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:47.701259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:47.887730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb7367-c870-49da-9043-9a6338e83841 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:47.909150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cb7367-c870-49da-9043-9a6338e83841 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:47.917642 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36df4a-7cb7-44ff-ae13-68875399be7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:47.918217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36df4a-7cb7-44ff-ae13-68875399be7b service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:47.918501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36df4a-7cb7-44ff-ae13-68875399be7b service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:47.918779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36df4a-7cb7-44ff-ae13-68875399be7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:47.928809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36df4a-7cb7-44ff-ae13-68875399be7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:47.931436 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36df4a-7cb7-44ff-ae13-68875399be7b service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:47.942900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 764/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:33:48.806030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539ec67-cae0-487c-8588-95f27798e478 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:48.806620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539ec67-cae0-487c-8588-95f27798e478 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:48.806620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539ec67-cae0-487c-8588-95f27798e478 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:48.807962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 16:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:48.813534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb467-1a6e-44e6-a5c6-482e15bea27c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:48.814076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb467-1a6e-44e6-a5c6-482e15bea27c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:48.814170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb467-1a6e-44e6-a5c6-482e15bea27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:48.836721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e31fb467-1a6e-44e6-a5c6-482e15bea27c None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:48.837955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e31fb467-1a6e-44e6-a5c6-482e15bea27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:48.846914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 16:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:49.006979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539ec67-cae0-487c-8588-95f27798e478 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:49.021766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539ec67-cae0-487c-8588-95f27798e478 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:49.027530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d907d-306e-44ed-82cc-2506688bd381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:49.028137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d907d-306e-44ed-82cc-2506688bd381 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:49.028414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d907d-306e-44ed-82cc-2506688bd381 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:49.028682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d907d-306e-44ed-82cc-2506688bd381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:49.037776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d907d-306e-44ed-82cc-2506688bd381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:49.039387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d907d-306e-44ed-82cc-2506688bd381 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:49.049290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 762/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:53.261749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b84d6-9c7f-48af-90f8-96bce3ce0d84 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:53.262328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b84d6-9c7f-48af-90f8-96bce3ce0d84 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:53.262328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b84d6-9c7f-48af-90f8-96bce3ce0d84 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:53.263613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:53.270950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dc20c-4133-4b8b-986e-9a2ce20cb27d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:53.271531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dc20c-4133-4b8b-986e-9a2ce20cb27d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:53.271531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983dc20c-4133-4b8b-986e-9a2ce20cb27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:53.292082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-983dc20c-4133-4b8b-986e-9a2ce20cb27d None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:53.293333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-983dc20c-4133-4b8b-986e-9a2ce20cb27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:53.301388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:33:53.595861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b84d6-9c7f-48af-90f8-96bce3ce0d84 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:53.597837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ac8b84d6-9c7f-48af-90f8-96bce3ce0d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:53.638417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:53.687909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b84d6-9c7f-48af-90f8-96bce3ce0d84 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:53.691815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a99cb-89c5-4b13-9976-94176092de1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:53.692952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a99cb-89c5-4b13-9976-94176092de1e service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:53.693486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a99cb-89c5-4b13-9976-94176092de1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:53.693796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a99cb-89c5-4b13-9976-94176092de1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:53.703479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a99cb-89c5-4b13-9976-94176092de1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:53.704914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a99cb-89c5-4b13-9976-94176092de1e service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:53.715807 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 767/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:33:55.722494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6672f-337b-4a5c-a5c6-2ec6e2f5c9fc None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:55.723090 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6672f-337b-4a5c-a5c6-2ec6e2f5c9fc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:55.723090 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6672f-337b-4a5c-a5c6-2ec6e2f5c9fc None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:55.724720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:33:55.730638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eacaf8-318b-4b44-9887-7cd2e5a7b7d6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:55.731094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eacaf8-318b-4b44-9887-7cd2e5a7b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:55.731191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eacaf8-318b-4b44-9887-7cd2e5a7b7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:55.751988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d2eacaf8-318b-4b44-9887-7cd2e5a7b7d6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:33:55.753191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d2eacaf8-318b-4b44-9887-7cd2e5a7b7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:33:55.761980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:33:56.069965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6672f-337b-4a5c-a5c6-2ec6e2f5c9fc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:33:56.081733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6672f-337b-4a5c-a5c6-2ec6e2f5c9fc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:33:56.086784 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d2172-3ea7-4c19-905b-4bff96019e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:33:56.087531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2172-3ea7-4c19-905b-4bff96019e84 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:33:56.087838 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2172-3ea7-4c19-905b-4bff96019e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:33:56.088138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d2172-3ea7-4c19-905b-4bff96019e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:33:56.099075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d2172-3ea7-4c19-905b-4bff96019e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:33:56.100719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d2172-3ea7-4c19-905b-4bff96019e84 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:33:56.113437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 765/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:33:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:00.356001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bbc28-6e74-479f-9a13-e8a89ab1bf01 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:00.356603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bbc28-6e74-479f-9a13-e8a89ab1bf01 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:00.356603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bbc28-6e74-479f-9a13-e8a89ab1bf01 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:00.357793 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:34:00.363080 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06a8e9-5a30-4d12-97d7-2dc02769e9bf None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:00.363679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06a8e9-5a30-4d12-97d7-2dc02769e9bf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:00.363679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d06a8e9-5a30-4d12-97d7-2dc02769e9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:00.384938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7d06a8e9-5a30-4d12-97d7-2dc02769e9bf None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:00.386731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7d06a8e9-5a30-4d12-97d7-2dc02769e9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:00.394022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:00.992972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bbc28-6e74-479f-9a13-e8a89ab1bf01 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:00.994834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-415bbc28-6e74-479f-9a13-e8a89ab1bf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:01.095872 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bbc28-6e74-479f-9a13-e8a89ab1bf01 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:01.100660 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f1f84-0436-463b-8a1f-d6f73f013ad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:01.101310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1f84-0436-463b-8a1f-d6f73f013ad9 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:01.101586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1f84-0436-463b-8a1f-d6f73f013ad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:01.101854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f1f84-0436-463b-8a1f-d6f73f013ad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:01.112311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f1f84-0436-463b-8a1f-d6f73f013ad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:01.113630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f1f84-0436-463b-8a1f-d6f73f013ad9 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:01.124923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 770/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:03.154832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394ed78-e946-4561-bc94-40a3020d7153 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:03.155410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394ed78-e946-4561-bc94-40a3020d7153 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:03.155410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394ed78-e946-4561-bc94-40a3020d7153 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:03.156741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 16:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:34:03.162614 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7d006-67cd-4976-a8f7-e8acb871936b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:03.163114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7d006-67cd-4976-a8f7-e8acb871936b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:03.163252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f7d006-67cd-4976-a8f7-e8acb871936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:03.185083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a2f7d006-67cd-4976-a8f7-e8acb871936b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:34:03.186329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a2f7d006-67cd-4976-a8f7-e8acb871936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:03.196153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 16:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:34:03.792889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394ed78-e946-4561-bc94-40a3020d7153 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:34:03.794640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1394ed78-e946-4561-bc94-40a3020d7153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:34:03.808009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1394ed78-e946-4561-bc94-40a3020d7153 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:34:03.811568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd2feb-09ab-440e-b7fe-b7922415fcc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:34:03.812166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2feb-09ab-440e-b7fe-b7922415fcc6 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:34:03.812440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2feb-09ab-440e-b7fe-b7922415fcc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:34:03.812710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2feb-09ab-440e-b7fe-b7922415fcc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:34:03.822265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd2feb-09ab-440e-b7fe-b7922415fcc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:34:03.823689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd2feb-09ab-440e-b7fe-b7922415fcc6 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:34:03.834201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 768/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:34:13.179913 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=63 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:13.829635 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=37 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:34.684329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb292eca-2fc8-45c3-a5e0-3a618c99103f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:34.685021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb292eca-2fc8-45c3-a5e0-3a618c99103f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:34.685021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb292eca-2fc8-45c3-a5e0-3a618c99103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:34.714083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-cb292eca-2fc8-45c3-a5e0-3a618c99103f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:34.715941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cb292eca-2fc8-45c3-a5e0-3a618c99103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:34.729335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 772/1540] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:34.739070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945974-e5f6-4492-b71c-3041fce1080b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:34.739688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945974-e5f6-4492-b71c-3041fce1080b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:34.739688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945974-e5f6-4492-b71c-3041fce1080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:34.770469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3f945974-e5f6-4492-b71c-3041fce1080b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:34.771980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3f945974-e5f6-4492-b71c-3041fce1080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:34.789791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 769/1541] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:34.795330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb292eca-2fc8-45c3-a5e0-3a618c99103f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:34.807456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb292eca-2fc8-45c3-a5e0-3a618c99103f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:34.819278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4d7ed-8d68-4e03-948b-9d55521d00a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:34.819917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4d7ed-8d68-4e03-948b-9d55521d00a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:34.820211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4d7ed-8d68-4e03-948b-9d55521d00a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:34.820518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4d7ed-8d68-4e03-948b-9d55521d00a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:34.821177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4d7ed-8d68-4e03-948b-9d55521d00a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:34.821480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4d7ed-8d68-4e03-948b-9d55521d00a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:34.823134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4d7ed-8d68-4e03-948b-9d55521d00a6 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:34.844006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 773/1542] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:34.853871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f945974-e5f6-4492-b71c-3041fce1080b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:34.871718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f945974-e5f6-4492-b71c-3041fce1080b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:34.880692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857d423-d44a-4db9-bd97-d01dd3307eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:34.881495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d423-d44a-4db9-bd97-d01dd3307eeb admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:34.881772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d423-d44a-4db9-bd97-d01dd3307eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:34.882107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857d423-d44a-4db9-bd97-d01dd3307eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:34.882700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857d423-d44a-4db9-bd97-d01dd3307eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:34.884631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857d423-d44a-4db9-bd97-d01dd3307eeb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:34.910307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaed7d-94d9-48d7-b8af-eba9b567e410 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:34.910674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaed7d-94d9-48d7-b8af-eba9b567e410 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:34.910905 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaed7d-94d9-48d7-b8af-eba9b567e410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:34.955022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-40aaed7d-94d9-48d7-b8af-eba9b567e410 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:34.956629 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-40aaed7d-94d9-48d7-b8af-eba9b567e410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:34.971274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 774/1543] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:34.975368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfdcdc-f499-4cd3-a852-93497b821550 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:34.975657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfdcdc-f499-4cd3-a852-93497b821550 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:34.975934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfdcdc-f499-4cd3-a852-93497b821550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.010456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-58bfdcdc-f499-4cd3-a852-93497b821550 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.011907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-58bfdcdc-f499-4cd3-a852-93497b821550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.022134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 775/1544] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.023515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ffe14-f2b0-446d-93b1-b2dc1c229a1d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.023807 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ffe14-f2b0-446d-93b1-b2dc1c229a1d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.024080 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ffe14-f2b0-446d-93b1-b2dc1c229a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.049352 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-407ffe14-f2b0-446d-93b1-b2dc1c229a1d None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.050694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-407ffe14-f2b0-446d-93b1-b2dc1c229a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.063886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 776/1545] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.064657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490f84-fd6a-41b3-bf71-658625fecf90 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.064942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490f84-fd6a-41b3-bf71-658625fecf90 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.065216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490f84-fd6a-41b3-bf71-658625fecf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.079184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 770/1546] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:34 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:35.080556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0f7f6-891a-4613-b116-5dab27ab6f56 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.081143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0f7f6-891a-4613-b116-5dab27ab6f56 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.081573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0f7f6-891a-4613-b116-5dab27ab6f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.092587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-90490f84-fd6a-41b3-bf71-658625fecf90 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.093832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-90490f84-fd6a-41b3-bf71-658625fecf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.110948 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0bc0f7f6-891a-4613-b116-5dab27ab6f56 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.112172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0bc0f7f6-891a-4613-b116-5dab27ab6f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.165782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 777/1547] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.167165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c85da7-fde1-4108-b430-32f005db151a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.167454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c85da7-fde1-4108-b430-32f005db151a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.167716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c85da7-fde1-4108-b430-32f005db151a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.179484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 771/1548] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.180763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69b41-f1f2-4d6d-a61a-7cea960526f6 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.181055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69b41-f1f2-4d6d-a61a-7cea960526f6 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.181332 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e69b41-f1f2-4d6d-a61a-7cea960526f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.188906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-69c85da7-fde1-4108-b430-32f005db151a None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.190203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-69c85da7-fde1-4108-b430-32f005db151a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.199049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 778/1549] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.200175 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfab57-ff5a-499e-82e2-18175ee35dfe None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.200463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfab57-ff5a-499e-82e2-18175ee35dfe None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.200737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfab57-ff5a-499e-82e2-18175ee35dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.203093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d5e69b41-f1f2-4d6d-a61a-7cea960526f6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.209320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d5e69b41-f1f2-4d6d-a61a-7cea960526f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.214975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 772/1550] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.216244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b969da-c2bf-4d9f-b342-6eeae6bc99a1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.216528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b969da-c2bf-4d9f-b342-6eeae6bc99a1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.216851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b969da-c2bf-4d9f-b342-6eeae6bc99a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.223135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8bdfab57-ff5a-499e-82e2-18175ee35dfe None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.224479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8bdfab57-ff5a-499e-82e2-18175ee35dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.232607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 779/1551] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.233399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfab57-ff5a-499e-82e2-18175ee35dfe None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.239124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d0b969da-c2bf-4d9f-b342-6eeae6bc99a1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.240950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d0b969da-c2bf-4d9f-b342-6eeae6bc99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.243554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfab57-ff5a-499e-82e2-18175ee35dfe None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.248664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6ca64-b5cf-4e02-b775-9910f96dd075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.249280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6ca64-b5cf-4e02-b775-9910f96dd075 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.249570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6ca64-b5cf-4e02-b775-9910f96dd075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.249860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6ca64-b5cf-4e02-b775-9910f96dd075 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.250526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6ca64-b5cf-4e02-b775-9910f96dd075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.251173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 773/1552] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.252478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6ca64-b5cf-4e02-b775-9910f96dd075 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.252729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73813-e12c-433f-a10a-ed8c26036b3d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.253018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73813-e12c-433f-a10a-ed8c26036b3d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.253294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d73813-e12c-433f-a10a-ed8c26036b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.275285 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-13d73813-e12c-433f-a10a-ed8c26036b3d None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.292683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-13d73813-e12c-433f-a10a-ed8c26036b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.292683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 774/1553] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.292683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d73813-e12c-433f-a10a-ed8c26036b3d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.295663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d73813-e12c-433f-a10a-ed8c26036b3d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.300210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a7734-2b90-4e7b-865b-07799507919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.300807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a7734-2b90-4e7b-865b-07799507919c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.301083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a7734-2b90-4e7b-865b-07799507919c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.301349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a7734-2b90-4e7b-865b-07799507919c admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.302023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a7734-2b90-4e7b-865b-07799507919c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:35.302503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a7734-2b90-4e7b-865b-07799507919c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.303568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-d51a7734-2b90-4e7b-865b-07799507919c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:35:35.303568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: warnings.warn(msg) Sep 01 16:35:35.303568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: Sep 01 16:35:35.304565 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a7734-2b90-4e7b-865b-07799507919c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.316601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 775/1554] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:35.319392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca352-f033-490f-ab04-4319493dcca0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.319392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca352-f033-490f-ab04-4319493dcca0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.319392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ca352-f033-490f-ab04-4319493dcca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.339530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-020ca352-f033-490f-ab04-4319493dcca0 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.340745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-020ca352-f033-490f-ab04-4319493dcca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.350157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 776/1555] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.354009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963dda-3197-4595-941f-e9c7bfaeeb74 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.354009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963dda-3197-4595-941f-e9c7bfaeeb74 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.354009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c963dda-3197-4595-941f-e9c7bfaeeb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.374513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1c963dda-3197-4595-941f-e9c7bfaeeb74 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.375711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1c963dda-3197-4595-941f-e9c7bfaeeb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.384995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 777/1556] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.386571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 780/1557] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:35.390646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c963dda-3197-4595-941f-e9c7bfaeeb74 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.390784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ecdc1-84fd-497b-acf2-1ba62d730d56 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.390784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ecdc1-84fd-497b-acf2-1ba62d730d56 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.390784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ecdc1-84fd-497b-acf2-1ba62d730d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.397574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c963dda-3197-4595-941f-e9c7bfaeeb74 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.402292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fba2a-ab2a-4555-a50e-e6bec8407475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.402884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fba2a-ab2a-4555-a50e-e6bec8407475 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.403163 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fba2a-ab2a-4555-a50e-e6bec8407475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.403449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fba2a-ab2a-4555-a50e-e6bec8407475 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.404069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fba2a-ab2a-4555-a50e-e6bec8407475 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:35.404365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fba2a-ab2a-4555-a50e-e6bec8407475 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.406187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fba2a-ab2a-4555-a50e-e6bec8407475 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.409760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c02ecdc1-84fd-497b-acf2-1ba62d730d56 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.411006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c02ecdc1-84fd-497b-acf2-1ba62d730d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.418513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 778/1558] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:35.419533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fba2a-ab2a-4555-a50e-e6bec8407475 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.420419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 781/1559] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.421632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895d687-c0cd-4aa0-b049-886ad095b523 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.422016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895d687-c0cd-4aa0-b049-886ad095b523 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.422296 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895d687-c0cd-4aa0-b049-886ad095b523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.430561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fba2a-ab2a-4555-a50e-e6bec8407475 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.435360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fc28a-5230-45e8-b7c2-4d4fbb130354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.435973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc28a-5230-45e8-b7c2-4d4fbb130354 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.436255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc28a-5230-45e8-b7c2-4d4fbb130354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.436531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc28a-5230-45e8-b7c2-4d4fbb130354 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.437306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fc28a-5230-45e8-b7c2-4d4fbb130354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:35.437612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fc28a-5230-45e8-b7c2-4d4fbb130354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.439573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fc28a-5230-45e8-b7c2-4d4fbb130354 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.442498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0895d687-c0cd-4aa0-b049-886ad095b523 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:35.444417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0895d687-c0cd-4aa0-b049-886ad095b523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:35.453045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 782/1560] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:35.453870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895d687-c0cd-4aa0-b049-886ad095b523 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.462225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 779/1561] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:35.462225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fc28a-5230-45e8-b7c2-4d4fbb130354 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.465423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895d687-c0cd-4aa0-b049-886ad095b523 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.470068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc625f-0f9a-4da5-964b-ef2e08a5537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.470669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc625f-0f9a-4da5-964b-ef2e08a5537f admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.470941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc625f-0f9a-4da5-964b-ef2e08a5537f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.471206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc625f-0f9a-4da5-964b-ef2e08a5537f admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.471780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fc28a-5230-45e8-b7c2-4d4fbb130354 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.471896 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc625f-0f9a-4da5-964b-ef2e08a5537f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.472846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-83fc625f-0f9a-4da5-964b-ef2e08a5537f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:35:35.472846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: warnings.warn(msg) Sep 01 16:35:35.472846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: Sep 01 16:35:35.474026 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc625f-0f9a-4da5-964b-ef2e08a5537f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.476536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc998f4-e7a5-4020-a22a-0ad294fa0cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.477139 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc998f4-e7a5-4020-a22a-0ad294fa0cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.477415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc998f4-e7a5-4020-a22a-0ad294fa0cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.477685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc998f4-e7a5-4020-a22a-0ad294fa0cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.478366 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc998f4-e7a5-4020-a22a-0ad294fa0cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:35.478671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc998f4-e7a5-4020-a22a-0ad294fa0cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.480233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc998f4-e7a5-4020-a22a-0ad294fa0cc1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.492336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 780/1562] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:35.493316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc998f4-e7a5-4020-a22a-0ad294fa0cc1 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.503697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc998f4-e7a5-4020-a22a-0ad294fa0cc1 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.509450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9e7c6-e61a-4f66-b777-02fff7cf0d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.510131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9e7c6-e61a-4f66-b777-02fff7cf0d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.510411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9e7c6-e61a-4f66-b777-02fff7cf0d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.511943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9e7c6-e61a-4f66-b777-02fff7cf0d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.511943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9e7c6-e61a-4f66-b777-02fff7cf0d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.513946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9e7c6-e61a-4f66-b777-02fff7cf0d2b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.524738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 781/1563] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:35.525548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9e7c6-e61a-4f66-b777-02fff7cf0d2b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.535347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9e7c6-e61a-4f66-b777-02fff7cf0d2b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.540625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86804153-33d5-4029-a910-f7a50032684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.541205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86804153-33d5-4029-a910-f7a50032684d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.541484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86804153-33d5-4029-a910-f7a50032684d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.541754 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86804153-33d5-4029-a910-f7a50032684d admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.542461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86804153-33d5-4029-a910-f7a50032684d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:35.542813 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86804153-33d5-4029-a910-f7a50032684d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.544383 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86804153-33d5-4029-a910-f7a50032684d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.556926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 782/1564] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:35.557725 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86804153-33d5-4029-a910-f7a50032684d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.567706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86804153-33d5-4029-a910-f7a50032684d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.574317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ca584-6c86-4ed3-a816-780a0b226497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.576399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ca584-6c86-4ed3-a816-780a0b226497 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.576399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ca584-6c86-4ed3-a816-780a0b226497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.576399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ca584-6c86-4ed3-a816-780a0b226497 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.576399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ca584-6c86-4ed3-a816-780a0b226497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.578025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ca584-6c86-4ed3-a816-780a0b226497 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.591994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:35.664182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 783/1565] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/projects => generated 393 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:35.667455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc625f-0f9a-4da5-964b-ef2e08a5537f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.723927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:35.729216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc625f-0f9a-4da5-964b-ef2e08a5537f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.733980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4ec9-5973-47db-b812-66403d34fb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.734672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4ec9-5973-47db-b812-66403d34fb81 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.735207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4ec9-5973-47db-b812-66403d34fb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.735473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb4ec9-5973-47db-b812-66403d34fb81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.736134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4ec9-5973-47db-b812-66403d34fb81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:35.736436 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4ec9-5973-47db-b812-66403d34fb81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.738169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb4ec9-5973-47db-b812-66403d34fb81 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.745179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 783/1566] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/projects => generated 389 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:35.747184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ca584-6c86-4ed3-a816-780a0b226497 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.755145 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 784/1567] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:35.757397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4ec9-5973-47db-b812-66403d34fb81 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.768129 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb4ec9-5973-47db-b812-66403d34fb81 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.817786 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ca584-6c86-4ed3-a816-780a0b226497 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.823361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b9a20-2e22-4c79-9bbe-38988941c2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.823970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b9a20-2e22-4c79-9bbe-38988941c2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.824250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b9a20-2e22-4c79-9bbe-38988941c2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.824524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b9a20-2e22-4c79-9bbe-38988941c2c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.825268 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b9a20-2e22-4c79-9bbe-38988941c2c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:35.825570 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b9a20-2e22-4c79-9bbe-38988941c2c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.827197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103b9a20-2e22-4c79-9bbe-38988941c2c7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.828439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f115630-2d4c-44de-87a2-9251f55a374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.829155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115630-2d4c-44de-87a2-9251f55a374d admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.829433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115630-2d4c-44de-87a2-9251f55a374d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.829702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f115630-2d4c-44de-87a2-9251f55a374d admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.830423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f115630-2d4c-44de-87a2-9251f55a374d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.832334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f115630-2d4c-44de-87a2-9251f55a374d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.840152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 784/1568] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:35.841125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b9a20-2e22-4c79-9bbe-38988941c2c7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:35.858151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b9a20-2e22-4c79-9bbe-38988941c2c7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:35.863492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc372ae-c866-4c43-bf1d-72839b3d351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:35.864145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc372ae-c866-4c43-bf1d-72839b3d351c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:35.864424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc372ae-c866-4c43-bf1d-72839b3d351c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:35.865232 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc372ae-c866-4c43-bf1d-72839b3d351c admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:35.866054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc372ae-c866-4c43-bf1d-72839b3d351c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:35.868112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc372ae-c866-4c43-bf1d-72839b3d351c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:35.995467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 785/1569] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:35.996340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f115630-2d4c-44de-87a2-9251f55a374d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.058965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f115630-2d4c-44de-87a2-9251f55a374d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.063950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8397f9-0296-4f82-bb34-bd412a0412b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.064569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8397f9-0296-4f82-bb34-bd412a0412b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.064845 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8397f9-0296-4f82-bb34-bd412a0412b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.065118 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8397f9-0296-4f82-bb34-bd412a0412b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.065755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8397f9-0296-4f82-bb34-bd412a0412b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.067408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8397f9-0296-4f82-bb34-bd412a0412b8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.067568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 785/1570] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:35 2022] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:36.069207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc372ae-c866-4c43-bf1d-72839b3d351c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.082453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 786/1571] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:36.083390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8397f9-0296-4f82-bb34-bd412a0412b8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.093996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8397f9-0296-4f82-bb34-bd412a0412b8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.160374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c6e95-0be0-464a-92c7-33fb4d87da6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.160996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6e95-0be0-464a-92c7-33fb4d87da6a admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.161278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6e95-0be0-464a-92c7-33fb4d87da6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.162392 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c6e95-0be0-464a-92c7-33fb4d87da6a admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.162782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c6e95-0be0-464a-92c7-33fb4d87da6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.163461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc372ae-c866-4c43-bf1d-72839b3d351c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.164752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c6e95-0be0-464a-92c7-33fb4d87da6a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.168463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ef9f-6c40-4dfd-82b3-1f420c9760e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.169076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ef9f-6c40-4dfd-82b3-1f420c9760e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.169352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ef9f-6c40-4dfd-82b3-1f420c9760e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.169617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ef9f-6c40-4dfd-82b3-1f420c9760e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.170282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9ef9f-6c40-4dfd-82b3-1f420c9760e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.172176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9ef9f-6c40-4dfd-82b3-1f420c9760e9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.263560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:36.269032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 787/1572] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:36.269943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c6e95-0be0-464a-92c7-33fb4d87da6a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.281516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c6e95-0be0-464a-92c7-33fb4d87da6a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.288399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e3659-7e1f-4a16-a63c-99982cb242ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.289020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e3659-7e1f-4a16-a63c-99982cb242ed admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.289298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e3659-7e1f-4a16-a63c-99982cb242ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.289568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e3659-7e1f-4a16-a63c-99982cb242ed admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.290245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e3659-7e1f-4a16-a63c-99982cb242ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.292227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e3659-7e1f-4a16-a63c-99982cb242ed admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.300767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 786/1573] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:36.301606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ef9f-6c40-4dfd-82b3-1f420c9760e9 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.359361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:36.373130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ef9f-6c40-4dfd-82b3-1f420c9760e9 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.380185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26d153-332e-41d4-8530-76fefe97f19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.380185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26d153-332e-41d4-8530-76fefe97f19b admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.380185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26d153-332e-41d4-8530-76fefe97f19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.380185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26d153-332e-41d4-8530-76fefe97f19b admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.380752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26d153-332e-41d4-8530-76fefe97f19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.381642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26d153-332e-41d4-8530-76fefe97f19b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.434894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 788/1574] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:36.436180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e3659-7e1f-4a16-a63c-99982cb242ed admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.447646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e3659-7e1f-4a16-a63c-99982cb242ed admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.452483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeff131-814e-4861-a4de-5973a45b9b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.453155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff131-814e-4861-a4de-5973a45b9b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.453435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff131-814e-4861-a4de-5973a45b9b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.453703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeff131-814e-4861-a4de-5973a45b9b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.454365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeff131-814e-4861-a4de-5973a45b9b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.456269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeff131-814e-4861-a4de-5973a45b9b2b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.644978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 789/1575] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/projects => generated 403 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:36.646527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeff131-814e-4861-a4de-5973a45b9b2b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.646780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 787/1576] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/projects => generated 383 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:36.647816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26d153-332e-41d4-8530-76fefe97f19b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.735762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26d153-332e-41d4-8530-76fefe97f19b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.740674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455abebf-ac68-4fbf-9602-6d1fc3b2e81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.741403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455abebf-ac68-4fbf-9602-6d1fc3b2e81e admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.741690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455abebf-ac68-4fbf-9602-6d1fc3b2e81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.741997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455abebf-ac68-4fbf-9602-6d1fc3b2e81e admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.742146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeff131-814e-4861-a4de-5973a45b9b2b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.742807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455abebf-ac68-4fbf-9602-6d1fc3b2e81e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.743819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-455abebf-ac68-4fbf-9602-6d1fc3b2e81e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:35:36.743819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: warnings.warn(msg) Sep 01 16:35:36.743819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: Sep 01 16:35:36.745064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455abebf-ac68-4fbf-9602-6d1fc3b2e81e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.747576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653633-ac03-4624-a5a9-de066b60a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.748462 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653633-ac03-4624-a5a9-de066b60a442 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.748760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653633-ac03-4624-a5a9-de066b60a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.749030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653633-ac03-4624-a5a9-de066b60a442 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.749733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4653633-ac03-4624-a5a9-de066b60a442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.751853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4653633-ac03-4624-a5a9-de066b60a442 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.870733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 788/1577] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:36.871565 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455abebf-ac68-4fbf-9602-6d1fc3b2e81e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.884286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455abebf-ac68-4fbf-9602-6d1fc3b2e81e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.889013 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dca92-93e7-4fe3-8d33-47cc5dbe56a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.889663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dca92-93e7-4fe3-8d33-47cc5dbe56a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.889992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dca92-93e7-4fe3-8d33-47cc5dbe56a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.890269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582dca92-93e7-4fe3-8d33-47cc5dbe56a8 admin admin] PATH_INFO: `/v3/projects/2bf0446d7ff94fa880e5a8d868a9e0d4/users/b1628c4903b34a219d19e01bf73e0b03/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.907934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 790/1578] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:36.907934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653633-ac03-4624-a5a9-de066b60a442 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.910453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dca92-93e7-4fe3-8d33-47cc5dbe56a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf0446d7ff94fa880e5a8d868a9e0d4, user_id=b1628c4903b34a219d19e01bf73e0b03, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.914058 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582dca92-93e7-4fe3-8d33-47cc5dbe56a8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.916311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653633-ac03-4624-a5a9-de066b60a442 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.921029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68b48c-f735-4f07-ab9a-f29cf92beaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.921637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b48c-f735-4f07-ab9a-f29cf92beaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.921957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b48c-f735-4f07-ab9a-f29cf92beaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.922237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68b48c-f735-4f07-ab9a-f29cf92beaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.923074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68b48c-f735-4f07-ab9a-f29cf92beaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.924464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68b48c-f735-4f07-ab9a-f29cf92beaa3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.936624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 791/1579] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:36.937451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68b48c-f735-4f07-ab9a-f29cf92beaa3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:36.948658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68b48c-f735-4f07-ab9a-f29cf92beaa3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:36.953558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f8a7-5ee0-43f7-a120-338a45543f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:36.954212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f8a7-5ee0-43f7-a120-338a45543f0e admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:36.956808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f8a7-5ee0-43f7-a120-338a45543f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:36.956808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f8a7-5ee0-43f7-a120-338a45543f0e admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:36.956808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0f8a7-5ee0-43f7-a120-338a45543f0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:36.957374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0f8a7-5ee0-43f7-a120-338a45543f0e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:36.985365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 789/1580] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:36 2022] PUT /identity/v3/projects/2bf0446d7ff94fa880e5a8d868a9e0d4/users/b1628c4903b34a219d19e01bf73e0b03/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:36.986485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dca92-93e7-4fe3-8d33-47cc5dbe56a8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.061492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582dca92-93e7-4fe3-8d33-47cc5dbe56a8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.067221 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3fb85-4c69-4265-85d7-6d7550c462a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.067585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fb85-4c69-4265-85d7-6d7550c462a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.068477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fb85-4c69-4265-85d7-6d7550c462a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.068850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3fb85-4c69-4265-85d7-6d7550c462a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.069753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3fb85-4c69-4265-85d7-6d7550c462a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.071405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3fb85-4c69-4265-85d7-6d7550c462a0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.082352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 790/1581] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.083374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3fb85-4c69-4265-85d7-6d7550c462a0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.088535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 792/1582] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:36 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:37.089295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f8a7-5ee0-43f7-a120-338a45543f0e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.097564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3fb85-4c69-4265-85d7-6d7550c462a0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.103615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d73a-e4fa-48d9-9e48-1ba61c0d2ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.103857 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d73a-e4fa-48d9-9e48-1ba61c0d2ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.104188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d73a-e4fa-48d9-9e48-1ba61c0d2ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.104413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3d73a-e4fa-48d9-9e48-1ba61c0d2ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.105026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3d73a-e4fa-48d9-9e48-1ba61c0d2ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.106993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3d73a-e4fa-48d9-9e48-1ba61c0d2ef2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.108058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f8a7-5ee0-43f7-a120-338a45543f0e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.115862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb448c-f172-4a0a-85d9-15e5402d0d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.117439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb448c-f172-4a0a-85d9-15e5402d0d48 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.119315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb448c-f172-4a0a-85d9-15e5402d0d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.122041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb448c-f172-4a0a-85d9-15e5402d0d48 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.124886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb448c-f172-4a0a-85d9-15e5402d0d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.129070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb448c-f172-4a0a-85d9-15e5402d0d48 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.242454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 791/1583] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:37 2022] POST /identity/v3/users => generated 302 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:37.243244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d73a-e4fa-48d9-9e48-1ba61c0d2ef2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.253408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3d73a-e4fa-48d9-9e48-1ba61c0d2ef2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.259055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39871028-6a01-4f24-8028-264871eaf7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.259625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39871028-6a01-4f24-8028-264871eaf7ca admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.260034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39871028-6a01-4f24-8028-264871eaf7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.260309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39871028-6a01-4f24-8028-264871eaf7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.260943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39871028-6a01-4f24-8028-264871eaf7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.262548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39871028-6a01-4f24-8028-264871eaf7ca admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.275046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 792/1584] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.275904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39871028-6a01-4f24-8028-264871eaf7ca admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.288706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39871028-6a01-4f24-8028-264871eaf7ca admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.293168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 793/1585] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:37 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:37.293168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb448c-f172-4a0a-85d9-15e5402d0d48 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.297235 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652086f1-5b80-4fbd-b2e8-652efa54db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.298243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652086f1-5b80-4fbd-b2e8-652efa54db05 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.298717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652086f1-5b80-4fbd-b2e8-652efa54db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.299169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652086f1-5b80-4fbd-b2e8-652efa54db05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.299905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652086f1-5b80-4fbd-b2e8-652efa54db05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.301517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652086f1-5b80-4fbd-b2e8-652efa54db05 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.303690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:37.307389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb448c-f172-4a0a-85d9-15e5402d0d48 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.312841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15132005-351b-4c8e-b665-0d312c38fc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.313453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15132005-351b-4c8e-b665-0d312c38fc8a admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.313736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15132005-351b-4c8e-b665-0d312c38fc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.314034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15132005-351b-4c8e-b665-0d312c38fc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.314681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15132005-351b-4c8e-b665-0d312c38fc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.314911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 793/1586] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.316485 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15132005-351b-4c8e-b665-0d312c38fc8a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.316999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f54186-7a95-4c2f-9598-3d61e3517fca None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.317502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f54186-7a95-4c2f-9598-3d61e3517fca None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.318553 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f54186-7a95-4c2f-9598-3d61e3517fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.329060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 794/1587] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.329846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15132005-351b-4c8e-b665-0d312c38fc8a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.341264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15132005-351b-4c8e-b665-0d312c38fc8a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.343698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-52f54186-7a95-4c2f-9598-3d61e3517fca None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:37.344937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-52f54186-7a95-4c2f-9598-3d61e3517fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:37.346678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba9611-9231-4189-a4ce-aeda161c97a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.346678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba9611-9231-4189-a4ce-aeda161c97a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.347051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba9611-9231-4189-a4ce-aeda161c97a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.347314 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba9611-9231-4189-a4ce-aeda161c97a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.347767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba9611-9231-4189-a4ce-aeda161c97a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.350416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba9611-9231-4189-a4ce-aeda161c97a2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.354453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 794/1588] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:37.355016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f54186-7a95-4c2f-9598-3d61e3517fca None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.366603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 795/1589] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.366895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f54186-7a95-4c2f-9598-3d61e3517fca None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.373238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba9611-9231-4189-a4ce-aeda161c97a2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.373614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b510696-3dc8-430e-a190-3eecee325f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.374905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b510696-3dc8-430e-a190-3eecee325f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.374905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b510696-3dc8-430e-a190-3eecee325f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.374905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b510696-3dc8-430e-a190-3eecee325f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.375499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b510696-3dc8-430e-a190-3eecee325f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.377182 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b510696-3dc8-430e-a190-3eecee325f0c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.378664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba9611-9231-4189-a4ce-aeda161c97a2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.385241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe82459-cd4d-4cc0-bb45-62a2b2198cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.385858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe82459-cd4d-4cc0-bb45-62a2b2198cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.386167 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe82459-cd4d-4cc0-bb45-62a2b2198cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.386437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe82459-cd4d-4cc0-bb45-62a2b2198cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.387109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe82459-cd4d-4cc0-bb45-62a2b2198cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.388708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe82459-cd4d-4cc0-bb45-62a2b2198cd6 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.396980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 795/1590] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.396980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b510696-3dc8-430e-a190-3eecee325f0c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.404016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 796/1591] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.404255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe82459-cd4d-4cc0-bb45-62a2b2198cd6 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.414208 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b510696-3dc8-430e-a190-3eecee325f0c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.415964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe82459-cd4d-4cc0-bb45-62a2b2198cd6 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.421474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83e1bd-5e0c-47ec-9007-06c7289d4bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.421687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd2a6a-6ac5-446a-ac5f-d574a6867c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.422196 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2a6a-6ac5-446a-ac5f-d574a6867c23 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.422386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e1bd-5e0c-47ec-9007-06c7289d4bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.422498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2a6a-6ac5-446a-ac5f-d574a6867c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.422749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2a6a-6ac5-446a-ac5f-d574a6867c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.422878 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e1bd-5e0c-47ec-9007-06c7289d4bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.423150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83e1bd-5e0c-47ec-9007-06c7289d4bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.423400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd2a6a-6ac5-446a-ac5f-d574a6867c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.424125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83e1bd-5e0c-47ec-9007-06c7289d4bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.425056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd2a6a-6ac5-446a-ac5f-d574a6867c23 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.426810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83e1bd-5e0c-47ec-9007-06c7289d4bb1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.438671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 797/1592] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.439467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd2a6a-6ac5-446a-ac5f-d574a6867c23 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.447204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 796/1593] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.448192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83e1bd-5e0c-47ec-9007-06c7289d4bb1 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.452652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd2a6a-6ac5-446a-ac5f-d574a6867c23 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.459368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f4411-e69e-42a1-8843-2b3fc1f2d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.460145 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4411-e69e-42a1-8843-2b3fc1f2d038 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.460467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4411-e69e-42a1-8843-2b3fc1f2d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.460894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f4411-e69e-42a1-8843-2b3fc1f2d038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.461702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f4411-e69e-42a1-8843-2b3fc1f2d038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.463650 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83e1bd-5e0c-47ec-9007-06c7289d4bb1 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.464401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f4411-e69e-42a1-8843-2b3fc1f2d038 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.471103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32038-5194-4e2c-876d-06a607348954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.472203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32038-5194-4e2c-876d-06a607348954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.472683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32038-5194-4e2c-876d-06a607348954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.473156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd32038-5194-4e2c-876d-06a607348954 admin admin] PATH_INFO: `/v3/projects/f89012e15d0441a8b9c2d76042c3756c/users/67ceab80e8744b478ec9cb93e1b56f5f/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.478338 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 798/1594] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.479209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f4411-e69e-42a1-8843-2b3fc1f2d038 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.491996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:37.498294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd32038-5194-4e2c-876d-06a607348954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89012e15d0441a8b9c2d76042c3756c, user_id=67ceab80e8744b478ec9cb93e1b56f5f, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.501528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd32038-5194-4e2c-876d-06a607348954 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.543459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f4411-e69e-42a1-8843-2b3fc1f2d038 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.547904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4e61f-02bd-42ed-b7fa-c02955306332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.548516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4e61f-02bd-42ed-b7fa-c02955306332 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.548795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4e61f-02bd-42ed-b7fa-c02955306332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.549065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4e61f-02bd-42ed-b7fa-c02955306332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.559903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4e61f-02bd-42ed-b7fa-c02955306332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.561348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4e61f-02bd-42ed-b7fa-c02955306332 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.572889 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 799/1595] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:37.573749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4e61f-02bd-42ed-b7fa-c02955306332 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.583211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4e61f-02bd-42ed-b7fa-c02955306332 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.590011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045676d9-9d59-4f32-9581-ad37059bb0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.591051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045676d9-9d59-4f32-9581-ad37059bb0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.591518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045676d9-9d59-4f32-9581-ad37059bb0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.591972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045676d9-9d59-4f32-9581-ad37059bb0bc admin admin] PATH_INFO: `/v3/projects/ba7ee5834a304139958dc23716aa8819/users/36ae407308bf4947b1f113f5390db714/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.601989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 797/1596] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:37 2022] PUT /identity/v3/projects/f89012e15d0441a8b9c2d76042c3756c/users/67ceab80e8744b478ec9cb93e1b56f5f/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:37.604022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32038-5194-4e2c-876d-06a607348954 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.619873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045676d9-9d59-4f32-9581-ad37059bb0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba7ee5834a304139958dc23716aa8819, user_id=36ae407308bf4947b1f113f5390db714, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.621480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-045676d9-9d59-4f32-9581-ad37059bb0bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:35:37.621480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: warnings.warn(msg) Sep 01 16:35:37.621480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: Sep 01 16:35:37.625138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045676d9-9d59-4f32-9581-ad37059bb0bc admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.685094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd32038-5194-4e2c-876d-06a607348954 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.690360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b015f-8300-433d-a77d-b269ad85f31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.690985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b015f-8300-433d-a77d-b269ad85f31b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.691267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b015f-8300-433d-a77d-b269ad85f31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.691540 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b015f-8300-433d-a77d-b269ad85f31b admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.692222 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b015f-8300-433d-a77d-b269ad85f31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.695167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b015f-8300-433d-a77d-b269ad85f31b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.712246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 798/1597] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.712246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b015f-8300-433d-a77d-b269ad85f31b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.721145 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 800/1598] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:37 2022] PUT /identity/v3/projects/ba7ee5834a304139958dc23716aa8819/users/36ae407308bf4947b1f113f5390db714/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:37.722146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045676d9-9d59-4f32-9581-ad37059bb0bc admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.726499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b015f-8300-433d-a77d-b269ad85f31b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.790544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045676d9-9d59-4f32-9581-ad37059bb0bc admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.795642 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d5d56-6233-457c-8876-685e9f8a9cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.796255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d5d56-6233-457c-8876-685e9f8a9cdc admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.796678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d5d56-6233-457c-8876-685e9f8a9cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.797023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d5d56-6233-457c-8876-685e9f8a9cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.797702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d5d56-6233-457c-8876-685e9f8a9cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.799512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d5d56-6233-457c-8876-685e9f8a9cdc admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.803800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48df23-48c3-456b-ae96-21599cac8dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.804428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df23-48c3-456b-ae96-21599cac8dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.804705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df23-48c3-456b-ae96-21599cac8dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.804990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48df23-48c3-456b-ae96-21599cac8dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.805621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48df23-48c3-456b-ae96-21599cac8dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.807283 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48df23-48c3-456b-ae96-21599cac8dc8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.813710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 801/1599] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.814991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d5d56-6233-457c-8876-685e9f8a9cdc admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.821676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 799/1600] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:37.822940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48df23-48c3-456b-ae96-21599cac8dc8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:37.832189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d5d56-6233-457c-8876-685e9f8a9cdc admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.837378 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48df23-48c3-456b-ae96-21599cac8dc8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:37.840490 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25665f2-85be-4c2f-8d6b-8d9a6733ac3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.841289 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25665f2-85be-4c2f-8d6b-8d9a6733ac3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.841628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25665f2-85be-4c2f-8d6b-8d9a6733ac3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.842033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25665f2-85be-4c2f-8d6b-8d9a6733ac3d admin admin] PATH_INFO: `/v3/projects/e81d8e66d2a0422fb157993a191c289b/users/744cf2055b244186afa58ec86a7d3b73/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.851092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d73e4-85a7-4186-836b-bc91a198f1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:37.851092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d73e4-85a7-4186-836b-bc91a198f1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.851092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d73e4-85a7-4186-836b-bc91a198f1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.851092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d73e4-85a7-4186-836b-bc91a198f1f3 admin admin] PATH_INFO: `/v3/projects/c1880b0226ac4d6fb1407e2242609f8a/users/c33b81f98c4e4e919d60f408ad24e594/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:37.862742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25665f2-85be-4c2f-8d6b-8d9a6733ac3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81d8e66d2a0422fb157993a191c289b, user_id=744cf2055b244186afa58ec86a7d3b73, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.863411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d73e4-85a7-4186-836b-bc91a198f1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1880b0226ac4d6fb1407e2242609f8a, user_id=c33b81f98c4e4e919d60f408ad24e594, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:37.866550 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25665f2-85be-4c2f-8d6b-8d9a6733ac3d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.866845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d73e4-85a7-4186-836b-bc91a198f1f3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:37.985233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 800/1601] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:37 2022] PUT /identity/v3/projects/c1880b0226ac4d6fb1407e2242609f8a/users/c33b81f98c4e4e919d60f408ad24e594/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:37.992183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574cc65-0a35-45bd-bb06-013dae553df9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:37.992614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574cc65-0a35-45bd-bb06-013dae553df9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:37.993224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574cc65-0a35-45bd-bb06-013dae553df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.017272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9574cc65-0a35-45bd-bb06-013dae553df9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:38.018901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9574cc65-0a35-45bd-bb06-013dae553df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.022939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 802/1602] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:37 2022] PUT /identity/v3/projects/e81d8e66d2a0422fb157993a191c289b/users/744cf2055b244186afa58ec86a7d3b73/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:38.022939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25665f2-85be-4c2f-8d6b-8d9a6733ac3d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:38.033413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:38.096638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 801/1603] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:38.098260 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74187b-5762-4548-b495-e2865c24b3b5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.098615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74187b-5762-4548-b495-e2865c24b3b5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.098948 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74187b-5762-4548-b495-e2865c24b3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.114108 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25665f2-85be-4c2f-8d6b-8d9a6733ac3d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:38.120054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d156c-1599-423b-81b8-33539d16d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:38.120940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d156c-1599-423b-81b8-33539d16d27a admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.121116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ed74187b-5762-4548-b495-e2865c24b3b5 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:38.121307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d156c-1599-423b-81b8-33539d16d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.121587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d156c-1599-423b-81b8-33539d16d27a admin admin] PATH_INFO: `/v3/projects/572d466ea837460290b7b601f1a9fdbd/users/c5b4a1b1c71041629a8e8c25ebdacbbc/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.122520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ed74187b-5762-4548-b495-e2865c24b3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.128556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:38.138431 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 802/1604] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:38.138431 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74187b-5762-4548-b495-e2865c24b3b5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:38.143473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d156c-1599-423b-81b8-33539d16d27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=572d466ea837460290b7b601f1a9fdbd, user_id=c5b4a1b1c71041629a8e8c25ebdacbbc, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:38.144680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74187b-5762-4548-b495-e2865c24b3b5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:38.146286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d156c-1599-423b-81b8-33539d16d27a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:38.150810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420ef8a-7fe8-4633-9bdc-43aca07d83c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:38.151356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ef8a-7fe8-4633-9bdc-43aca07d83c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.151835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ef8a-7fe8-4633-9bdc-43aca07d83c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.152097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420ef8a-7fe8-4633-9bdc-43aca07d83c1 admin admin] PATH_INFO: `/v3/projects/2ab7cc9738594ece9afbe0b1cc2a7ff9/users/05310022dc69434fb8c4fa41f833abe9/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.171544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420ef8a-7fe8-4633-9bdc-43aca07d83c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab7cc9738594ece9afbe0b1cc2a7ff9, user_id=05310022dc69434fb8c4fa41f833abe9, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:38.174441 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420ef8a-7fe8-4633-9bdc-43aca07d83c1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:38.366342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 803/1605] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:38 2022] PUT /identity/v3/projects/572d466ea837460290b7b601f1a9fdbd/users/c5b4a1b1c71041629a8e8c25ebdacbbc/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:38.367133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d156c-1599-423b-81b8-33539d16d27a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:38.436797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d156c-1599-423b-81b8-33539d16d27a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:38.441790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56518856-f67a-493b-89ff-6b989b750aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:38.442472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56518856-f67a-493b-89ff-6b989b750aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.442747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56518856-f67a-493b-89ff-6b989b750aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.443088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56518856-f67a-493b-89ff-6b989b750aa3 admin admin] PATH_INFO: `/v3/projects/4619da9368184097b0498e07a1420143/users/abf8779957ba4ab7ac76de2f481ede86/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.455363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 803/1606] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:38 2022] PUT /identity/v3/projects/2ab7cc9738594ece9afbe0b1cc2a7ff9/users/05310022dc69434fb8c4fa41f833abe9/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:38.459947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac93b9-a28a-4d15-a7c4-797c4d81c0a4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.459947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac93b9-a28a-4d15-a7c4-797c4d81c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.459947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac93b9-a28a-4d15-a7c4-797c4d81c0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.460732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56518856-f67a-493b-89ff-6b989b750aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4619da9368184097b0498e07a1420143, user_id=abf8779957ba4ab7ac76de2f481ede86, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:38.463474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56518856-f67a-493b-89ff-6b989b750aa3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:38.490872 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ffac93b9-a28a-4d15-a7c4-797c4d81c0a4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:38.492687 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ffac93b9-a28a-4d15-a7c4-797c4d81c0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.556813 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 804/1607] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:38.558120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653204d-ceeb-44f6-b286-5a6cdc5808f5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.558407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653204d-ceeb-44f6-b286-5a6cdc5808f5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.558678 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653204d-ceeb-44f6-b286-5a6cdc5808f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.582762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b653204d-ceeb-44f6-b286-5a6cdc5808f5 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:38.584564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b653204d-ceeb-44f6-b286-5a6cdc5808f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.593828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 805/1608] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:38.594681 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653204d-ceeb-44f6-b286-5a6cdc5808f5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:38.604010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 804/1609] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:38 2022] PUT /identity/v3/projects/4619da9368184097b0498e07a1420143/users/abf8779957ba4ab7ac76de2f481ede86/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:38.604010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56518856-f67a-493b-89ff-6b989b750aa3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:38.660925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653204d-ceeb-44f6-b286-5a6cdc5808f5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:38.676058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56518856-f67a-493b-89ff-6b989b750aa3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:38.684255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec1f6d-feb5-4a68-9d9b-16cd70e899de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:38.685247 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1f6d-feb5-4a68-9d9b-16cd70e899de service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.685742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1f6d-feb5-4a68-9d9b-16cd70e899de service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.686271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec1f6d-feb5-4a68-9d9b-16cd70e899de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.707404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:38.745091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419863ed-918a-474b-a357-e19e8721584b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:38.746323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419863ed-918a-474b-a357-e19e8721584b service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.748867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419863ed-918a-474b-a357-e19e8721584b service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.749217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419863ed-918a-474b-a357-e19e8721584b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.778244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec1f6d-feb5-4a68-9d9b-16cd70e899de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:38.781127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec1f6d-feb5-4a68-9d9b-16cd70e899de service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:38.796792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 805/1610] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:38.798469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2245b5-e031-48de-b839-65874be48bc9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.798784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2245b5-e031-48de-b839-65874be48bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.799134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2245b5-e031-48de-b839-65874be48bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.840654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419863ed-918a-474b-a357-e19e8721584b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:38.841114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5d2245b5-e031-48de-b839-65874be48bc9 None None] MFA Rules not processed for user `c5b4a1b1c71041629a8e8c25ebdacbbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:38.843257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5d2245b5-e031-48de-b839-65874be48bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.843568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419863ed-918a-474b-a357-e19e8721584b service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:38.848110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:38.863518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 806/1611] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:38.865864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021f516-6f46-46fb-b651-7719cd614389 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.866381 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021f516-6f46-46fb-b651-7719cd614389 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.867396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021f516-6f46-46fb-b651-7719cd614389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.907502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4021f516-6f46-46fb-b651-7719cd614389 None None] MFA Rules not processed for user `05310022dc69434fb8c4fa41f833abe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:38.908846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4021f516-6f46-46fb-b651-7719cd614389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.935622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 806/1612] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:38.937233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2245b5-e031-48de-b839-65874be48bc9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:38.944159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5d2245b5-e031-48de-b839-65874be48bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:38.966437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2245b5-e031-48de-b839-65874be48bc9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:38.970833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735548f8-59c4-4e4b-9e23-7656d7518904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:38.971581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735548f8-59c4-4e4b-9e23-7656d7518904 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:38.972039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735548f8-59c4-4e4b-9e23-7656d7518904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:38.972978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735548f8-59c4-4e4b-9e23-7656d7518904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:38.992031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735548f8-59c4-4e4b-9e23-7656d7518904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:38.992031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735548f8-59c4-4e4b-9e23-7656d7518904 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:39.026407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 807/1613] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:39.026407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735548f8-59c4-4e4b-9e23-7656d7518904 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:39.038395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 807/1614] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:39.040978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa04e89-f157-4903-a2c6-851bec14a8e3 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.041930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa04e89-f157-4903-a2c6-851bec14a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.042420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa04e89-f157-4903-a2c6-851bec14a8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.048555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735548f8-59c4-4e4b-9e23-7656d7518904 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:39.057395 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbdb85-e2b1-4290-97e3-304e1d2b48fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:39.059180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbdb85-e2b1-4290-97e3-304e1d2b48fc service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.059810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbdb85-e2b1-4290-97e3-304e1d2b48fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.062157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbdb85-e2b1-4290-97e3-304e1d2b48fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.088946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbdb85-e2b1-4290-97e3-304e1d2b48fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:39.092207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbdb85-e2b1-4290-97e3-304e1d2b48fc service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:39.118495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 808/1615] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:39.122016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a6334-a30d-43d9-9c6c-081b318c5131 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.122699 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a6334-a30d-43d9-9c6c-081b318c5131 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.123562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a6334-a30d-43d9-9c6c-081b318c5131 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.126817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 809/1616] 10.222.0.15 () {54 vars in 962 bytes} [Thu Sep 1 16:35:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:35:39.143324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5fa04e89-f157-4903-a2c6-851bec14a8e3 None None] MFA Rules not processed for user `abf8779957ba4ab7ac76de2f481ede86`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:39.145219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd7228-f63f-4f68-bf16-ecc73bf28c2b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.145367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5fa04e89-f157-4903-a2c6-851bec14a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:39.147346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd7228-f63f-4f68-bf16-ecc73bf28c2b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.148004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd7228-f63f-4f68-bf16-ecc73bf28c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.236002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0fbd7228-f63f-4f68-bf16-ecc73bf28c2b None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:39.237673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0fbd7228-f63f-4f68-bf16-ecc73bf28c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:39.259714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:39.276002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 808/1617] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:39.277937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a279085-f314-4d18-b29b-5f36d33b9894 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.278223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a279085-f314-4d18-b29b-5f36d33b9894 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.278498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a279085-f314-4d18-b29b-5f36d33b9894 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.280282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 809/1618] 10.222.0.15 () {54 vars in 962 bytes} [Thu Sep 1 16:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:35:39.280843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a279085-f314-4d18-b29b-5f36d33b9894 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:39.299084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a279085-f314-4d18-b29b-5f36d33b9894 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:39.306966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b3067-2951-47e1-95e3-cd1eaecd8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:39.307756 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b3067-2951-47e1-95e3-cd1eaecd8ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.308172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b3067-2951-47e1-95e3-cd1eaecd8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.308673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b3067-2951-47e1-95e3-cd1eaecd8ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.309076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b3067-2951-47e1-95e3-cd1eaecd8ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:39.311391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b3067-2951-47e1-95e3-cd1eaecd8ee3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:39.378645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 810/1619] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Sep 1 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:39.381038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4c1ac-496a-4169-9a76-c70e91c2be51 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.382198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4c1ac-496a-4169-9a76-c70e91c2be51 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.382198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4c1ac-496a-4169-9a76-c70e91c2be51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.419157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ece4c1ac-496a-4169-9a76-c70e91c2be51 None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:39.421537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ece4c1ac-496a-4169-9a76-c70e91c2be51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:39.438105 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 811/1620] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Sep 1 16:35:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:39.438841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4c1ac-496a-4169-9a76-c70e91c2be51 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:39.440668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 810/1621] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:39 2022] POST /identity/v3/projects => generated 405 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:39.445907 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b3067-2951-47e1-95e3-cd1eaecd8ee3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:39.479554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4c1ac-496a-4169-9a76-c70e91c2be51 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:39.617116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b3067-2951-47e1-95e3-cd1eaecd8ee3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:39.624363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac490f-cc7f-4b71-abdf-94f65f725ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:39.625105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac490f-cc7f-4b71-abdf-94f65f725ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.632541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac490f-cc7f-4b71-abdf-94f65f725ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.632541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac490f-cc7f-4b71-abdf-94f65f725ccd admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.632541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac490f-cc7f-4b71-abdf-94f65f725ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:39.639759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac490f-cc7f-4b71-abdf-94f65f725ccd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:39.673739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:39.716786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a9caa-10c4-4680-a32b-76cd675f34fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:39.719713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a9caa-10c4-4680-a32b-76cd675f34fd service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.720361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a9caa-10c4-4680-a32b-76cd675f34fd service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.720746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a9caa-10c4-4680-a32b-76cd675f34fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.819403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 811/1622] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:39 2022] POST /identity/v3/users => generated 309 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:35:39.821150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac490f-cc7f-4b71-abdf-94f65f725ccd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:39.851769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac490f-cc7f-4b71-abdf-94f65f725ccd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:39.870634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df1a04-7ea2-432d-94b9-d9031ad996c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:39.871957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df1a04-7ea2-432d-94b9-d9031ad996c5 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:39.872485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df1a04-7ea2-432d-94b9-d9031ad996c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:39.873301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df1a04-7ea2-432d-94b9-d9031ad996c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:39.952876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a9caa-10c4-4680-a32b-76cd675f34fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:39.954632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a9caa-10c4-4680-a32b-76cd675f34fd service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:39.978955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 812/1623] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:39.980149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a9caa-10c4-4680-a32b-76cd675f34fd service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:40.016859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a9caa-10c4-4680-a32b-76cd675f34fd service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:40.024894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e852a0d-461f-4077-8d7c-9f562780fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:40.031092 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e852a0d-461f-4077-8d7c-9f562780fd6e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:40.031092 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e852a0d-461f-4077-8d7c-9f562780fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:40.031092 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e852a0d-461f-4077-8d7c-9f562780fd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:40.031092 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e852a0d-461f-4077-8d7c-9f562780fd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:40.031092 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e852a0d-461f-4077-8d7c-9f562780fd6e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:40.068247 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 813/1624] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:40.069846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e852a0d-461f-4077-8d7c-9f562780fd6e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:40.073698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df1a04-7ea2-432d-94b9-d9031ad996c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:40.079777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df1a04-7ea2-432d-94b9-d9031ad996c5 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:40.106756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e852a0d-461f-4077-8d7c-9f562780fd6e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:40.125452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 812/1625] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:40.130530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28426a26-53f3-4382-bd04-73eb19e85dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:40.132216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28426a26-53f3-4382-bd04-73eb19e85dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:40.135987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28426a26-53f3-4382-bd04-73eb19e85dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:40.136518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28426a26-53f3-4382-bd04-73eb19e85dbc admin admin] PATH_INFO: `/v3/projects/8b4e7fb92aff4f2da3f5cc28321ab4f6/users/3dd5ae406ebc4fe0aee87c165c073511/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:40.198923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28426a26-53f3-4382-bd04-73eb19e85dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4e7fb92aff4f2da3f5cc28321ab4f6, user_id=3dd5ae406ebc4fe0aee87c165c073511, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:40.203004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28426a26-53f3-4382-bd04-73eb19e85dbc admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:40.296333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 814/1626] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:40 2022] PUT /identity/v3/projects/8b4e7fb92aff4f2da3f5cc28321ab4f6/users/3dd5ae406ebc4fe0aee87c165c073511/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:40.301899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df1a04-7ea2-432d-94b9-d9031ad996c5 service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:40.325105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df1a04-7ea2-432d-94b9-d9031ad996c5 service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:40.530972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551857e-3495-42df-9cb4-7d36d8941542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:40.532006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551857e-3495-42df-9cb4-7d36d8941542 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:40.533984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551857e-3495-42df-9cb4-7d36d8941542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:40.534422 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551857e-3495-42df-9cb4-7d36d8941542 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:40.537838 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551857e-3495-42df-9cb4-7d36d8941542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:40.539823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551857e-3495-42df-9cb4-7d36d8941542 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:40.581376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548af39f-6090-4996-8905-604b7a2f95a0 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:40.581787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548af39f-6090-4996-8905-604b7a2f95a0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:40.582173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548af39f-6090-4996-8905-604b7a2f95a0 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:40.584426 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 815/1627] 10.222.0.15 () {54 vars in 912 bytes} [Thu Sep 1 16:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:35:40.587057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 813/1628] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:35:40.592084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548af39f-6090-4996-8905-604b7a2f95a0 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:40.600011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cefcb5-bf58-4ced-83d4-7bf8df9433e1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:40.600011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cefcb5-bf58-4ced-83d4-7bf8df9433e1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:40.600011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cefcb5-bf58-4ced-83d4-7bf8df9433e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:40.609326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:40.625945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b1cefcb5-bf58-4ced-83d4-7bf8df9433e1 None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:40.627519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b1cefcb5-bf58-4ced-83d4-7bf8df9433e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:40.644003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548af39f-6090-4996-8905-604b7a2f95a0 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:40.654654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fe229-6cc2-4149-addd-c70d2f673f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:40.655983 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fe229-6cc2-4149-addd-c70d2f673f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:40.655983 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fe229-6cc2-4149-addd-c70d2f673f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:40.659896 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fe229-6cc2-4149-addd-c70d2f673f40 admin admin] PATH_INFO: `/v3/projects/8b4e7fb92aff4f2da3f5cc28321ab4f6/users/3dd5ae406ebc4fe0aee87c165c073511/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:40.660484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fe229-6cc2-4149-addd-c70d2f673f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4e7fb92aff4f2da3f5cc28321ab4f6, user_id=3dd5ae406ebc4fe0aee87c165c073511, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:40.680307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fe229-6cc2-4149-addd-c70d2f673f40 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:40.711869 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 816/1629] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:40 2022] PUT /identity/v3/projects/8b4e7fb92aff4f2da3f5cc28321ab4f6/users/3dd5ae406ebc4fe0aee87c165c073511/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:35:40.731569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afea53-c1aa-488b-b41f-fb6f2d0d0c79 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:40.731928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afea53-c1aa-488b-b41f-fb6f2d0d0c79 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:40.732982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afea53-c1aa-488b-b41f-fb6f2d0d0c79 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:40.740547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 817/1630] 10.222.0.15 () {54 vars in 912 bytes} [Thu Sep 1 16:35:40 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:35:40.745964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5f388-afe3-4ed2-b2aa-56765ef0613d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:40.745964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5f388-afe3-4ed2-b2aa-56765ef0613d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:40.745964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5f388-afe3-4ed2-b2aa-56765ef0613d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:40.799060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 814/1631] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:40.801449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1ca9-d381-463a-95b9-e3d8f266f0df None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:40.802219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1ca9-d381-463a-95b9-e3d8f266f0df None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:40.803460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e1ca9-d381-463a-95b9-e3d8f266f0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:40.804875 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b4e5f388-afe3-4ed2-b2aa-56765ef0613d None None] MFA Rules not processed for user `3dd5ae406ebc4fe0aee87c165c073511`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:40.807895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b4e5f388-afe3-4ed2-b2aa-56765ef0613d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:40.828745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c04e1ca9-d381-463a-95b9-e3d8f266f0df None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:40.831374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c04e1ca9-d381-463a-95b9-e3d8f266f0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:40.920513 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 818/1632] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:40.923472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5f388-afe3-4ed2-b2aa-56765ef0613d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:40.994267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:41.104210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 815/1633] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:35:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:41.104210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e1ca9-d381-463a-95b9-e3d8f266f0df None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:41.137707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5f388-afe3-4ed2-b2aa-56765ef0613d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:41.143450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3faa1-0a60-4256-aeff-4fa1628fa960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:41.143450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3faa1-0a60-4256-aeff-4fa1628fa960 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:41.143450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3faa1-0a60-4256-aeff-4fa1628fa960 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:41.146603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3faa1-0a60-4256-aeff-4fa1628fa960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:41.160042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3faa1-0a60-4256-aeff-4fa1628fa960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:41.162915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3faa1-0a60-4256-aeff-4fa1628fa960 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:41.185205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 819/1634] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:41.278811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e1ca9-d381-463a-95b9-e3d8f266f0df None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:41.293449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470b9f3-f5c5-4b8c-bcf7-c6b156e36b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:41.294230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470b9f3-f5c5-4b8c-bcf7-c6b156e36b59 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:41.294798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470b9f3-f5c5-4b8c-bcf7-c6b156e36b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:41.294918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470b9f3-f5c5-4b8c-bcf7-c6b156e36b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:41.321713 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470b9f3-f5c5-4b8c-bcf7-c6b156e36b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:41.325828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470b9f3-f5c5-4b8c-bcf7-c6b156e36b59 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:41.344436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 816/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:41 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:41.476005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3faa1-0a60-4256-aeff-4fa1628fa960 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:41.492563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3faa1-0a60-4256-aeff-4fa1628fa960 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:41.512079 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa45ea-5803-4ecf-be19-87c8bb667d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:41.515236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa45ea-5803-4ecf-be19-87c8bb667d20 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:41.915232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa45ea-5803-4ecf-be19-87c8bb667d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:41.915232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa45ea-5803-4ecf-be19-87c8bb667d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:41.915232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa45ea-5803-4ecf-be19-87c8bb667d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:41.915232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa45ea-5803-4ecf-be19-87c8bb667d20 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:41.915232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 820/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:43.158770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470b9f3-f5c5-4b8c-bcf7-c6b156e36b59 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:43.247054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:43.304033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470b9f3-f5c5-4b8c-bcf7-c6b156e36b59 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:43.311422 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:43.312767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:43.313278 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:43.313775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] PATH_INFO: `/v3/users/abf8779957ba4ab7ac76de2f481ede86` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:43.315658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf8779957ba4ab7ac76de2f481ede86)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:43.319048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:43.721409 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf8779957ba4ab7ac76de2f481ede86'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:43.758080 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf8779957ba4ab7ac76de2f481ede86'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:43.760079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf8779957ba4ab7ac76de2f481ede86'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:44.356269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf8779957ba4ab7ac76de2f481ede86'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:44.357865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf8779957ba4ab7ac76de2f481ede86'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:44.421447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 817/1637] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:43 2022] DELETE /identity/v3/users/abf8779957ba4ab7ac76de2f481ede86 => generated 0 bytes in 1263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:44.429282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ffb60-e570-487e-bb64-d120279640c4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:44.430685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ffb60-e570-487e-bb64-d120279640c4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:44.431182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ffb60-e570-487e-bb64-d120279640c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:44.492302 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ba9ffb60-e570-487e-bb64-d120279640c4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:44.494169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ba9ffb60-e570-487e-bb64-d120279640c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:44.613257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 821/1638] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:44.632925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:44.634514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:44.734945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38cc4e9-dd07-43fa-9a99-a3e2049e0425 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:44.741990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be723f-854d-4a85-b0a8-1bc58d7bf4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:44.751212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be723f-854d-4a85-b0a8-1bc58d7bf4ba service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:44.751212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be723f-854d-4a85-b0a8-1bc58d7bf4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:44.751212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be723f-854d-4a85-b0a8-1bc58d7bf4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:44.755572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be723f-854d-4a85-b0a8-1bc58d7bf4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:44.757411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be723f-854d-4a85-b0a8-1bc58d7bf4ba service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:44.781657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 818/1639] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:35:46.498808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ffb60-e570-487e-bb64-d120279640c4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:46.518824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ba9ffb60-e570-487e-bb64-d120279640c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:46.566641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ffb60-e570-487e-bb64-d120279640c4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:46.577674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:46.579028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:46.579320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:46.580166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] PATH_INFO: `/v3/projects/4619da9368184097b0498e07a1420143` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:46.581852 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4619da9368184097b0498e07a1420143)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:46.593027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:46.840346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4619da9368184097b0498e07a1420143', 'request_id': 'req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:46.851254 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4619da9368184097b0498e07a1420143', 'request_id': 'req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:46.932655 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4619da9368184097b0498e07a1420143', 'request_id': 'req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:46.964096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] The token cache is being invalidate because project 4619da9368184097b0498e07a1420143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:46.965110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:46.966296 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:46.969558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 822/1640] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:46 2022] DELETE /identity/v3/projects/4619da9368184097b0498e07a1420143 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:46.973846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be723f-854d-4a85-b0a8-1bc58d7bf4ba service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:46.986751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be723f-854d-4a85-b0a8-1bc58d7bf4ba service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:47.209562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:47.247702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280bd55-f110-4489-bf96-44da995aa8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:47.248958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280bd55-f110-4489-bf96-44da995aa8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:47.249392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280bd55-f110-4489-bf96-44da995aa8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:47.249819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280bd55-f110-4489-bf96-44da995aa8a0 admin admin] PATH_INFO: `/v3/users/3dd5ae406ebc4fe0aee87c165c073511` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:47.252580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280bd55-f110-4489-bf96-44da995aa8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd5ae406ebc4fe0aee87c165c073511)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:47.254573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280bd55-f110-4489-bf96-44da995aa8a0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:47.629951 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:47.631877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:47.677805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205ba81-28d9-4c93-b65a-a0a9fa1210d3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:47.703399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:47.709932 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:47.709932 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:47.711319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] PATH_INFO: `/v3/users/c5b4a1b1c71041629a8e8c25ebdacbbc` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:47.719989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d280bd55-f110-4489-bf96-44da995aa8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd5ae406ebc4fe0aee87c165c073511'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.727753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b4a1b1c71041629a8e8c25ebdacbbc)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:47.732459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: WARNING py.warnings [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:35:47.732459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: warnings.warn(msg) Sep 01 16:35:47.732459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: Sep 01 16:35:47.735617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:47.745446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d280bd55-f110-4489-bf96-44da995aa8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd5ae406ebc4fe0aee87c165c073511'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.747547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d280bd55-f110-4489-bf96-44da995aa8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd5ae406ebc4fe0aee87c165c073511'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.843753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d280bd55-f110-4489-bf96-44da995aa8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd5ae406ebc4fe0aee87c165c073511'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.846231 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d280bd55-f110-4489-bf96-44da995aa8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd5ae406ebc4fe0aee87c165c073511'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:47.904895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 819/1641] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:46 2022] DELETE /identity/v3/users/3dd5ae406ebc4fe0aee87c165c073511 => generated 0 bytes in 929 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:48.132340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:48.159004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b4a1b1c71041629a8e8c25ebdacbbc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:48.190658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b4a1b1c71041629a8e8c25ebdacbbc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:48.194955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b4a1b1c71041629a8e8c25ebdacbbc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:48.339541 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b4a1b1c71041629a8e8c25ebdacbbc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:48.433800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b4a1b1c71041629a8e8c25ebdacbbc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:48.450670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 823/1642] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:47 2022] DELETE /identity/v3/users/c5b4a1b1c71041629a8e8c25ebdacbbc => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:48.452326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4433695-c6e6-462c-a525-b4a0cf1c9bea None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:48.452848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4433695-c6e6-462c-a525-b4a0cf1c9bea None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:48.453239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4433695-c6e6-462c-a525-b4a0cf1c9bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:48.528323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c4433695-c6e6-462c-a525-b4a0cf1c9bea None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:48.530209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c4433695-c6e6-462c-a525-b4a0cf1c9bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:48.722191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 820/1643] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:35:49.019132 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:49.024398 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:49.185606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68e9ed-851d-40ea-b373-d3e1df674f0e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:49.196174 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789332e4-1420-4e94-8fcc-bdd97f7abf3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:49.196854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789332e4-1420-4e94-8fcc-bdd97f7abf3c service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:49.197293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789332e4-1420-4e94-8fcc-bdd97f7abf3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:49.197797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789332e4-1420-4e94-8fcc-bdd97f7abf3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:49.234507 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789332e4-1420-4e94-8fcc-bdd97f7abf3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:49.263124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789332e4-1420-4e94-8fcc-bdd97f7abf3c service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:49.281952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 824/1644] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:52.385369 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4433695-c6e6-462c-a525-b4a0cf1c9bea None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:52.387739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c4433695-c6e6-462c-a525-b4a0cf1c9bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:52.401202 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789332e4-1420-4e94-8fcc-bdd97f7abf3c service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:52.402970 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-789332e4-1420-4e94-8fcc-bdd97f7abf3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:52.433731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4433695-c6e6-462c-a525-b4a0cf1c9bea None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:52.437599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789332e4-1420-4e94-8fcc-bdd97f7abf3c service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:52.450571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:52.452367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.453343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.454645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] PATH_INFO: `/v3/users/05310022dc69434fb8c4fa41f833abe9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.456475 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:52.457191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:52.457478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:52.457749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] PATH_INFO: `/v3/projects/8b4e7fb92aff4f2da3f5cc28321ab4f6` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:52.462233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05310022dc69434fb8c4fa41f833abe9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:52.466033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4e7fb92aff4f2da3f5cc28321ab4f6)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:52.469163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:52.470424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:52.909205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05310022dc69434fb8c4fa41f833abe9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:52.932915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4e7fb92aff4f2da3f5cc28321ab4f6', 'request_id': 'req-7876b494-b23b-4f91-8e9a-d741c8a84ff7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:52.960917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05310022dc69434fb8c4fa41f833abe9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:52.962717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05310022dc69434fb8c4fa41f833abe9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:52.966242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4e7fb92aff4f2da3f5cc28321ab4f6', 'request_id': 'req-7876b494-b23b-4f91-8e9a-d741c8a84ff7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:53.122060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05310022dc69434fb8c4fa41f833abe9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:53.125871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05310022dc69434fb8c4fa41f833abe9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:53.132832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:53.191438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 821/1645] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:35:52 2022] DELETE /identity/v3/users/05310022dc69434fb8c4fa41f833abe9 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:53.196276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4e7fb92aff4f2da3f5cc28321ab4f6', 'request_id': 'req-7876b494-b23b-4f91-8e9a-d741c8a84ff7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:53.197449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.200986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:53.225241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] The token cache is being invalidate because project 8b4e7fb92aff4f2da3f5cc28321ab4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:53.226421 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:53.227688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7876b494-b23b-4f91-8e9a-d741c8a84ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:53.230698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 825/1646] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:52 2022] DELETE /identity/v3/projects/8b4e7fb92aff4f2da3f5cc28321ab4f6 => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:35:53.233094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a813021-aec3-4466-a316-df92e820a3da None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.233233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a813021-aec3-4466-a316-df92e820a3da None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.233714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a813021-aec3-4466-a316-df92e820a3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.268515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8a813021-aec3-4466-a316-df92e820a3da None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:53.270478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8a813021-aec3-4466-a316-df92e820a3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:53.345099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:53.399617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b1c2-d00f-44f0-af2e-4eb2278af5c5 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.415173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.416915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.419313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.423491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] PATH_INFO: `/v3/projects/572d466ea837460290b7b601f1a9fdbd` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.424534 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572d466ea837460290b7b601f1a9fdbd)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.425862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: WARNING py.warnings [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 16:35:53.425862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: warnings.warn(msg) Sep 01 16:35:53.425862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: Sep 01 16:35:53.431588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:53.496579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 826/1647] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:53.500799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bd08c-6cd6-426c-9043-cf5e1bd8846a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.501389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bd08c-6cd6-426c-9043-cf5e1bd8846a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.501868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bd08c-6cd6-426c-9043-cf5e1bd8846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.595813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ce7bd08c-6cd6-426c-9043-cf5e1bd8846a None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:53.598243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ce7bd08c-6cd6-426c-9043-cf5e1bd8846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:53.619309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 827/1648] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:53.629860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996590fb-f14a-4d7c-a7bb-01f7e70d5f76 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.630504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996590fb-f14a-4d7c-a7bb-01f7e70d5f76 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.630806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996590fb-f14a-4d7c-a7bb-01f7e70d5f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.676752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-996590fb-f14a-4d7c-a7bb-01f7e70d5f76 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:53.678257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-996590fb-f14a-4d7c-a7bb-01f7e70d5f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:53.711105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572d466ea837460290b7b601f1a9fdbd', 'request_id': 'req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:53.760616 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572d466ea837460290b7b601f1a9fdbd', 'request_id': 'req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:53.782780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572d466ea837460290b7b601f1a9fdbd', 'request_id': 'req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:53.886447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 828/1649] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:53.891790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996590fb-f14a-4d7c-a7bb-01f7e70d5f76 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.898833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-996590fb-f14a-4d7c-a7bb-01f7e70d5f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:53.906627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] The token cache is being invalidate because project 572d466ea837460290b7b601f1a9fdbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:53.907766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:53.918815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:53.921631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 822/1650] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:53 2022] DELETE /identity/v3/projects/572d466ea837460290b7b601f1a9fdbd => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:53.923033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:53.928675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:53.966445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4cb6b-b2b2-45ee-a20a-22aa8fe32642 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:53.982212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0697ab-4bd9-4435-9b81-ce580d9a21c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:53.982862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0697ab-4bd9-4435-9b81-ce580d9a21c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:53.983209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0697ab-4bd9-4435-9b81-ce580d9a21c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:53.983628 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0697ab-4bd9-4435-9b81-ce580d9a21c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:53.984638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0697ab-4bd9-4435-9b81-ce580d9a21c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:53.985101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0697ab-4bd9-4435-9b81-ce580d9a21c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:53.987774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0697ab-4bd9-4435-9b81-ce580d9a21c0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:54.028117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 823/1651] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:54.032941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f4bb1-9210-4303-a9e2-883f3e891566 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.033227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f4bb1-9210-4303-a9e2-883f3e891566 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.033702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f4bb1-9210-4303-a9e2-883f3e891566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.088005 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1a9f4bb1-9210-4303-a9e2-883f3e891566 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:54.089626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1a9f4bb1-9210-4303-a9e2-883f3e891566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:54.118870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 824/1652] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:54.126236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f4bb1-9210-4303-a9e2-883f3e891566 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:54.145225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9f4bb1-9210-4303-a9e2-883f3e891566 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:54.163086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f39ac3-a4ba-43c5-b31c-5e21a310aab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:54.165672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39ac3-a4ba-43c5-b31c-5e21a310aab8 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.169717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39ac3-a4ba-43c5-b31c-5e21a310aab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.170412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f39ac3-a4ba-43c5-b31c-5e21a310aab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.174184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f39ac3-a4ba-43c5-b31c-5e21a310aab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:54.183471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f39ac3-a4ba-43c5-b31c-5e21a310aab8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:54.189116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996590fb-f14a-4d7c-a7bb-01f7e70d5f76 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:54.204998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8ee1-0b3e-470e-88cf-e8021da2bcbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:54.206473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8ee1-0b3e-470e-88cf-e8021da2bcbc service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.206978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8ee1-0b3e-470e-88cf-e8021da2bcbc service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.207579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8ee1-0b3e-470e-88cf-e8021da2bcbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.216602 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fdaf8ee1-0b3e-470e-88cf-e8021da2bcbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:54.267817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf8ee1-0b3e-470e-88cf-e8021da2bcbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:54.270297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf8ee1-0b3e-470e-88cf-e8021da2bcbc service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:54.289387 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 829/1653] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:54.291526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20234e50-cdb7-4598-aa6e-b362b15b4a00 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.292161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20234e50-cdb7-4598-aa6e-b362b15b4a00 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.292652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20234e50-cdb7-4598-aa6e-b362b15b4a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.336259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-20234e50-cdb7-4598-aa6e-b362b15b4a00 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:54.337836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-20234e50-cdb7-4598-aa6e-b362b15b4a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:54.355200 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 830/1654] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:54.361379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20234e50-cdb7-4598-aa6e-b362b15b4a00 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:54.401114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20234e50-cdb7-4598-aa6e-b362b15b4a00 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:54.423358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79ed68-80a7-4c55-8a8f-1897d2e96d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:54.424451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79ed68-80a7-4c55-8a8f-1897d2e96d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.424961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79ed68-80a7-4c55-8a8f-1897d2e96d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.426691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79ed68-80a7-4c55-8a8f-1897d2e96d66 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.429367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79ed68-80a7-4c55-8a8f-1897d2e96d66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:54.432558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 825/1655] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:54 2022] POST /identity/v3/projects => generated 371 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:54.433104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79ed68-80a7-4c55-8a8f-1897d2e96d66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:54.438788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f39ac3-a4ba-43c5-b31c-5e21a310aab8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:54.439779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79ed68-80a7-4c55-8a8f-1897d2e96d66 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:54.523584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 831/1656] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:35:54.526329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79ed68-80a7-4c55-8a8f-1897d2e96d66 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:54.569043 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79ed68-80a7-4c55-8a8f-1897d2e96d66 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:54.607971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8ffda-35d1-44b0-9db3-dba9eda4358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:54.618877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8ffda-35d1-44b0-9db3-dba9eda4358b admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.618877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8ffda-35d1-44b0-9db3-dba9eda4358b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.618877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8ffda-35d1-44b0-9db3-dba9eda4358b admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.618877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8ffda-35d1-44b0-9db3-dba9eda4358b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:54.626517 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8ffda-35d1-44b0-9db3-dba9eda4358b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:54.634934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f39ac3-a4ba-43c5-b31c-5e21a310aab8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:54.656821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a31ca-4551-45fd-bc99-22bd983df611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:54.658769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a31ca-4551-45fd-bc99-22bd983df611 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:54.659646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a31ca-4551-45fd-bc99-22bd983df611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:54.660814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a31ca-4551-45fd-bc99-22bd983df611 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:54.666101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a31ca-4551-45fd-bc99-22bd983df611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:54.678994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a31ca-4551-45fd-bc99-22bd983df611 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:54.909208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 832/1657] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:54 2022] POST /identity/v3/projects => generated 373 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:54.912221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8ffda-35d1-44b0-9db3-dba9eda4358b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.019822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 826/1658] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:54 2022] POST /identity/v3/users => generated 286 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:35:55.022443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a31ca-4551-45fd-bc99-22bd983df611 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.040483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a31ca-4551-45fd-bc99-22bd983df611 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:55.119534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8ffda-35d1-44b0-9db3-dba9eda4358b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:55.142082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f0995-2bfb-4ac1-9a2d-d33bc351a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.151050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f0995-2bfb-4ac1-9a2d-d33bc351a768 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.151050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f0995-2bfb-4ac1-9a2d-d33bc351a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.151050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f0995-2bfb-4ac1-9a2d-d33bc351a768 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.151050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f0995-2bfb-4ac1-9a2d-d33bc351a768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.151050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f0995-2bfb-4ac1-9a2d-d33bc351a768 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.206036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b50ed8-cc34-4894-93d0-3d177910cd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.206692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b50ed8-cc34-4894-93d0-3d177910cd74 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.206973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b50ed8-cc34-4894-93d0-3d177910cd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.207245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b50ed8-cc34-4894-93d0-3d177910cd74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.207911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b50ed8-cc34-4894-93d0-3d177910cd74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.209794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b50ed8-cc34-4894-93d0-3d177910cd74 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.251214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 827/1659] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:35:55.252537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b50ed8-cc34-4894-93d0-3d177910cd74 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.277559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b50ed8-cc34-4894-93d0-3d177910cd74 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:55.290845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:55.306144 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97831-419d-42c9-b813-a23e46a1fc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.306795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97831-419d-42c9-b813-a23e46a1fc1f admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.307101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97831-419d-42c9-b813-a23e46a1fc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.307342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97831-419d-42c9-b813-a23e46a1fc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.308002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae97831-419d-42c9-b813-a23e46a1fc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.317126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae97831-419d-42c9-b813-a23e46a1fc1f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.346651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 833/1660] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:54 2022] POST /identity/v3/users => generated 287 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:55.350395 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f0995-2bfb-4ac1-9a2d-d33bc351a768 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.363116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 828/1661] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:35:55.369043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97831-419d-42c9-b813-a23e46a1fc1f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.393485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97831-419d-42c9-b813-a23e46a1fc1f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:55.423801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a248ff-380e-4cf3-8146-8e5a79d60d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.426525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a248ff-380e-4cf3-8146-8e5a79d60d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.430529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a248ff-380e-4cf3-8146-8e5a79d60d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.432555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a248ff-380e-4cf3-8146-8e5a79d60d17 admin admin] PATH_INFO: `/v3/projects/410c3831d5864c979d4e5346d50a7b44/users/be0faffadacb46dd9f322105675053d1/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.435449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f0995-2bfb-4ac1-9a2d-d33bc351a768 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:55.463177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b70e32-4535-472e-817e-958b0e0324d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.464310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70e32-4535-472e-817e-958b0e0324d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.466316 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70e32-4535-472e-817e-958b0e0324d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.466880 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b70e32-4535-472e-817e-958b0e0324d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.471324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b70e32-4535-472e-817e-958b0e0324d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.473697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b70e32-4535-472e-817e-958b0e0324d7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.526410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a248ff-380e-4cf3-8146-8e5a79d60d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410c3831d5864c979d4e5346d50a7b44, user_id=be0faffadacb46dd9f322105675053d1, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.530759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a248ff-380e-4cf3-8146-8e5a79d60d17 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.546125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 834/1662] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:55.551273 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b70e32-4535-472e-817e-958b0e0324d7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.581040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b70e32-4535-472e-817e-958b0e0324d7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:55.604296 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d17d0-5529-4971-a278-988f0becde6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.605327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d17d0-5529-4971-a278-988f0becde6b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.605692 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d17d0-5529-4971-a278-988f0becde6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.606159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d17d0-5529-4971-a278-988f0becde6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.611035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d17d0-5529-4971-a278-988f0becde6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.615979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d17d0-5529-4971-a278-988f0becde6b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:55.651309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 835/1663] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:55.660694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d17d0-5529-4971-a278-988f0becde6b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:55.676943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 829/1664] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:55 2022] PUT /identity/v3/projects/410c3831d5864c979d4e5346d50a7b44/users/be0faffadacb46dd9f322105675053d1/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:35:55.681093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d17d0-5529-4971-a278-988f0becde6b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:55.704770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8fb27-6c58-4cca-ad9c-8d59fca958db None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.705466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8fb27-6c58-4cca-ad9c-8d59fca958db None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.708160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8fb27-6c58-4cca-ad9c-8d59fca958db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.853990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f4d8fb27-6c58-4cca-ad9c-8d59fca958db None None] MFA Rules not processed for user `be0faffadacb46dd9f322105675053d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:55.859700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f4d8fb27-6c58-4cca-ad9c-8d59fca958db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:55.882210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:55.933410 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23e4c0-6c43-415d-8e09-60c611063128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:55.934300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23e4c0-6c43-415d-8e09-60c611063128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:55.934734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23e4c0-6c43-415d-8e09-60c611063128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:55.936064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23e4c0-6c43-415d-8e09-60c611063128 admin admin] PATH_INFO: `/v3/projects/e7acdd5b97004934948f719d699374f2/users/9656b7469fd042efab53d0edde0837c0/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:55.986183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23e4c0-6c43-415d-8e09-60c611063128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7acdd5b97004934948f719d699374f2, user_id=9656b7469fd042efab53d0edde0837c0, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:55.989146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23e4c0-6c43-415d-8e09-60c611063128 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:56.051185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 830/1665] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:56.058242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8fb27-6c58-4cca-ad9c-8d59fca958db None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:56.069815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 836/1666] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:55 2022] PUT /identity/v3/projects/e7acdd5b97004934948f719d699374f2/users/9656b7469fd042efab53d0edde0837c0/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:56.085806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8fb27-6c58-4cca-ad9c-8d59fca958db None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:56.089273 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152935f7-2648-458e-872d-c252ab6f3612 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:56.089714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152935f7-2648-458e-872d-c252ab6f3612 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:56.090146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152935f7-2648-458e-872d-c252ab6f3612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:56.171040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-152935f7-2648-458e-872d-c252ab6f3612 None None] MFA Rules not processed for user `9656b7469fd042efab53d0edde0837c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:56.172423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-152935f7-2648-458e-872d-c252ab6f3612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:56.263674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8409-2c12-43b7-8494-861c7cf45ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:56.264777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8409-2c12-43b7-8494-861c7cf45ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:56.265069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8409-2c12-43b7-8494-861c7cf45ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:56.265395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8409-2c12-43b7-8494-861c7cf45ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:56.279925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab8409-2c12-43b7-8494-861c7cf45ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:56.285971 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab8409-2c12-43b7-8494-861c7cf45ff7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:56.387884 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 837/1667] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:56.392336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152935f7-2648-458e-872d-c252ab6f3612 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:56.412693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152935f7-2648-458e-872d-c252ab6f3612 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:56.432131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf49985-1c44-4044-91ab-41cdc430ce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:56.433017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf49985-1c44-4044-91ab-41cdc430ce09 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:56.433404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf49985-1c44-4044-91ab-41cdc430ce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:56.433797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf49985-1c44-4044-91ab-41cdc430ce09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:56.434716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf49985-1c44-4044-91ab-41cdc430ce09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:56.440015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf49985-1c44-4044-91ab-41cdc430ce09 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:56.518662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 831/1668] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:56 2022] POST /identity/v3/projects => generated 373 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:35:56.522979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8409-2c12-43b7-8494-861c7cf45ff7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:56.537397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-11ab8409-2c12-43b7-8494-861c7cf45ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:56.616257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 838/1669] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:56 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:35:56.621522 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf49985-1c44-4044-91ab-41cdc430ce09 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:56.854955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8409-2c12-43b7-8494-861c7cf45ff7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:56.900285 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf49985-1c44-4044-91ab-41cdc430ce09 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:56.921342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea098414-64f2-407a-bcaa-0aba07d6daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:56.922670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098414-64f2-407a-bcaa-0aba07d6daee admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:56.923486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098414-64f2-407a-bcaa-0aba07d6daee admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:56.924290 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea098414-64f2-407a-bcaa-0aba07d6daee admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:56.925782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea098414-64f2-407a-bcaa-0aba07d6daee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:56.944492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea098414-64f2-407a-bcaa-0aba07d6daee admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:57.035037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:57.035707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:57.036252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:57.059033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] PATH_INFO: `/v3/projects/2ab7cc9738594ece9afbe0b1cc2a7ff9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:57.060514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab7cc9738594ece9afbe0b1cc2a7ff9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:57.064052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:57.103596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 839/1670] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:56 2022] POST /identity/v3/users => generated 293 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:57.104786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea098414-64f2-407a-bcaa-0aba07d6daee admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:57.160297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea098414-64f2-407a-bcaa-0aba07d6daee admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:57.180159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5be99-5398-434d-a797-79bdc1c8f8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:57.180809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5be99-5398-434d-a797-79bdc1c8f8ed admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:57.181093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5be99-5398-434d-a797-79bdc1c8f8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:57.183931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5be99-5398-434d-a797-79bdc1c8f8ed admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:57.184403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5be99-5398-434d-a797-79bdc1c8f8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:57.203407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5be99-5398-434d-a797-79bdc1c8f8ed admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:57.355903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 840/1671] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:57 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:57.355903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5be99-5398-434d-a797-79bdc1c8f8ed admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:57.381391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab7cc9738594ece9afbe0b1cc2a7ff9', 'request_id': 'req-475c584c-b76e-4de5-bbc6-565c0ba79e21'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:57.383082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5be99-5398-434d-a797-79bdc1c8f8ed admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:57.407036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab7cc9738594ece9afbe0b1cc2a7ff9', 'request_id': 'req-475c584c-b76e-4de5-bbc6-565c0ba79e21'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:57.424442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab7cc9738594ece9afbe0b1cc2a7ff9', 'request_id': 'req-475c584c-b76e-4de5-bbc6-565c0ba79e21'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:57.516941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:57.586891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:57.593632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] The token cache is being invalidate because project 2ab7cc9738594ece9afbe0b1cc2a7ff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:35:57.594327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:57.596840 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:35:57.607831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 832/1672] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:35:56 2022] DELETE /identity/v3/projects/2ab7cc9738594ece9afbe0b1cc2a7ff9 => generated 0 bytes in 1089 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:57.627760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:57.627760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:57.628008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7822d68-477a-419b-9843-5edc8ea300e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:57.628008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7822d68-477a-419b-9843-5edc8ea300e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:57.634125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7822d68-477a-419b-9843-5edc8ea300e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:57.635848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7822d68-477a-419b-9843-5edc8ea300e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:57.637255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7822d68-477a-419b-9843-5edc8ea300e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:57.644540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7822d68-477a-419b-9843-5edc8ea300e1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:57.690300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c584c-b76e-4de5-bbc6-565c0ba79e21 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:57.710235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 841/1673] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:57.724027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7159-50c0-4f5e-a1ff-d422994035bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:57.724216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c5b2-a5e3-431c-a278-ce726f562d4e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:57.724216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c5b2-a5e3-431c-a278-ce726f562d4e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:57.724216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1c5b2-a5e3-431c-a278-ce726f562d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:57.726236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7159-50c0-4f5e-a1ff-d422994035bc admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:57.728319 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7159-50c0-4f5e-a1ff-d422994035bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:57.732363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb7159-50c0-4f5e-a1ff-d422994035bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:57.734272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb7159-50c0-4f5e-a1ff-d422994035bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:57.737350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbb7159-50c0-4f5e-a1ff-d422994035bc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:57.809214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 833/1674] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:57.810285 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7159-50c0-4f5e-a1ff-d422994035bc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:57.817064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bcbb7159-50c0-4f5e-a1ff-d422994035bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:57.839007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d2f1c5b2-a5e3-431c-a278-ce726f562d4e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:57.840668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d2f1c5b2-a5e3-431c-a278-ce726f562d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:57.873595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb7159-50c0-4f5e-a1ff-d422994035bc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:57.891512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 842/1675] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:57.894751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1c5b2-a5e3-431c-a278-ce726f562d4e None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:57.912290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c0230-a74b-4036-a835-c4a83b39ca18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:57.912954 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0230-a74b-4036-a835-c4a83b39ca18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:57.913345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0230-a74b-4036-a835-c4a83b39ca18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:57.913811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c0230-a74b-4036-a835-c4a83b39ca18 admin admin] PATH_INFO: `/v3/projects/8e02241ce49749b88911dd1e20d54111/users/88d82971d8f04733ad846b665e914096/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:57.937307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1c5b2-a5e3-431c-a278-ce726f562d4e None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:57.963633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c0230-a74b-4036-a835-c4a83b39ca18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e02241ce49749b88911dd1e20d54111, user_id=88d82971d8f04733ad846b665e914096, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:57.968949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c0230-a74b-4036-a835-c4a83b39ca18 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:57.977432 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaab0c-1ff7-4b76-ab35-52e3e22f99cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:57.978790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaab0c-1ff7-4b76-ab35-52e3e22f99cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:57.978790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaab0c-1ff7-4b76-ab35-52e3e22f99cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:57.979068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbaab0c-1ff7-4b76-ab35-52e3e22f99cc admin admin] PATH_INFO: `/v3/projects/b360da0b6dd24e23a735b14e241927e1/users/990ea4d4b4144feaa99fb6dc9ccbb01b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:58.010066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaab0c-1ff7-4b76-ab35-52e3e22f99cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b360da0b6dd24e23a735b14e241927e1, user_id=990ea4d4b4144feaa99fb6dc9ccbb01b, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:58.034717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbaab0c-1ff7-4b76-ab35-52e3e22f99cc admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:58.090856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 834/1676] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:57 2022] PUT /identity/v3/projects/8e02241ce49749b88911dd1e20d54111/users/88d82971d8f04733ad846b665e914096/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:58.100425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7b74-0838-454f-8ccd-2110e7f1db22 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:58.101928 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7b74-0838-454f-8ccd-2110e7f1db22 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:58.102230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7b74-0838-454f-8ccd-2110e7f1db22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:58.203345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-302e7b74-0838-454f-8ccd-2110e7f1db22 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:58.205860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-302e7b74-0838-454f-8ccd-2110e7f1db22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:58.218624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 843/1677] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:57 2022] PUT /identity/v3/projects/b360da0b6dd24e23a735b14e241927e1/users/990ea4d4b4144feaa99fb6dc9ccbb01b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:58.218624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaab0c-1ff7-4b76-ab35-52e3e22f99cc admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:58.274836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:58.374545 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbaab0c-1ff7-4b76-ab35-52e3e22f99cc admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:58.388449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 835/1678] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:58.393016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e7b74-0838-454f-8ccd-2110e7f1db22 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:58.393990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:58.398179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5434bf6-64af-4aae-b124-2e087650ce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:58.399002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434bf6-64af-4aae-b124-2e087650ce35 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:58.404655 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434bf6-64af-4aae-b124-2e087650ce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:58.405111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434bf6-64af-4aae-b124-2e087650ce35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:58.406533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5434bf6-64af-4aae-b124-2e087650ce35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:58.413675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5434bf6-64af-4aae-b124-2e087650ce35 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:58.431307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e7b74-0838-454f-8ccd-2110e7f1db22 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:58.449576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61ce62-4e70-42e1-86ca-e5745513fe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:58.450416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61ce62-4e70-42e1-86ca-e5745513fe71 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:58.450802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61ce62-4e70-42e1-86ca-e5745513fe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:58.451186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61ce62-4e70-42e1-86ca-e5745513fe71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:58.451950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61ce62-4e70-42e1-86ca-e5745513fe71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:58.457389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 844/1679] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:58.460646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5434bf6-64af-4aae-b124-2e087650ce35 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:58.462262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61ce62-4e70-42e1-86ca-e5745513fe71 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:58.499416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 836/1680] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:35:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:35:58.502088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5434bf6-64af-4aae-b124-2e087650ce35 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:58.508457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61ce62-4e70-42e1-86ca-e5745513fe71 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:58.527118 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782368c9-c47d-4955-9981-90b2d7b878d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:58.528230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782368c9-c47d-4955-9981-90b2d7b878d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:58.529847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782368c9-c47d-4955-9981-90b2d7b878d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:58.530448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782368c9-c47d-4955-9981-90b2d7b878d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:58.531344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782368c9-c47d-4955-9981-90b2d7b878d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:35:58.538227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782368c9-c47d-4955-9981-90b2d7b878d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:58.542580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782368c9-c47d-4955-9981-90b2d7b878d9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:58.545988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61ce62-4e70-42e1-86ca-e5745513fe71 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:58.564762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673f95a-3776-4364-ac70-c4087de59787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:58.571088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f95a-3776-4364-ac70-c4087de59787 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:58.571088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f95a-3776-4364-ac70-c4087de59787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:58.571088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f95a-3776-4364-ac70-c4087de59787 admin admin] PATH_INFO: `/v3/projects/8e02241ce49749b88911dd1e20d54111/users/88d82971d8f04733ad846b665e914096/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:58.574427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673f95a-3776-4364-ac70-c4087de59787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e02241ce49749b88911dd1e20d54111, user_id=88d82971d8f04733ad846b665e914096, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:58.591057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673f95a-3776-4364-ac70-c4087de59787 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:58.609672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 845/1681] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:35:58.613479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782368c9-c47d-4955-9981-90b2d7b878d9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:58.623942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 837/1682] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:58 2022] PUT /identity/v3/projects/8e02241ce49749b88911dd1e20d54111/users/88d82971d8f04733ad846b665e914096/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:58.625131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673f95a-3776-4364-ac70-c4087de59787 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:58.664160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782368c9-c47d-4955-9981-90b2d7b878d9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:58.901077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673f95a-3776-4364-ac70-c4087de59787 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:58.933677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d19e4b-8505-4e0a-a6c8-b342d66f0751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:58.933677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19e4b-8505-4e0a-a6c8-b342d66f0751 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:58.933677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19e4b-8505-4e0a-a6c8-b342d66f0751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:58.933677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d19e4b-8505-4e0a-a6c8-b342d66f0751 admin admin] PATH_INFO: `/v3/projects/b360da0b6dd24e23a735b14e241927e1/users/990ea4d4b4144feaa99fb6dc9ccbb01b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:58.935386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a5b96-73f7-44b9-b025-adbc0467ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:58.936164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a5b96-73f7-44b9-b025-adbc0467ce67 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:58.937136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a5b96-73f7-44b9-b025-adbc0467ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:58.937566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a5b96-73f7-44b9-b025-adbc0467ce67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:58.938508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a5b96-73f7-44b9-b025-adbc0467ce67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:58.943308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d19e4b-8505-4e0a-a6c8-b342d66f0751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b360da0b6dd24e23a735b14e241927e1, user_id=990ea4d4b4144feaa99fb6dc9ccbb01b, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:58.946698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d19e4b-8505-4e0a-a6c8-b342d66f0751 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:58.960140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a5b96-73f7-44b9-b025-adbc0467ce67 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:58.994330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 846/1683] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:35:58 2022] PUT /identity/v3/projects/b360da0b6dd24e23a735b14e241927e1/users/990ea4d4b4144feaa99fb6dc9ccbb01b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:35:58.998942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790c11-603d-4bb9-a8a1-1e155fd21c9a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:59.014751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790c11-603d-4bb9-a8a1-1e155fd21c9a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:59.015365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5790c11-603d-4bb9-a8a1-1e155fd21c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:59.178272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 838/1684] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:35:58 2022] POST /identity/v3/projects => generated 355 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:35:59.185697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab1e67-cdfb-4740-854a-5829b77a1d51 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:59.186424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab1e67-cdfb-4740-854a-5829b77a1d51 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:59.188940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab1e67-cdfb-4740-854a-5829b77a1d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:59.224939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a5790c11-603d-4bb9-a8a1-1e155fd21c9a None None] MFA Rules not processed for user `88d82971d8f04733ad846b665e914096`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:59.229801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a5790c11-603d-4bb9-a8a1-1e155fd21c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:59.397677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a7ab1e67-cdfb-4740-854a-5829b77a1d51 None None] MFA Rules not processed for user `990ea4d4b4144feaa99fb6dc9ccbb01b`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:35:59.398999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a7ab1e67-cdfb-4740-854a-5829b77a1d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:59.597119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 847/1685] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 597 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:59.604219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5790c11-603d-4bb9-a8a1-1e155fd21c9a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:59.709065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 839/1686] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:35:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 530 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:35:59.710664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab1e67-cdfb-4740-854a-5829b77a1d51 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:59.712453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a7ab1e67-cdfb-4740-854a-5829b77a1d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:35:59.759269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:59.864928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5790c11-603d-4bb9-a8a1-1e155fd21c9a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:59.877110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccc3f1-c0fd-40d6-acdf-29eb77341b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:59.877922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc3f1-c0fd-40d6-acdf-29eb77341b21 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:59.878276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc3f1-c0fd-40d6-acdf-29eb77341b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:59.878619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccc3f1-c0fd-40d6-acdf-29eb77341b21 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:59.881711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccc3f1-c0fd-40d6-acdf-29eb77341b21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:59.886387 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccc3f1-c0fd-40d6-acdf-29eb77341b21 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:59.889559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab1e67-cdfb-4740-854a-5829b77a1d51 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:35:59.896782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c2e54-caa1-4910-ac4f-0a35fbf7b11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:35:59.899000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c2e54-caa1-4910-ac4f-0a35fbf7b11e service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:35:59.899942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c2e54-caa1-4910-ac4f-0a35fbf7b11e service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:35:59.900624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c2e54-caa1-4910-ac4f-0a35fbf7b11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:35:59.941519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c2e54-caa1-4910-ac4f-0a35fbf7b11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:35:59.944261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c2e54-caa1-4910-ac4f-0a35fbf7b11e service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:35:59.979588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 840/1687] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:35:59.983220 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c2e54-caa1-4910-ac4f-0a35fbf7b11e service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:35:59.994651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f40c2e54-caa1-4910-ac4f-0a35fbf7b11e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.004549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 848/1688] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:35:59 2022] POST /identity/v3/users => generated 278 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:00.023018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645c062-781f-40ae-8186-14ca46079b70 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.023468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645c062-781f-40ae-8186-14ca46079b70 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.023883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645c062-781f-40ae-8186-14ca46079b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.037861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c2e54-caa1-4910-ac4f-0a35fbf7b11e service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:00.053209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4274c6-f080-4392-bcac-1c7ad5032ebf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:00.055344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4274c6-f080-4392-bcac-1c7ad5032ebf service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.056075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4274c6-f080-4392-bcac-1c7ad5032ebf service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.056761 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4274c6-f080-4392-bcac-1c7ad5032ebf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.088105 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5645c062-781f-40ae-8186-14ca46079b70 None None] MFA Rules not processed for user `b1628c4903b34a219d19e01bf73e0b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:00.089562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5645c062-781f-40ae-8186-14ca46079b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.089713 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4274c6-f080-4392-bcac-1c7ad5032ebf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:00.094670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4274c6-f080-4392-bcac-1c7ad5032ebf service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:00.167912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 841/1689] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:35:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:00.170493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4274c6-f080-4392-bcac-1c7ad5032ebf service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:00.201643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4274c6-f080-4392-bcac-1c7ad5032ebf service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:00.250000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45966421-897e-4f10-b069-52f6f4aae15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:00.250000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966421-897e-4f10-b069-52f6f4aae15e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.252269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966421-897e-4f10-b069-52f6f4aae15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.253015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45966421-897e-4f10-b069-52f6f4aae15e admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.254712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45966421-897e-4f10-b069-52f6f4aae15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:00.258240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45966421-897e-4f10-b069-52f6f4aae15e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:00.286853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 849/1690] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:00.289525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571771fe-4c48-45b2-990a-277a6984b362 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.292000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571771fe-4c48-45b2-990a-277a6984b362 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.298223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571771fe-4c48-45b2-990a-277a6984b362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.334238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 842/1691] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:00.337793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45966421-897e-4f10-b069-52f6f4aae15e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:00.344305 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-45966421-897e-4f10-b069-52f6f4aae15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.379027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:00.492174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45966421-897e-4f10-b069-52f6f4aae15e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:00.492888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-571771fe-4c48-45b2-990a-277a6984b362 None None] MFA Rules not processed for user `744cf2055b244186afa58ec86a7d3b73`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:00.500640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-571771fe-4c48-45b2-990a-277a6984b362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.526132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130a743-08e1-4b7f-9782-312de3fe94b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:00.528161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130a743-08e1-4b7f-9782-312de3fe94b0 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.528618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130a743-08e1-4b7f-9782-312de3fe94b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.529057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130a743-08e1-4b7f-9782-312de3fe94b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.565574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130a743-08e1-4b7f-9782-312de3fe94b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:00.569046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130a743-08e1-4b7f-9782-312de3fe94b0 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:00.619039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 843/1692] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:00.620545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130a743-08e1-4b7f-9782-312de3fe94b0 service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:00.652591 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130a743-08e1-4b7f-9782-312de3fe94b0 service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:00.672029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eff725-a999-4b07-a559-d6347f748ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:00.672835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eff725-a999-4b07-a559-d6347f748ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.673719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eff725-a999-4b07-a559-d6347f748ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.674184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eff725-a999-4b07-a559-d6347f748ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.697915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eff725-a999-4b07-a559-d6347f748ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:00.703568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eff725-a999-4b07-a559-d6347f748ab7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:00.736077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 844/1693] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:00.740267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a7bc-e9ff-48ea-9e3f-03506c523741 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.742745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a7bc-e9ff-48ea-9e3f-03506c523741 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.743095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908a7bc-e9ff-48ea-9e3f-03506c523741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.759841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 850/1694] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:00.760928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571771fe-4c48-45b2-990a-277a6984b362 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:00.794370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571771fe-4c48-45b2-990a-277a6984b362 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:00.815716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b09be-c2b7-4ab1-989a-e5e6be92528d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:00.818620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b09be-c2b7-4ab1-989a-e5e6be92528d service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:00.819073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b09be-c2b7-4ab1-989a-e5e6be92528d service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:00.820293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b09be-c2b7-4ab1-989a-e5e6be92528d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:00.823810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-057b09be-c2b7-4ab1-989a-e5e6be92528d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.830207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3908a7bc-e9ff-48ea-9e3f-03506c523741 None None] MFA Rules not processed for user `67ceab80e8744b478ec9cb93e1b56f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:00.833792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3908a7bc-e9ff-48ea-9e3f-03506c523741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:00.984608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:01.056360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 845/1695] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:01.057735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908a7bc-e9ff-48ea-9e3f-03506c523741 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:01.077745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908a7bc-e9ff-48ea-9e3f-03506c523741 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:01.089299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e33893-79cd-4c71-af87-18ee8cb7cbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:01.090206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e33893-79cd-4c71-af87-18ee8cb7cbf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.092162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e33893-79cd-4c71-af87-18ee8cb7cbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.092582 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e33893-79cd-4c71-af87-18ee8cb7cbf4 admin admin] PATH_INFO: `/v3/projects/5960d4538fdc4af4a715559812b87da4/users/d28939f679ee405ea364cda08204ef16/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.120462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e33893-79cd-4c71-af87-18ee8cb7cbf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5960d4538fdc4af4a715559812b87da4, user_id=d28939f679ee405ea364cda08204ef16, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:01.123626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e33893-79cd-4c71-af87-18ee8cb7cbf4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:01.148319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b09be-c2b7-4ab1-989a-e5e6be92528d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:01.150453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b09be-c2b7-4ab1-989a-e5e6be92528d service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:01.180144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 851/1696] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:01.181516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabec42-7841-46e4-a7f7-1f0bb9ab6dac None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.182493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabec42-7841-46e4-a7f7-1f0bb9ab6dac None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.182493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabec42-7841-46e4-a7f7-1f0bb9ab6dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.219783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9eabec42-7841-46e4-a7f7-1f0bb9ab6dac None None] MFA Rules not processed for user `744cf2055b244186afa58ec86a7d3b73`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:01.221107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9eabec42-7841-46e4-a7f7-1f0bb9ab6dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:01.263139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 852/1697] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:01.270351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeb00e-d943-4bd0-bd36-a8df2d538b82 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.275761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeb00e-d943-4bd0-bd36-a8df2d538b82 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.276279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caeb00e-d943-4bd0-bd36-a8df2d538b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.319196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 846/1698] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:01 2022] PUT /identity/v3/projects/5960d4538fdc4af4a715559812b87da4/users/d28939f679ee405ea364cda08204ef16/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:01.321219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e33893-79cd-4c71-af87-18ee8cb7cbf4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:01.325028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-82e33893-79cd-4c71-af87-18ee8cb7cbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:01.361578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5caeb00e-d943-4bd0-bd36-a8df2d538b82 None None] MFA Rules not processed for user `67ceab80e8744b478ec9cb93e1b56f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:01.364769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5caeb00e-d943-4bd0-bd36-a8df2d538b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:01.553537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 853/1699] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:01.574551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68a31-ea8d-403a-8abf-c9ab08ac8842 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.575008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68a31-ea8d-403a-8abf-c9ab08ac8842 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.575411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f68a31-ea8d-403a-8abf-c9ab08ac8842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.622875 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e33893-79cd-4c71-af87-18ee8cb7cbf4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:01.639990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97847c98-8fc8-48cf-b142-7231ef15b71b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:01.640491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b1f68a31-ea8d-403a-8abf-c9ab08ac8842 None None] MFA Rules not processed for user `d28939f679ee405ea364cda08204ef16`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:01.655645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97847c98-8fc8-48cf-b142-7231ef15b71b service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.655645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97847c98-8fc8-48cf-b142-7231ef15b71b service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.655645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97847c98-8fc8-48cf-b142-7231ef15b71b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.655988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b1f68a31-ea8d-403a-8abf-c9ab08ac8842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:01.810472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 854/1700] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:01.811587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f68a31-ea8d-403a-8abf-c9ab08ac8842 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:01.817142 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97847c98-8fc8-48cf-b142-7231ef15b71b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:01.820680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97847c98-8fc8-48cf-b142-7231ef15b71b service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:01.847241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 847/1701] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:01.848168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97847c98-8fc8-48cf-b142-7231ef15b71b service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:01.860124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f68a31-ea8d-403a-8abf-c9ab08ac8842 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:01.886588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990dd3d0-1d43-4b8e-97b5-a9f86181e04a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:01.886588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dd3d0-1d43-4b8e-97b5-a9f86181e04a service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:01.887072 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dd3d0-1d43-4b8e-97b5-a9f86181e04a service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:01.887072 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990dd3d0-1d43-4b8e-97b5-a9f86181e04a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:01.935007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dd3d0-1d43-4b8e-97b5-a9f86181e04a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:01.940652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990dd3d0-1d43-4b8e-97b5-a9f86181e04a service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:01.978985 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 855/1702] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:02.033058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac84595-6944-431a-88d5-fef451f22a24 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:02.033272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac84595-6944-431a-88d5-fef451f22a24 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:02.033737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac84595-6944-431a-88d5-fef451f22a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:02.084884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97847c98-8fc8-48cf-b142-7231ef15b71b service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:02.109899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01bf71-c906-4d26-9d20-30bd8e504a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:02.114183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01bf71-c906-4d26-9d20-30bd8e504a81 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:02.119745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01bf71-c906-4d26-9d20-30bd8e504a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:02.120955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01bf71-c906-4d26-9d20-30bd8e504a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:02.137659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01bf71-c906-4d26-9d20-30bd8e504a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:02.142368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01bf71-c906-4d26-9d20-30bd8e504a81 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:02.212706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-bac84595-6944-431a-88d5-fef451f22a24 None None] MFA Rules not processed for user `36ae407308bf4947b1f113f5390db714`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:02.214726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bac84595-6944-431a-88d5-fef451f22a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:02.387579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 848/1703] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:01 2022] POST /identity/v3/projects => generated 357 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:02.406317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01bf71-c906-4d26-9d20-30bd8e504a81 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:02.542460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 856/1704] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:02.544101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac84595-6944-431a-88d5-fef451f22a24 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:02.582830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac84595-6944-431a-88d5-fef451f22a24 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:02.738605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba23025-c374-4d29-87db-55105fd48a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:02.739275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba23025-c374-4d29-87db-55105fd48a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:02.739588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba23025-c374-4d29-87db-55105fd48a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:02.739892 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba23025-c374-4d29-87db-55105fd48a38 admin admin] PATH_INFO: `/v3/users/be0faffadacb46dd9f322105675053d1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:02.743178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba23025-c374-4d29-87db-55105fd48a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0faffadacb46dd9f322105675053d1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:02.746637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba23025-c374-4d29-87db-55105fd48a38 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:02.781589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01bf71-c906-4d26-9d20-30bd8e504a81 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:02.806078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cc5e4-096c-407f-a88d-881af7a1d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:02.807071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cc5e4-096c-407f-a88d-881af7a1d4ef admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:02.810196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cc5e4-096c-407f-a88d-881af7a1d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:02.810894 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cc5e4-096c-407f-a88d-881af7a1d4ef admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:02.811996 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cc5e4-096c-407f-a88d-881af7a1d4ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:02.823417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:02.825824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cc5e4-096c-407f-a88d-881af7a1d4ef admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:02.859013 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:03.030897 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 849/1705] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:02 2022] POST /identity/v3/users => generated 285 bytes in 627 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:03.036748 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cc5e4-096c-407f-a88d-881af7a1d4ef admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:03.064679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cc5e4-096c-407f-a88d-881af7a1d4ef admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:03.091795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36277c49-2c79-42d1-8fd7-9907298c35ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:03.092924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36277c49-2c79-42d1-8fd7-9907298c35ea admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.092924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36277c49-2c79-42d1-8fd7-9907298c35ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.093195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36277c49-2c79-42d1-8fd7-9907298c35ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.093765 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36277c49-2c79-42d1-8fd7-9907298c35ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:03.095493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36277c49-2c79-42d1-8fd7-9907298c35ea admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:03.152696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 850/1706] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:03.154181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36277c49-2c79-42d1-8fd7-9907298c35ea admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:03.164946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9ba23025-c374-4d29-87db-55105fd48a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0faffadacb46dd9f322105675053d1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:03.183111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9ba23025-c374-4d29-87db-55105fd48a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0faffadacb46dd9f322105675053d1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:03.201639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9ba23025-c374-4d29-87db-55105fd48a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0faffadacb46dd9f322105675053d1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:03.202592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36277c49-2c79-42d1-8fd7-9907298c35ea admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:03.208259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45408040-523c-41b4-b3b4-060b79605809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:03.209728 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45408040-523c-41b4-b3b4-060b79605809 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.215652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45408040-523c-41b4-b3b4-060b79605809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.216085 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45408040-523c-41b4-b3b4-060b79605809 admin admin] PATH_INFO: `/v3/projects/effa92dcaf944c22b8c381fb415051f4/users/2f4e54ed39074e258136c7a0e745a71b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.272757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45408040-523c-41b4-b3b4-060b79605809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=effa92dcaf944c22b8c381fb415051f4, user_id=2f4e54ed39074e258136c7a0e745a71b, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:03.288087 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45408040-523c-41b4-b3b4-060b79605809 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:03.313362 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9ba23025-c374-4d29-87db-55105fd48a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0faffadacb46dd9f322105675053d1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:03.369189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9ba23025-c374-4d29-87db-55105fd48a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0faffadacb46dd9f322105675053d1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:03.398035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 857/1707] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:02 2022] DELETE /identity/v3/users/be0faffadacb46dd9f322105675053d1 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:03.402187 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec9e40-053c-40bf-8735-f4313f2d118e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.402823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec9e40-053c-40bf-8735-f4313f2d118e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.403320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec9e40-053c-40bf-8735-f4313f2d118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.436709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 851/1708] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:03 2022] PUT /identity/v3/projects/effa92dcaf944c22b8c381fb415051f4/users/2f4e54ed39074e258136c7a0e745a71b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:03.442319 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a44c-9a2b-484b-9a7a-656652cfc4ce None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.442319 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a44c-9a2b-484b-9a7a-656652cfc4ce None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.442319 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a44c-9a2b-484b-9a7a-656652cfc4ce None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.442319 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 852/1709] 10.222.0.15 () {54 vars in 912 bytes} [Thu Sep 1 16:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:36:03.443367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0cec9e40-053c-40bf-8735-f4313f2d118e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:03.445560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0cec9e40-053c-40bf-8735-f4313f2d118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:03.448373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002a44c-9a2b-484b-9a7a-656652cfc4ce None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:03.470895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2002a44c-9a2b-484b-9a7a-656652cfc4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:03.606589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:03.642378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 858/1710] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:03.645005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cc442-e447-41f4-8582-964c995cf270 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.647678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cc442-e447-41f4-8582-964c995cf270 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.648005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cc442-e447-41f4-8582-964c995cf270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.717819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002a44c-9a2b-484b-9a7a-656652cfc4ce None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:03.727332 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b5e6-1e4a-4ed0-ba17-44709121fdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:03.728063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b5e6-1e4a-4ed0-ba17-44709121fdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.728430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b5e6-1e4a-4ed0-ba17-44709121fdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.728811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b5e6-1e4a-4ed0-ba17-44709121fdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.729678 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9b5e6-1e4a-4ed0-ba17-44709121fdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:03.731931 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9b5e6-1e4a-4ed0-ba17-44709121fdd7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:03.754340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:03.761005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-025cc442-e447-41f4-8582-964c995cf270 None None] MFA Rules not processed for user `02432d1312a34273813856362cada1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:03.764921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-025cc442-e447-41f4-8582-964c995cf270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:03.765441 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 853/1711] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:03.768740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd53096-3716-4f42-8bbb-ec25e0da6bb0 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.769039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd53096-3716-4f42-8bbb-ec25e0da6bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.769321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd53096-3716-4f42-8bbb-ec25e0da6bb0 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.776037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 854/1712] 10.222.0.15 () {54 vars in 912 bytes} [Thu Sep 1 16:36:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:36:03.776913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd53096-3716-4f42-8bbb-ec25e0da6bb0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:03.784825 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7fd53096-3716-4f42-8bbb-ec25e0da6bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:03.955970 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 859/1713] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:36:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:03.956630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cc442-e447-41f4-8582-964c995cf270 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:03.965664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd53096-3716-4f42-8bbb-ec25e0da6bb0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:03.972670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3d653-00b1-4625-9a20-6c7c7fd34510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:03.973652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3d653-00b1-4625-9a20-6c7c7fd34510 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:03.974188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3d653-00b1-4625-9a20-6c7c7fd34510 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:03.974710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3d653-00b1-4625-9a20-6c7c7fd34510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:03.992454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3d653-00b1-4625-9a20-6c7c7fd34510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:03.996879 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3d653-00b1-4625-9a20-6c7c7fd34510 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:03.997820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cc442-e447-41f4-8582-964c995cf270 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:04.012488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f98b8-6e84-4a3e-a9f0-93810a2c6b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:04.013178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f98b8-6e84-4a3e-a9f0-93810a2c6b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:04.013513 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f98b8-6e84-4a3e-a9f0-93810a2c6b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:04.013786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f98b8-6e84-4a3e-a9f0-93810a2c6b38 admin admin] PATH_INFO: `/v3/projects/effa92dcaf944c22b8c381fb415051f4/users/2f4e54ed39074e258136c7a0e745a71b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:04.022774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f98b8-6e84-4a3e-a9f0-93810a2c6b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=effa92dcaf944c22b8c381fb415051f4, user_id=2f4e54ed39074e258136c7a0e745a71b, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:04.029592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 855/1714] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:04.034228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f98b8-6e84-4a3e-a9f0-93810a2c6b38 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:04.034581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942078-5676-4a91-b474-9a83dc36ead8 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:04.035105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942078-5676-4a91-b474-9a83dc36ead8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:04.035652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31942078-5676-4a91-b474-9a83dc36ead8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:04.069440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-31942078-5676-4a91-b474-9a83dc36ead8 None None] MFA Rules not processed for user `02432d1312a34273813856362cada1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:04.079766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 860/1715] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:03 2022] PUT /identity/v3/projects/effa92dcaf944c22b8c381fb415051f4/users/2f4e54ed39074e258136c7a0e745a71b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:04.079766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182582ed-9b78-4c03-b68b-9996dc207921 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:04.079766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182582ed-9b78-4c03-b68b-9996dc207921 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:04.079766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182582ed-9b78-4c03-b68b-9996dc207921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:04.080223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-31942078-5676-4a91-b474-9a83dc36ead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:04.133854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-182582ed-9b78-4c03-b68b-9996dc207921 None None] MFA Rules not processed for user `c33b81f98c4e4e919d60f408ad24e594`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:04.136282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-182582ed-9b78-4c03-b68b-9996dc207921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:04.233655 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 856/1716] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:36:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:04.234332 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942078-5676-4a91-b474-9a83dc36ead8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:04.236759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-31942078-5676-4a91-b474-9a83dc36ead8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:04.259480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31942078-5676-4a91-b474-9a83dc36ead8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:04.272612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcba88-eaa3-4cbd-8de7-fa1ec130ba23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:04.273566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcba88-eaa3-4cbd-8de7-fa1ec130ba23 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:04.273854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcba88-eaa3-4cbd-8de7-fa1ec130ba23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:04.275160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcba88-eaa3-4cbd-8de7-fa1ec130ba23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:04.284346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcba88-eaa3-4cbd-8de7-fa1ec130ba23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:04.286240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcba88-eaa3-4cbd-8de7-fa1ec130ba23 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:04.304909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 861/1717] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:04.305662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 857/1718] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:04.306870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcba88-eaa3-4cbd-8de7-fa1ec130ba23 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:04.308249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6cde3-1e2e-417c-a1c5-4eb6f1e9f63b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:04.316159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6cde3-1e2e-417c-a1c5-4eb6f1e9f63b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:04.316783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6cde3-1e2e-417c-a1c5-4eb6f1e9f63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:04.322149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcba88-eaa3-4cbd-8de7-fa1ec130ba23 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:04.338259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90175598-86b8-4dc4-b17a-814352841ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:04.338259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90175598-86b8-4dc4-b17a-814352841ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:04.338259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90175598-86b8-4dc4-b17a-814352841ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:04.338259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90175598-86b8-4dc4-b17a-814352841ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:04.366722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90175598-86b8-4dc4-b17a-814352841ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:04.370380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90175598-86b8-4dc4-b17a-814352841ac1 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:04.394817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 858/1719] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:04.414292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-74c6cde3-1e2e-417c-a1c5-4eb6f1e9f63b None None] MFA Rules not processed for user `2f4e54ed39074e258136c7a0e745a71b`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:04.415714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-74c6cde3-1e2e-417c-a1c5-4eb6f1e9f63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:04.656644 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 862/1720] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:04.676336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90175598-86b8-4dc4-b17a-814352841ac1 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:04.682497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-90175598-86b8-4dc4-b17a-814352841ac1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:04.820483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90175598-86b8-4dc4-b17a-814352841ac1 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:04.835999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e36d7-1229-4821-ac6d-e5f68ddbde51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:04.836652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e36d7-1229-4821-ac6d-e5f68ddbde51 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:04.836937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e36d7-1229-4821-ac6d-e5f68ddbde51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:04.837212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e36d7-1229-4821-ac6d-e5f68ddbde51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:04.859184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e36d7-1229-4821-ac6d-e5f68ddbde51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:04.859184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e36d7-1229-4821-ac6d-e5f68ddbde51 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:04.890915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 859/1721] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:05.252617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6cde3-1e2e-417c-a1c5-4eb6f1e9f63b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:05.275130 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6cde3-1e2e-417c-a1c5-4eb6f1e9f63b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:05.294355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69017439-c351-4d27-8ff1-f1b8a9672200 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:05.295011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017439-c351-4d27-8ff1-f1b8a9672200 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:05.295294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017439-c351-4d27-8ff1-f1b8a9672200 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:05.295569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017439-c351-4d27-8ff1-f1b8a9672200 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:05.310347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-69017439-c351-4d27-8ff1-f1b8a9672200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:05.343856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e36d7-1229-4821-ac6d-e5f68ddbde51 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:05.345338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-740e36d7-1229-4821-ac6d-e5f68ddbde51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:05.538616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69017439-c351-4d27-8ff1-f1b8a9672200 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:05.547330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69017439-c351-4d27-8ff1-f1b8a9672200 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:05.597766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 863/1722] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:05.597766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69017439-c351-4d27-8ff1-f1b8a9672200 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:05.603777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e36d7-1229-4821-ac6d-e5f68ddbde51 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:05.607500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-69017439-c351-4d27-8ff1-f1b8a9672200 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:05.620269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882b22a-5b3a-4b64-9b5c-c4f97c10925a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:05.620884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882b22a-5b3a-4b64-9b5c-c4f97c10925a service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:05.621272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882b22a-5b3a-4b64-9b5c-c4f97c10925a service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:05.623258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882b22a-5b3a-4b64-9b5c-c4f97c10925a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:05.632207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3882b22a-5b3a-4b64-9b5c-c4f97c10925a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:05.770929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:05.778375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882b22a-5b3a-4b64-9b5c-c4f97c10925a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:05.787078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882b22a-5b3a-4b64-9b5c-c4f97c10925a service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:05.800483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 860/1723] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:05.801398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882b22a-5b3a-4b64-9b5c-c4f97c10925a service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:05.806744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3882b22a-5b3a-4b64-9b5c-c4f97c10925a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:05.834852 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69017439-c351-4d27-8ff1-f1b8a9672200 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:05.849202 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdf8c6-267d-47c4-8a54-391db4a46b5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d15478ca864f49aae2301e2328fe23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:05.850447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdf8c6-267d-47c4-8a54-391db4a46b5b service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:05.850848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdf8c6-267d-47c4-8a54-391db4a46b5b service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:05.851271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fdf8c6-267d-47c4-8a54-391db4a46b5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:05.853486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-26fdf8c6-267d-47c4-8a54-391db4a46b5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:05.879649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdf8c6-267d-47c4-8a54-391db4a46b5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:05.885239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fdf8c6-267d-47c4-8a54-391db4a46b5b service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:05.909566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 864/1724] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:05.930657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882b22a-5b3a-4b64-9b5c-c4f97c10925a service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:05.943178 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:05.944207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:05.944678 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:05.945246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] PATH_INFO: `/v3/projects/410c3831d5864c979d4e5346d50a7b44` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:05.948131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=410c3831d5864c979d4e5346d50a7b44)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:05.955743 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:06.003803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdf8c6-267d-47c4-8a54-391db4a46b5b service placement] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:06.006103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-26fdf8c6-267d-47c4-8a54-391db4a46b5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:06.044029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fdf8c6-267d-47c4-8a54-391db4a46b5b service placement] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:06.085677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe8b03-3ae8-4536-96d3-365459cfac9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:06.086359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8b03-3ae8-4536-96d3-365459cfac9e service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:06.086642 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8b03-3ae8-4536-96d3-365459cfac9e service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:06.086915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe8b03-3ae8-4536-96d3-365459cfac9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:06.111064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe8b03-3ae8-4536-96d3-365459cfac9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:06.117217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe8b03-3ae8-4536-96d3-365459cfac9e service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:06.131708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 865/1725] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:06.276258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410c3831d5864c979d4e5346d50a7b44', 'request_id': 'req-fb3cc319-adee-40c1-902e-cd00fd35fa8e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:06.304733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410c3831d5864c979d4e5346d50a7b44', 'request_id': 'req-fb3cc319-adee-40c1-902e-cd00fd35fa8e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:06.327492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410c3831d5864c979d4e5346d50a7b44', 'request_id': 'req-fb3cc319-adee-40c1-902e-cd00fd35fa8e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:06.573273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] The token cache is being invalidate because project 410c3831d5864c979d4e5346d50a7b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:06.574349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:06.578250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fb3cc319-adee-40c1-902e-cd00fd35fa8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:06.580624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 861/1726] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:05 2022] DELETE /identity/v3/projects/410c3831d5864c979d4e5346d50a7b44 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:06.586251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe8b03-3ae8-4536-96d3-365459cfac9e service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:06.649462 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe8b03-3ae8-4536-96d3-365459cfac9e service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:06.950191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a4cca-5aa9-4aad-a62f-6894adf64d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:06.950886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a4cca-5aa9-4aad-a62f-6894adf64d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:06.951169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a4cca-5aa9-4aad-a62f-6894adf64d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:06.952726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a4cca-5aa9-4aad-a62f-6894adf64d50 admin admin] PATH_INFO: `/v3/users/88d82971d8f04733ad846b665e914096` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:06.959498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a4cca-5aa9-4aad-a62f-6894adf64d50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d82971d8f04733ad846b665e914096)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:06.965912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a4cca-5aa9-4aad-a62f-6894adf64d50 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:07.000367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeab8f-6e16-4b1d-b2da-c442e6f7ae40 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:07.000654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeab8f-6e16-4b1d-b2da-c442e6f7ae40 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:07.000965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeab8f-6e16-4b1d-b2da-c442e6f7ae40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:07.075299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-dbfeab8f-6e16-4b1d-b2da-c442e6f7ae40 None None] MFA Rules not processed for user `67ceab80e8744b478ec9cb93e1b56f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:07.078415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dbfeab8f-6e16-4b1d-b2da-c442e6f7ae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:07.191655 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:07.235239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 862/1727] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:07.465484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b49a4cca-5aa9-4aad-a62f-6894adf64d50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d82971d8f04733ad846b665e914096'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.488215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b49a4cca-5aa9-4aad-a62f-6894adf64d50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d82971d8f04733ad846b665e914096'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.491574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b49a4cca-5aa9-4aad-a62f-6894adf64d50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d82971d8f04733ad846b665e914096'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.732620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b49a4cca-5aa9-4aad-a62f-6894adf64d50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d82971d8f04733ad846b665e914096'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.834687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b49a4cca-5aa9-4aad-a62f-6894adf64d50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d82971d8f04733ad846b665e914096'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:07.874088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 866/1728] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:06 2022] DELETE /identity/v3/users/88d82971d8f04733ad846b665e914096 => generated 0 bytes in 1288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:08.925279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:09.659008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeab8f-6e16-4b1d-b2da-c442e6f7ae40 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:09.662573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dbfeab8f-6e16-4b1d-b2da-c442e6f7ae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:09.775072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeab8f-6e16-4b1d-b2da-c442e6f7ae40 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:09.889470 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09e30a-526d-4fa4-a777-5d629a95a625 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:09.890365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09e30a-526d-4fa4-a777-5d629a95a625 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:09.890865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09e30a-526d-4fa4-a777-5d629a95a625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:09.986065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2f09e30a-526d-4fa4-a777-5d629a95a625 None None] MFA Rules not processed for user `b1628c4903b34a219d19e01bf73e0b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:09.992803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2f09e30a-526d-4fa4-a777-5d629a95a625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:10.051421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:10.052804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.053190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.053681 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] PATH_INFO: `/v3/projects/8e02241ce49749b88911dd1e20d54111` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.055397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e02241ce49749b88911dd1e20d54111)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:10.058201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:10.245382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 867/1729] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:10.389028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e02241ce49749b88911dd1e20d54111', 'request_id': 'req-be13b229-7484-4610-82e9-87b7f585b333'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:10.418650 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e02241ce49749b88911dd1e20d54111', 'request_id': 'req-be13b229-7484-4610-82e9-87b7f585b333'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:10.452946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:10.457550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e02241ce49749b88911dd1e20d54111', 'request_id': 'req-be13b229-7484-4610-82e9-87b7f585b333'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:10.573619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:10.586624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] The token cache is being invalidate because project 8e02241ce49749b88911dd1e20d54111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:10.587392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:10.589673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-be13b229-7484-4610-82e9-87b7f585b333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:10.593724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 863/1730] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:09 2022] DELETE /identity/v3/projects/8e02241ce49749b88911dd1e20d54111 => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:10.600185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9458c7-00c7-4e36-ae01-71984aa7a497 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.601036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9458c7-00c7-4e36-ae01-71984aa7a497 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.601733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9458c7-00c7-4e36-ae01-71984aa7a497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.652442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9b9458c7-00c7-4e36-ae01-71984aa7a497 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:10.656575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9b9458c7-00c7-4e36-ae01-71984aa7a497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:10.825284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 868/1731] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:10.837814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b5d6a-a1f1-46ad-b673-cc3b74e9b89e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.839054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b5d6a-a1f1-46ad-b673-cc3b74e9b89e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.840092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b5d6a-a1f1-46ad-b673-cc3b74e9b89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.887898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-dd5b5d6a-a1f1-46ad-b673-cc3b74e9b89e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:10.891138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dd5b5d6a-a1f1-46ad-b673-cc3b74e9b89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:10.922787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 864/1732] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:10.928445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9458c7-00c7-4e36-ae01-71984aa7a497 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:10.950409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9458c7-00c7-4e36-ae01-71984aa7a497 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:10.967903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab571dbb-61ca-4ced-ae9b-67a81d188074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:10.974464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab571dbb-61ca-4ced-ae9b-67a81d188074 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:10.974464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab571dbb-61ca-4ced-ae9b-67a81d188074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:10.974464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab571dbb-61ca-4ced-ae9b-67a81d188074 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:10.974464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab571dbb-61ca-4ced-ae9b-67a81d188074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:10.974464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab571dbb-61ca-4ced-ae9b-67a81d188074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:10.976986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab571dbb-61ca-4ced-ae9b-67a81d188074 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:10.995120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 869/1733] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:11.000912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b5d6a-a1f1-46ad-b673-cc3b74e9b89e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:11.014095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b5d6a-a1f1-46ad-b673-cc3b74e9b89e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:11.045861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8c3a1-e5c2-4a3f-a2eb-e6e6255fdd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:11.046535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8c3a1-e5c2-4a3f-a2eb-e6e6255fdd90 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.046995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8c3a1-e5c2-4a3f-a2eb-e6e6255fdd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.049517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8c3a1-e5c2-4a3f-a2eb-e6e6255fdd90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.054370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8c3a1-e5c2-4a3f-a2eb-e6e6255fdd90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:11.059435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c8c3a1-e5c2-4a3f-a2eb-e6e6255fdd90 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:11.317094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 865/1734] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:10 2022] POST /identity/v3/projects => generated 365 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:11.324290 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab571dbb-61ca-4ced-ae9b-67a81d188074 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:11.361020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab571dbb-61ca-4ced-ae9b-67a81d188074 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:11.493020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fbc60-1172-466b-9b02-5fe8e2088b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:11.494681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fbc60-1172-466b-9b02-5fe8e2088b5b admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.495408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fbc60-1172-466b-9b02-5fe8e2088b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.496212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fbc60-1172-466b-9b02-5fe8e2088b5b admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.497494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fbc60-1172-466b-9b02-5fe8e2088b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:11.501476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fbc60-1172-466b-9b02-5fe8e2088b5b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:11.731983 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 870/1735] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:11 2022] POST /identity/v3/users => generated 283 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:11.736966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8c3a1-e5c2-4a3f-a2eb-e6e6255fdd90 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:11.761188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c8c3a1-e5c2-4a3f-a2eb-e6e6255fdd90 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:11.775108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba93a7-168b-4705-8904-f138c3d6ef29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:11.775848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba93a7-168b-4705-8904-f138c3d6ef29 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.776404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba93a7-168b-4705-8904-f138c3d6ef29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.776771 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba93a7-168b-4705-8904-f138c3d6ef29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.777532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba93a7-168b-4705-8904-f138c3d6ef29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:11.779294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba93a7-168b-4705-8904-f138c3d6ef29 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:11.820019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 866/1736] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:11.824111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fbc60-1172-466b-9b02-5fe8e2088b5b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:11.839973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fbc60-1172-466b-9b02-5fe8e2088b5b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:11.847443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4336d1-a99e-4260-8b02-832655bec8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:11.848445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4336d1-a99e-4260-8b02-832655bec8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.850902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4336d1-a99e-4260-8b02-832655bec8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.850902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4336d1-a99e-4260-8b02-832655bec8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.850902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4336d1-a99e-4260-8b02-832655bec8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:11.852730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4336d1-a99e-4260-8b02-832655bec8b7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:11.872054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 871/1737] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:11.878031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba93a7-168b-4705-8904-f138c3d6ef29 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:11.902227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba93a7-168b-4705-8904-f138c3d6ef29 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:11.936354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d454e-3235-4b19-9843-8ae05c59ace0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:11.939719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d454e-3235-4b19-9843-8ae05c59ace0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:11.940090 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d454e-3235-4b19-9843-8ae05c59ace0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:11.940719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d454e-3235-4b19-9843-8ae05c59ace0 admin admin] PATH_INFO: `/v3/projects/30e03105dbff4482bceb8c770893bd13/users/d60ae14b5bb64b0db27d777486e882b8/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:11.994421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d454e-3235-4b19-9843-8ae05c59ace0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e03105dbff4482bceb8c770893bd13, user_id=d60ae14b5bb64b0db27d777486e882b8, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:12.000939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d454e-3235-4b19-9843-8ae05c59ace0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:12.167013 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 867/1738] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:11 2022] PUT /identity/v3/projects/30e03105dbff4482bceb8c770893bd13/users/d60ae14b5bb64b0db27d777486e882b8/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:12.180240 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652db790-31a8-49bf-bedf-3066b3a333ea None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.180741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652db790-31a8-49bf-bedf-3066b3a333ea None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:12.181217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652db790-31a8-49bf-bedf-3066b3a333ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:12.318131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-652db790-31a8-49bf-bedf-3066b3a333ea None None] MFA Rules not processed for user `d60ae14b5bb64b0db27d777486e882b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:12.319845 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-652db790-31a8-49bf-bedf-3066b3a333ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:12.587019 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 872/1739] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:12.593645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d454e-3235-4b19-9843-8ae05c59ace0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:12.944261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d454e-3235-4b19-9843-8ae05c59ace0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:12.988924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263822f2-d1eb-4025-8a7a-32d6a232d2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:12.991782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263822f2-d1eb-4025-8a7a-32d6a232d2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:12.993417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263822f2-d1eb-4025-8a7a-32d6a232d2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.006277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263822f2-d1eb-4025-8a7a-32d6a232d2d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.007927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263822f2-d1eb-4025-8a7a-32d6a232d2d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:13.017685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263822f2-d1eb-4025-8a7a-32d6a232d2d3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:13.300282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:13.363447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652db790-31a8-49bf-bedf-3066b3a333ea None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:13.370722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 868/1740] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:12 2022] POST /identity/v3/projects => generated 363 bytes in 778 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:13.384836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652db790-31a8-49bf-bedf-3066b3a333ea None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:13.435321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:13.734691 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a47c5-647a-4637-8490-68c9f5c6abbc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.735253 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a47c5-647a-4637-8490-68c9f5c6abbc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.735734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a47c5-647a-4637-8490-68c9f5c6abbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.826651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b56b4-05d6-47a7-a229-f1e8241c269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:13.829666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b56b4-05d6-47a7-a229-f1e8241c269a admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:13.834997 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b56b4-05d6-47a7-a229-f1e8241c269a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:13.838123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b56b4-05d6-47a7-a229-f1e8241c269a admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:13.845252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b56b4-05d6-47a7-a229-f1e8241c269a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:13.849529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b56b4-05d6-47a7-a229-f1e8241c269a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:14.016505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6d2a47c5-647a-4637-8490-68c9f5c6abbc None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:14.025184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6d2a47c5-647a-4637-8490-68c9f5c6abbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:14.066354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 873/1741] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:13 2022] POST /identity/v3/users => generated 288 bytes in 704 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:14.067912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b56b4-05d6-47a7-a229-f1e8241c269a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:14.136776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b56b4-05d6-47a7-a229-f1e8241c269a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:14.167179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee6173-6ff1-41ad-9efb-3f920e71032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:14.168447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee6173-6ff1-41ad-9efb-3f920e71032f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:14.169045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee6173-6ff1-41ad-9efb-3f920e71032f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:14.169638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee6173-6ff1-41ad-9efb-3f920e71032f admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:14.170917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee6173-6ff1-41ad-9efb-3f920e71032f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:14.186752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee6173-6ff1-41ad-9efb-3f920e71032f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:14.251479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 874/1742] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:14.280895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee6173-6ff1-41ad-9efb-3f920e71032f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:14.326591 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 869/1743] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:36:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 594 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:14.343281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee6173-6ff1-41ad-9efb-3f920e71032f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:14.360611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414c740-e4dd-4a49-8674-8d038f80370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:14.360611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c740-e4dd-4a49-8674-8d038f80370f admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:14.360611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c740-e4dd-4a49-8674-8d038f80370f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:14.360611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414c740-e4dd-4a49-8674-8d038f80370f admin admin] PATH_INFO: `/v3/projects/f55e70f3e25c4ce5bc08a8e4b38bd094/users/c5c56010d9af437cb483e4e7603230cf/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:14.406055 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414c740-e4dd-4a49-8674-8d038f80370f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55e70f3e25c4ce5bc08a8e4b38bd094, user_id=c5c56010d9af437cb483e4e7603230cf, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:14.414575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414c740-e4dd-4a49-8674-8d038f80370f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:14.558762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 875/1744] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:14 2022] PUT /identity/v3/projects/f55e70f3e25c4ce5bc08a8e4b38bd094/users/c5c56010d9af437cb483e4e7603230cf/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:14.559808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a47c5-647a-4637-8490-68c9f5c6abbc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:14.583692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a47c5-647a-4637-8490-68c9f5c6abbc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:14.721580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83467b97-1c56-4647-bce5-8b63b71b1b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:14.722938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83467b97-1c56-4647-bce5-8b63b71b1b2e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:14.723448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83467b97-1c56-4647-bce5-8b63b71b1b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:14.724029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83467b97-1c56-4647-bce5-8b63b71b1b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:14.725845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83467b97-1c56-4647-bce5-8b63b71b1b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:14.727981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83467b97-1c56-4647-bce5-8b63b71b1b2e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:14.773992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 870/1745] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:36:14.779045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414c740-e4dd-4a49-8674-8d038f80370f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:14.833684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414c740-e4dd-4a49-8674-8d038f80370f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:14.857496 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31558fce-be5a-476c-aedf-b54607856ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:14.860820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31558fce-be5a-476c-aedf-b54607856ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:14.863922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31558fce-be5a-476c-aedf-b54607856ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:14.865648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31558fce-be5a-476c-aedf-b54607856ef5 admin admin] PATH_INFO: `/v3/projects/f55e70f3e25c4ce5bc08a8e4b38bd094/users/c5c56010d9af437cb483e4e7603230cf/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:14.873210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31558fce-be5a-476c-aedf-b54607856ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55e70f3e25c4ce5bc08a8e4b38bd094, user_id=c5c56010d9af437cb483e4e7603230cf, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:14.879311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31558fce-be5a-476c-aedf-b54607856ef5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:14.998401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 876/1746] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:14 2022] PUT /identity/v3/projects/f55e70f3e25c4ce5bc08a8e4b38bd094/users/c5c56010d9af437cb483e4e7603230cf/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:15.025922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f4878-4f39-4788-a3e2-6862b05c4943 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:15.031429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f4878-4f39-4788-a3e2-6862b05c4943 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:15.032383 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f4878-4f39-4788-a3e2-6862b05c4943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:15.062084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31558fce-be5a-476c-aedf-b54607856ef5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:15.064657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-31558fce-be5a-476c-aedf-b54607856ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:15.193975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-690f4878-4f39-4788-a3e2-6862b05c4943 None None] MFA Rules not processed for user `c5c56010d9af437cb483e4e7603230cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:15.198014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-690f4878-4f39-4788-a3e2-6862b05c4943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:15.526848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31558fce-be5a-476c-aedf-b54607856ef5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:15.535330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675e733-4828-48ba-8523-4690102badec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:15.536550 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675e733-4828-48ba-8523-4690102badec service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:15.538174 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675e733-4828-48ba-8523-4690102badec service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:15.538675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675e733-4828-48ba-8523-4690102badec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:15.594120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 871/1747] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 568 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:15.601165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff157561-c962-4836-a5d8-a50d1644b301 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:15.602990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff157561-c962-4836-a5d8-a50d1644b301 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:15.605226 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff157561-c962-4836-a5d8-a50d1644b301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:15.674477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ff157561-c962-4836-a5d8-a50d1644b301 None None] MFA Rules not processed for user `c33b81f98c4e4e919d60f408ad24e594`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:15.678494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ff157561-c962-4836-a5d8-a50d1644b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:15.815932 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675e733-4828-48ba-8523-4690102badec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:15.836678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675e733-4828-48ba-8523-4690102badec service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:15.879174 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 877/1748] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:36:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 818 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:36:15.882478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675e733-4828-48ba-8523-4690102badec service swift] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:15.884796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5675e733-4828-48ba-8523-4690102badec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:15.991280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 872/1749] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:16.194841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675e733-4828-48ba-8523-4690102badec service swift] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:16.202849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5652091-4ea1-4250-9314-5539301e7bac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:16.204186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5652091-4ea1-4250-9314-5539301e7bac service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:16.204883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5652091-4ea1-4250-9314-5539301e7bac service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:16.205360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5652091-4ea1-4250-9314-5539301e7bac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:16.266942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5652091-4ea1-4250-9314-5539301e7bac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:16.274148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5652091-4ea1-4250-9314-5539301e7bac service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:16.312623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 878/1750] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:16.533629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bcabc-86df-4d59-8f22-625a974351b0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:16.534242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bcabc-86df-4d59-8f22-625a974351b0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:16.534783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222bcabc-86df-4d59-8f22-625a974351b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:16.629158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-222bcabc-86df-4d59-8f22-625a974351b0 None None] MFA Rules not processed for user `36ae407308bf4947b1f113f5390db714`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:16.639875 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-222bcabc-86df-4d59-8f22-625a974351b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:16.870828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 873/1751] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:16.920135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5652091-4ea1-4250-9314-5539301e7bac service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:16.924392 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b5652091-4ea1-4250-9314-5539301e7bac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:16.975581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:17.007339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5652091-4ea1-4250-9314-5539301e7bac service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:17.052804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8a64d-aa8a-458d-b458-23d04076e849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:17.054305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a64d-aa8a-458d-b458-23d04076e849 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:17.054610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a64d-aa8a-458d-b458-23d04076e849 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:17.054916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8a64d-aa8a-458d-b458-23d04076e849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:17.218406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:17.403029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8a64d-aa8a-458d-b458-23d04076e849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:17.404934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8a64d-aa8a-458d-b458-23d04076e849 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:17.438493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 879/1752] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:19.344769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1deef0-c15e-44b9-a23d-393b008d28ae None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:19.345618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1deef0-c15e-44b9-a23d-393b008d28ae None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:19.345618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1deef0-c15e-44b9-a23d-393b008d28ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:19.399734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1e1deef0-c15e-44b9-a23d-393b008d28ae None None] MFA Rules not processed for user `02432d1312a34273813856362cada1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:19.409738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1e1deef0-c15e-44b9-a23d-393b008d28ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:19.633734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 874/1753] 10.222.0.17 () {58 vars in 1015 bytes} [Thu Sep 1 16:36:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:20.013236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8a64d-aa8a-458d-b458-23d04076e849 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:20.015697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f3b8a64d-aa8a-458d-b458-23d04076e849 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:20.053441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8a64d-aa8a-458d-b458-23d04076e849 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:20.073564 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc64af-7b0f-445f-8486-1d979794d701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:20.075889 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc64af-7b0f-445f-8486-1d979794d701 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:20.076161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc64af-7b0f-445f-8486-1d979794d701 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:20.076839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc64af-7b0f-445f-8486-1d979794d701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:20.107312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc64af-7b0f-445f-8486-1d979794d701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:20.111419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc64af-7b0f-445f-8486-1d979794d701 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:20.143228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 880/1754] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:20.659066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:21.804177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:24.428423 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d23062-92dd-45f5-bb86-20f1a743d73e None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:24.429082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d23062-92dd-45f5-bb86-20f1a743d73e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:24.429211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d23062-92dd-45f5-bb86-20f1a743d73e None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:24.431404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 875/1755] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 1 16:36:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:36:24.461863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341374-8734-4218-a5a2-2fabce5ad97d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:24.463837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341374-8734-4218-a5a2-2fabce5ad97d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:24.466486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf341374-8734-4218-a5a2-2fabce5ad97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:24.564679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-cf341374-8734-4218-a5a2-2fabce5ad97d None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:24.568563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cf341374-8734-4218-a5a2-2fabce5ad97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:24.882083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 881/1756] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 1 16:36:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:25.396231 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d23062-92dd-45f5-bb86-20f1a743d73e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:25.399288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d1d23062-92dd-45f5-bb86-20f1a743d73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:25.560187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d23062-92dd-45f5-bb86-20f1a743d73e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:25.594955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f4dbd-ceed-404e-b104-c9fe35d425c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:25.594955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f4dbd-ceed-404e-b104-c9fe35d425c2 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:25.594955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f4dbd-ceed-404e-b104-c9fe35d425c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:25.594955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f4dbd-ceed-404e-b104-c9fe35d425c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:25.643516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f4dbd-ceed-404e-b104-c9fe35d425c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:25.649274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f4dbd-ceed-404e-b104-c9fe35d425c2 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:25.666134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 876/1757] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:26.994568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e2559-cbe7-4689-82e4-2c56aca75410 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:26.995362 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e2559-cbe7-4689-82e4-2c56aca75410 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:26.995362 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e2559-cbe7-4689-82e4-2c56aca75410 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:26.997003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 882/1758] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 1 16:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:36:27.016688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a9e1d-cf66-4612-837c-2934352f9db1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:27.017608 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a9e1d-cf66-4612-837c-2934352f9db1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:27.018173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a9e1d-cf66-4612-837c-2934352f9db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:27.063948 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c92a9e1d-cf66-4612-837c-2934352f9db1 None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:27.065469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c92a9e1d-cf66-4612-837c-2934352f9db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:27.096545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 877/1759] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 1 16:36:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:27.231418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e2559-cbe7-4689-82e4-2c56aca75410 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:27.272341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468e2559-cbe7-4689-82e4-2c56aca75410 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:27.283875 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6f12e-e759-417a-950c-a1acd32a36c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:27.285393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6f12e-e759-417a-950c-a1acd32a36c8 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:27.285963 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6f12e-e759-417a-950c-a1acd32a36c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:27.291073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6f12e-e759-417a-950c-a1acd32a36c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:27.299411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6f12e-e759-417a-950c-a1acd32a36c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:27.302268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6f12e-e759-417a-950c-a1acd32a36c8 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:27.325132 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 883/1760] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:31.256632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a9e1d-cf66-4612-837c-2934352f9db1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:31.520883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a9e1d-cf66-4612-837c-2934352f9db1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:31.528684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:31.532945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:31.533475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:31.534700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] PATH_INFO: `/v3/users/d60ae14b5bb64b0db27d777486e882b8` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:31.537606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60ae14b5bb64b0db27d777486e882b8)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:31.542165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:31.908079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:31.929287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60ae14b5bb64b0db27d777486e882b8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.952683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60ae14b5bb64b0db27d777486e882b8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:31.961689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60ae14b5bb64b0db27d777486e882b8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.080716 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60ae14b5bb64b0db27d777486e882b8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.096210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60ae14b5bb64b0db27d777486e882b8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:32.171715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 878/1761] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:31 2022] DELETE /identity/v3/users/d60ae14b5bb64b0db27d777486e882b8 => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:32.176894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74ebd-090a-4998-9054-8bc4cb923c58 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.178486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74ebd-090a-4998-9054-8bc4cb923c58 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.178761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee74ebd-090a-4998-9054-8bc4cb923c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.275048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-bee74ebd-090a-4998-9054-8bc4cb923c58 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:32.276758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bee74ebd-090a-4998-9054-8bc4cb923c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:32.466766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 884/1762] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:32.482508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:32.484063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:32.603781 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ccd953-ecd3-4fb8-840d-6f75f8132507 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:32.612267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb7b8-263a-4d6d-ae9d-7d03d5712060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:32.613746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb7b8-263a-4d6d-ae9d-7d03d5712060 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:32.614807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb7b8-263a-4d6d-ae9d-7d03d5712060 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:32.615282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfb7b8-263a-4d6d-ae9d-7d03d5712060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:32.635794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfb7b8-263a-4d6d-ae9d-7d03d5712060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:32.638736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfb7b8-263a-4d6d-ae9d-7d03d5712060 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:32.657860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 879/1763] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:34.044081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee74ebd-090a-4998-9054-8bc4cb923c58 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:34.045746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bee74ebd-090a-4998-9054-8bc4cb923c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:34.054727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:34.062172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee74ebd-090a-4998-9054-8bc4cb923c58 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:34.066544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:34.067883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:34.068158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:34.068590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] PATH_INFO: `/v3/projects/30e03105dbff4482bceb8c770893bd13` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:34.070553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e03105dbff4482bceb8c770893bd13)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:34.075065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:34.250473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e03105dbff4482bceb8c770893bd13', 'request_id': 'req-2c7fb9ea-95f9-48fd-b703-486fbd7290df'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:34.262882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e03105dbff4482bceb8c770893bd13', 'request_id': 'req-2c7fb9ea-95f9-48fd-b703-486fbd7290df'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:34.337491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e03105dbff4482bceb8c770893bd13', 'request_id': 'req-2c7fb9ea-95f9-48fd-b703-486fbd7290df'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:34.352779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] The token cache is being invalidate because project 30e03105dbff4482bceb8c770893bd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:34.353193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:34.353719 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:34.355420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 885/1764] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:34 2022] DELETE /identity/v3/projects/30e03105dbff4482bceb8c770893bd13 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:34.363053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb7b8-263a-4d6d-ae9d-7d03d5712060 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:34.375185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfb7b8-263a-4d6d-ae9d-7d03d5712060 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:34.469929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b046d17-9791-4efe-8679-1052891ad828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:34.470901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046d17-9791-4efe-8679-1052891ad828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:34.471292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046d17-9791-4efe-8679-1052891ad828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:34.471956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b046d17-9791-4efe-8679-1052891ad828 admin admin] PATH_INFO: `/v3/users/c5c56010d9af437cb483e4e7603230cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:34.482115 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b046d17-9791-4efe-8679-1052891ad828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c56010d9af437cb483e4e7603230cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:34.486864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b046d17-9791-4efe-8679-1052891ad828 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:34.884362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3b046d17-9791-4efe-8679-1052891ad828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c56010d9af437cb483e4e7603230cf'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:34.897397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3b046d17-9791-4efe-8679-1052891ad828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c56010d9af437cb483e4e7603230cf'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:34.898458 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3b046d17-9791-4efe-8679-1052891ad828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c56010d9af437cb483e4e7603230cf'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:35.019469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3b046d17-9791-4efe-8679-1052891ad828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c56010d9af437cb483e4e7603230cf'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:35.021845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3b046d17-9791-4efe-8679-1052891ad828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c56010d9af437cb483e4e7603230cf'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:35.025782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:35.047871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 880/1765] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:34 2022] DELETE /identity/v3/users/c5c56010d9af437cb483e4e7603230cf => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:35.699284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:35.700866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:35.718392 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb9ea-95f9-48fd-b703-486fbd7290df admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:35.788647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:35.789339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:35.789619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:35.789917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] PATH_INFO: `/v3/projects/f55e70f3e25c4ce5bc08a8e4b38bd094` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:35.791096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55e70f3e25c4ce5bc08a8e4b38bd094)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:35.793141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:35.967035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55e70f3e25c4ce5bc08a8e4b38bd094', 'request_id': 'req-cf66978d-de29-48fb-b712-9c4204d2118f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:35.976359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55e70f3e25c4ce5bc08a8e4b38bd094', 'request_id': 'req-cf66978d-de29-48fb-b712-9c4204d2118f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:36.197189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55e70f3e25c4ce5bc08a8e4b38bd094', 'request_id': 'req-cf66978d-de29-48fb-b712-9c4204d2118f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:36.219037 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] The token cache is being invalidate because project f55e70f3e25c4ce5bc08a8e4b38bd094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:36.219801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:36.220972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:36.224584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 886/1766] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:35 2022] DELETE /identity/v3/projects/f55e70f3e25c4ce5bc08a8e4b38bd094 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:36.230022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a768f7-80fc-4030-ba80-419a35f14798 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:36.230550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a768f7-80fc-4030-ba80-419a35f14798 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:36.230650 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a768f7-80fc-4030-ba80-419a35f14798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:36.238508 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:36.241092 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:36.259753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-67a768f7-80fc-4030-ba80-419a35f14798 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:36.261642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-67a768f7-80fc-4030-ba80-419a35f14798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:36.274855 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:36.383949 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66978d-de29-48fb-b712-9c4204d2118f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:36.387414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 881/1767] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:36.389521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32a33f-ed5e-43f5-96c1-959a3ed5f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:36.390335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a33f-ed5e-43f5-96c1-959a3ed5f355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:36.390693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a33f-ed5e-43f5-96c1-959a3ed5f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:36.391310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a33f-ed5e-43f5-96c1-959a3ed5f355 admin admin] PATH_INFO: `/v3/users/d28939f679ee405ea364cda08204ef16` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:36.393018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32a33f-ed5e-43f5-96c1-959a3ed5f355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28939f679ee405ea364cda08204ef16)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:36.397951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83929a6b-a23b-4877-b79a-fd316440f257 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:36.401809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32a33f-ed5e-43f5-96c1-959a3ed5f355 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:36.402032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83929a6b-a23b-4877-b79a-fd316440f257 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:36.402032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83929a6b-a23b-4877-b79a-fd316440f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:36.445064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-83929a6b-a23b-4877-b79a-fd316440f257 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:36.447117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-83929a6b-a23b-4877-b79a-fd316440f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:36.460061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 882/1768] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:36.464833 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83929a6b-a23b-4877-b79a-fd316440f257 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:36.479009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83929a6b-a23b-4877-b79a-fd316440f257 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:36.487733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db74250-f6d3-4670-88b4-3f3d03dc72d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:36.489930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db74250-f6d3-4670-88b4-3f3d03dc72d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:36.490349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db74250-f6d3-4670-88b4-3f3d03dc72d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:36.490707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db74250-f6d3-4670-88b4-3f3d03dc72d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:36.491354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db74250-f6d3-4670-88b4-3f3d03dc72d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:36.491891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db74250-f6d3-4670-88b4-3f3d03dc72d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:36.493838 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db74250-f6d3-4670-88b4-3f3d03dc72d8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:36.510789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 883/1769] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:36.515410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db74250-f6d3-4670-88b4-3f3d03dc72d8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:36.526931 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db74250-f6d3-4670-88b4-3f3d03dc72d8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:36.541091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63c6b8-8929-4bd3-b0fe-2ee80f8fab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:36.541733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c6b8-8929-4bd3-b0fe-2ee80f8fab9d admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:36.542061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c6b8-8929-4bd3-b0fe-2ee80f8fab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:36.542338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63c6b8-8929-4bd3-b0fe-2ee80f8fab9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:36.543040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63c6b8-8929-4bd3-b0fe-2ee80f8fab9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:36.560027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63c6b8-8929-4bd3-b0fe-2ee80f8fab9d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:36.772339 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 884/1770] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:36 2022] POST /identity/v3/projects => generated 369 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:36.776589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63c6b8-8929-4bd3-b0fe-2ee80f8fab9d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:36.843808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6c32a33f-ed5e-43f5-96c1-959a3ed5f355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28939f679ee405ea364cda08204ef16'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:36.855342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6c32a33f-ed5e-43f5-96c1-959a3ed5f355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28939f679ee405ea364cda08204ef16'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:36.856529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6c32a33f-ed5e-43f5-96c1-959a3ed5f355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28939f679ee405ea364cda08204ef16'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:36.890160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63c6b8-8929-4bd3-b0fe-2ee80f8fab9d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:36.890160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfa042-c8f5-46e4-853b-6443f85f3ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:36.890160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa042-c8f5-46e4-853b-6443f85f3ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:36.890160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa042-c8f5-46e4-853b-6443f85f3ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:36.890498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa042-c8f5-46e4-853b-6443f85f3ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:36.890498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfa042-c8f5-46e4-853b-6443f85f3ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:36.891960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfa042-c8f5-46e4-853b-6443f85f3ca2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:36.977564 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6c32a33f-ed5e-43f5-96c1-959a3ed5f355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28939f679ee405ea364cda08204ef16'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:36.991642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 885/1771] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:36 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:36.992852 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6c32a33f-ed5e-43f5-96c1-959a3ed5f355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28939f679ee405ea364cda08204ef16'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:36.992958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfa042-c8f5-46e4-853b-6443f85f3ca2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:36.994817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-85dfa042-c8f5-46e4-853b-6443f85f3ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:37.004917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 887/1772] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:36 2022] DELETE /identity/v3/users/d28939f679ee405ea364cda08204ef16 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:37.006459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887d88d-af05-4c64-a379-955c56af5eef None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:37.006999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887d88d-af05-4c64-a379-955c56af5eef None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:37.007489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887d88d-af05-4c64-a379-955c56af5eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:37.014274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfa042-c8f5-46e4-853b-6443f85f3ca2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:37.033178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f887d88d-af05-4c64-a379-955c56af5eef None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:37.033178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f887d88d-af05-4c64-a379-955c56af5eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:37.108495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a6c45-9a00-4b6e-8ec9-6fdd708ebf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:37.109361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6c45-9a00-4b6e-8ec9-6fdd708ebf11 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:37.109723 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6c45-9a00-4b6e-8ec9-6fdd708ebf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:37.110154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6c45-9a00-4b6e-8ec9-6fdd708ebf11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:37.111354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a6c45-9a00-4b6e-8ec9-6fdd708ebf11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:37.113739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a6c45-9a00-4b6e-8ec9-6fdd708ebf11 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:37.130530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 886/1773] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:37.132161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a6c45-9a00-4b6e-8ec9-6fdd708ebf11 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:37.147205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 888/1774] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:37.147430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a6c45-9a00-4b6e-8ec9-6fdd708ebf11 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:37.160366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887d88d-af05-4c64-a379-955c56af5eef None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:37.166859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e92e0-35f1-4774-a3e8-2ddfde53b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:37.167014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f887d88d-af05-4c64-a379-955c56af5eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:37.167097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e92e0-35f1-4774-a3e8-2ddfde53b5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:37.167097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e92e0-35f1-4774-a3e8-2ddfde53b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:37.167097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e92e0-35f1-4774-a3e8-2ddfde53b5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:37.169400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e92e0-35f1-4774-a3e8-2ddfde53b5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:37.171032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e92e0-35f1-4774-a3e8-2ddfde53b5d7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:37.189839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 887/1775] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:37.196420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e92e0-35f1-4774-a3e8-2ddfde53b5d7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:37.211626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e92e0-35f1-4774-a3e8-2ddfde53b5d7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:37.221299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b81be-3719-47e8-95cf-a24e5e53df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:37.222626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b81be-3719-47e8-95cf-a24e5e53df13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:37.223273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b81be-3719-47e8-95cf-a24e5e53df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:37.224156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b81be-3719-47e8-95cf-a24e5e53df13 admin admin] PATH_INFO: `/v3/projects/2ac59d6550c24208af9d898ce81fb2cd/users/8a5a32d17e064c97bfa556b13ae2948e/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:37.247384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b81be-3719-47e8-95cf-a24e5e53df13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac59d6550c24208af9d898ce81fb2cd, user_id=8a5a32d17e064c97bfa556b13ae2948e, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:37.260696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b81be-3719-47e8-95cf-a24e5e53df13 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:37.262334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887d88d-af05-4c64-a379-955c56af5eef None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:37.284455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b559e-8db3-4b69-9947-259a1257c66a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:37.285244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b559e-8db3-4b69-9947-259a1257c66a service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:37.285465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b559e-8db3-4b69-9947-259a1257c66a service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:37.285775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b559e-8db3-4b69-9947-259a1257c66a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:37.299727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b559e-8db3-4b69-9947-259a1257c66a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:37.302383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b559e-8db3-4b69-9947-259a1257c66a service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:37.316042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 889/1776] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:37.424344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 888/1777] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:37 2022] PUT /identity/v3/projects/2ac59d6550c24208af9d898ce81fb2cd/users/8a5a32d17e064c97bfa556b13ae2948e/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:37.438663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66bc86-1022-4ea4-96e3-cd82a48ea475 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:37.438943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66bc86-1022-4ea4-96e3-cd82a48ea475 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:37.439218 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66bc86-1022-4ea4-96e3-cd82a48ea475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:37.486477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5d66bc86-1022-4ea4-96e3-cd82a48ea475 None None] MFA Rules not processed for user `8a5a32d17e064c97bfa556b13ae2948e`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:37.487940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5d66bc86-1022-4ea4-96e3-cd82a48ea475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:37.596878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 890/1778] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:37.602708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b81be-3719-47e8-95cf-a24e5e53df13 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:37.701782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b81be-3719-47e8-95cf-a24e5e53df13 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:37.707064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc836f-670e-4dce-8791-4773da8b4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:37.708595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc836f-670e-4dce-8791-4773da8b4294 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:37.708595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc836f-670e-4dce-8791-4773da8b4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:37.708595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc836f-670e-4dce-8791-4773da8b4294 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:37.709219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc836f-670e-4dce-8791-4773da8b4294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:37.712568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc836f-670e-4dce-8791-4773da8b4294 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:38.522855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 889/1779] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:37 2022] POST /identity/v3/projects => generated 369 bytes in 921 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:38.528401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66bc86-1022-4ea4-96e3-cd82a48ea475 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:38.538628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66bc86-1022-4ea4-96e3-cd82a48ea475 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:38.611957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee5c51-e179-47fb-b9d8-480c494e93a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:38.612996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee5c51-e179-47fb-b9d8-480c494e93a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:38.613309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee5c51-e179-47fb-b9d8-480c494e93a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:38.613702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee5c51-e179-47fb-b9d8-480c494e93a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:38.614532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee5c51-e179-47fb-b9d8-480c494e93a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:38.617683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee5c51-e179-47fb-b9d8-480c494e93a6 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:38.888287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc836f-670e-4dce-8791-4773da8b4294 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:38.890964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ffdc836f-670e-4dce-8791-4773da8b4294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:38.910447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc836f-670e-4dce-8791-4773da8b4294 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:38.921297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:38.922605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:38.923127 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:38.923572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] PATH_INFO: `/v3/projects/5960d4538fdc4af4a715559812b87da4` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:38.924979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5960d4538fdc4af4a715559812b87da4)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:38.929308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:38.989970 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 891/1780] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:38 2022] POST /identity/v3/users => generated 291 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:38.994388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee5c51-e179-47fb-b9d8-480c494e93a6 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:39.015166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee5c51-e179-47fb-b9d8-480c494e93a6 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:39.022454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4ff0f-dfb4-4a33-bd99-15a77fe9c1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:39.023193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4ff0f-dfb4-4a33-bd99-15a77fe9c1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.023779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4ff0f-dfb4-4a33-bd99-15a77fe9c1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.024114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4ff0f-dfb4-4a33-bd99-15a77fe9c1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.024835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4ff0f-dfb4-4a33-bd99-15a77fe9c1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:39.026920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4ff0f-dfb4-4a33-bd99-15a77fe9c1e1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:39.041227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 892/1781] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:36:39.045238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4ff0f-dfb4-4a33-bd99-15a77fe9c1e1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:39.057801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4ff0f-dfb4-4a33-bd99-15a77fe9c1e1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:39.062904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdad09-28ab-42f1-bdd5-7bdf61e5a4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:39.063713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdad09-28ab-42f1-bdd5-7bdf61e5a4d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.063994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdad09-28ab-42f1-bdd5-7bdf61e5a4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.064269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdad09-28ab-42f1-bdd5-7bdf61e5a4d2 admin admin] PATH_INFO: `/v3/projects/52c562e800c9487bb11035f017324d76/users/6d51d492bb084a8e8e72eb67e524c551/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.083014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdad09-28ab-42f1-bdd5-7bdf61e5a4d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c562e800c9487bb11035f017324d76, user_id=6d51d492bb084a8e8e72eb67e524c551, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:39.087669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdad09-28ab-42f1-bdd5-7bdf61e5a4d2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:39.179212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:39.182513 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 893/1782] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:39 2022] PUT /identity/v3/projects/52c562e800c9487bb11035f017324d76/users/6d51d492bb084a8e8e72eb67e524c551/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:39.183781 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdad09-28ab-42f1-bdd5-7bdf61e5a4d2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:39.213553 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5960d4538fdc4af4a715559812b87da4', 'request_id': 'req-1851af8d-3b67-420e-827f-9213277bdb81'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.237577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5960d4538fdc4af4a715559812b87da4', 'request_id': 'req-1851af8d-3b67-420e-827f-9213277bdb81'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.264576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5960d4538fdc4af4a715559812b87da4', 'request_id': 'req-1851af8d-3b67-420e-827f-9213277bdb81'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.372549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdad09-28ab-42f1-bdd5-7bdf61e5a4d2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:39.397110 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] The token cache is being invalidate because project 5960d4538fdc4af4a715559812b87da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:39.397648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.398654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1851af8d-3b67-420e-827f-9213277bdb81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.401755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 890/1783] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:38 2022] DELETE /identity/v3/projects/5960d4538fdc4af4a715559812b87da4 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:39.414875 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3211532-4901-4d07-828d-22a29254e585 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.415187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3211532-4901-4d07-828d-22a29254e585 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.417386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3211532-4901-4d07-828d-22a29254e585 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.420018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 891/1784] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 1 16:36:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:36:39.420988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3211532-4901-4d07-828d-22a29254e585 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:39.422914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b3211532-4901-4d07-828d-22a29254e585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:39.565141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3423e0-7b76-4bb2-bf44-d70c55deb929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:39.566721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3423e0-7b76-4bb2-bf44-d70c55deb929 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.567286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3423e0-7b76-4bb2-bf44-d70c55deb929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.567767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3423e0-7b76-4bb2-bf44-d70c55deb929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.569763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3423e0-7b76-4bb2-bf44-d70c55deb929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:39.573018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3423e0-7b76-4bb2-bf44-d70c55deb929 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:39.577015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3211532-4901-4d07-828d-22a29254e585 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:39.582262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:39.584564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.585074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.585558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] PATH_INFO: `/v3/users/2f4e54ed39074e258136c7a0e745a71b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.588186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4e54ed39074e258136c7a0e745a71b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:39.591796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:39.592039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 894/1785] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:39.605243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3423e0-7b76-4bb2-bf44-d70c55deb929 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:39.606715 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1e3423e0-7b76-4bb2-bf44-d70c55deb929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:39.620814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3423e0-7b76-4bb2-bf44-d70c55deb929 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:39.628267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb2d39-159b-4030-b71c-5f1e7ce67b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:39.628857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2d39-159b-4030-b71c-5f1e7ce67b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.629133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2d39-159b-4030-b71c-5f1e7ce67b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.629400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb2d39-159b-4030-b71c-5f1e7ce67b07 admin admin] PATH_INFO: `/v3/projects/52c562e800c9487bb11035f017324d76/users/6d51d492bb084a8e8e72eb67e524c551/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.633190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb2d39-159b-4030-b71c-5f1e7ce67b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c562e800c9487bb11035f017324d76, user_id=6d51d492bb084a8e8e72eb67e524c551, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:39.636210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb2d39-159b-4030-b71c-5f1e7ce67b07 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:39.649740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 895/1786] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:39 2022] PUT /identity/v3/projects/52c562e800c9487bb11035f017324d76/users/6d51d492bb084a8e8e72eb67e524c551/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:39.651132 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d467e62-5cda-4a16-832d-bc90aaa806e9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.651407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d467e62-5cda-4a16-832d-bc90aaa806e9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.651674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d467e62-5cda-4a16-832d-bc90aaa806e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.680878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0d467e62-5cda-4a16-832d-bc90aaa806e9 None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:39.682548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0d467e62-5cda-4a16-832d-bc90aaa806e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:39.784612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 896/1787] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 1 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:39.786877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d564b-c371-4684-98ce-494332c184e1 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.787294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d564b-c371-4684-98ce-494332c184e1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.787777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d564b-c371-4684-98ce-494332c184e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.826370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-870d564b-c371-4684-98ce-494332c184e1 None None] MFA Rules not processed for user `6d51d492bb084a8e8e72eb67e524c551`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:39.827628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-870d564b-c371-4684-98ce-494332c184e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:39.903834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4e54ed39074e258136c7a0e745a71b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.927858 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4e54ed39074e258136c7a0e745a71b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.928351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 897/1788] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:39.928805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4e54ed39074e258136c7a0e745a71b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:39.931031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d564b-c371-4684-98ce-494332c184e1 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:39.938551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-870d564b-c371-4684-98ce-494332c184e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:39.953542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d564b-c371-4684-98ce-494332c184e1 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:39.960679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981159e-1543-4100-8bba-fab4930de378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:39.961392 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981159e-1543-4100-8bba-fab4930de378 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:39.961742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981159e-1543-4100-8bba-fab4930de378 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:39.962132 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981159e-1543-4100-8bba-fab4930de378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:39.972531 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981159e-1543-4100-8bba-fab4930de378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:39.975385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981159e-1543-4100-8bba-fab4930de378 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:39.989552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 898/1789] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:39.989841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981159e-1543-4100-8bba-fab4930de378 service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:39.991155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7981159e-1543-4100-8bba-fab4930de378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:40.011466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4e54ed39074e258136c7a0e745a71b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:40.014319 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4e54ed39074e258136c7a0e745a71b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:40.050678 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 892/1790] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:39 2022] DELETE /identity/v3/users/2f4e54ed39074e258136c7a0e745a71b => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:40.072302 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981159e-1543-4100-8bba-fab4930de378 service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:40.161030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3504f9c-27d6-4ed4-8c54-91df34acf681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:40.162205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504f9c-27d6-4ed4-8c54-91df34acf681 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:40.163045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504f9c-27d6-4ed4-8c54-91df34acf681 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:40.163671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3504f9c-27d6-4ed4-8c54-91df34acf681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:40.166633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e3504f9c-27d6-4ed4-8c54-91df34acf681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:40.257076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3504f9c-27d6-4ed4-8c54-91df34acf681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:40.259148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3504f9c-27d6-4ed4-8c54-91df34acf681 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:40.283100 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 899/1791] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:40.511989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:40.513645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:40.530356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de4523-16b6-43a0-ac4c-41ce77cc0cd6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:40.534984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a23440-50a2-42f0-bfd0-7bc7e6458c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:40.535777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23440-50a2-42f0-bfd0-7bc7e6458c41 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:40.536125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23440-50a2-42f0-bfd0-7bc7e6458c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:40.536611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23440-50a2-42f0-bfd0-7bc7e6458c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:40.538987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e7a23440-50a2-42f0-bfd0-7bc7e6458c41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:40.627410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23440-50a2-42f0-bfd0-7bc7e6458c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:40.629236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23440-50a2-42f0-bfd0-7bc7e6458c41 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:40.651187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 893/1792] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:40.750052 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3504f9c-27d6-4ed4-8c54-91df34acf681 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:40.759004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e3504f9c-27d6-4ed4-8c54-91df34acf681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:40.882891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:40.938892 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3504f9c-27d6-4ed4-8c54-91df34acf681 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:40.946116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:40.946592 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:40.946873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:40.947126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] PATH_INFO: `/v3/projects/effa92dcaf944c22b8c381fb415051f4` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:40.962557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=effa92dcaf944c22b8c381fb415051f4)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:40.966081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:41.191827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'effa92dcaf944c22b8c381fb415051f4', 'request_id': 'req-7665a058-3034-4b22-8d2e-37639a0748b1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:41.204747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'effa92dcaf944c22b8c381fb415051f4', 'request_id': 'req-7665a058-3034-4b22-8d2e-37639a0748b1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:41.315755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'effa92dcaf944c22b8c381fb415051f4', 'request_id': 'req-7665a058-3034-4b22-8d2e-37639a0748b1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:41.341177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] The token cache is being invalidate because project effa92dcaf944c22b8c381fb415051f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:41.341460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:41.342207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7665a058-3034-4b22-8d2e-37639a0748b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:41.344161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 900/1793] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:40 2022] DELETE /identity/v3/projects/effa92dcaf944c22b8c381fb415051f4 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:41.350734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab898-3c81-4dae-8dde-1f5331e87613 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:41.351028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab898-3c81-4dae-8dde-1f5331e87613 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:41.351358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ab898-3c81-4dae-8dde-1f5331e87613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:41.378586 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fd6ab898-3c81-4dae-8dde-1f5331e87613 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:41.379908 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fd6ab898-3c81-4dae-8dde-1f5331e87613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:41.466733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 894/1794] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:41.477471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa85e37-08df-472c-9fe1-7a7bc75b6cc4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:41.477758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa85e37-08df-472c-9fe1-7a7bc75b6cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:41.479457 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa85e37-08df-472c-9fe1-7a7bc75b6cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:41.506871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-efa85e37-08df-472c-9fe1-7a7bc75b6cc4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:41.508242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-efa85e37-08df-472c-9fe1-7a7bc75b6cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:41.523233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 901/1795] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:41.524852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ab898-3c81-4dae-8dde-1f5331e87613 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:41.546107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ab898-3c81-4dae-8dde-1f5331e87613 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:41.554615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442ea78-3f8a-40e4-897b-f4849279bdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:41.555643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442ea78-3f8a-40e4-897b-f4849279bdfa admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:41.556482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442ea78-3f8a-40e4-897b-f4849279bdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:41.557408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442ea78-3f8a-40e4-897b-f4849279bdfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:41.558800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442ea78-3f8a-40e4-897b-f4849279bdfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:41.559458 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442ea78-3f8a-40e4-897b-f4849279bdfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:41.562701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442ea78-3f8a-40e4-897b-f4849279bdfa admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:41.603873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 895/1796] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:41.604952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa85e37-08df-472c-9fe1-7a7bc75b6cc4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:41.618695 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa85e37-08df-472c-9fe1-7a7bc75b6cc4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:41.636828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc450f4-6e14-4863-adf6-48530d026594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:41.637614 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc450f4-6e14-4863-adf6-48530d026594 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:41.639148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc450f4-6e14-4863-adf6-48530d026594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:41.639654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc450f4-6e14-4863-adf6-48530d026594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:41.640886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc450f4-6e14-4863-adf6-48530d026594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:41.647588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc450f4-6e14-4863-adf6-48530d026594 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:41.871662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 902/1797] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:41 2022] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:41.873585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442ea78-3f8a-40e4-897b-f4849279bdfa admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:41.886495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442ea78-3f8a-40e4-897b-f4849279bdfa admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:41.983760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb9e53-8f9a-4dac-8a83-75ec607dbb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:41.984448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb9e53-8f9a-4dac-8a83-75ec607dbb27 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:41.984971 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb9e53-8f9a-4dac-8a83-75ec607dbb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:41.985462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb9e53-8f9a-4dac-8a83-75ec607dbb27 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:41.986344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb9e53-8f9a-4dac-8a83-75ec607dbb27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:41.988519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bb9e53-8f9a-4dac-8a83-75ec607dbb27 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:42.108669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 896/1798] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:41 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:42.113401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc450f4-6e14-4863-adf6-48530d026594 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.125467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc450f4-6e14-4863-adf6-48530d026594 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:42.131393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a3c8-6db6-4ebf-af15-f61850e032b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:42.138412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a3c8-6db6-4ebf-af15-f61850e032b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.138412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a3c8-6db6-4ebf-af15-f61850e032b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.138412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a3c8-6db6-4ebf-af15-f61850e032b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.138412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710a3c8-6db6-4ebf-af15-f61850e032b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:42.138412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710a3c8-6db6-4ebf-af15-f61850e032b4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:42.151754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 903/1799] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:42.156812 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb9e53-8f9a-4dac-8a83-75ec607dbb27 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.178581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb9e53-8f9a-4dac-8a83-75ec607dbb27 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:42.184069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29accd5-b5e6-453f-b817-fea212b7a2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:42.184799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29accd5-b5e6-453f-b817-fea212b7a2ce admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.184977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29accd5-b5e6-453f-b817-fea212b7a2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.185221 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29accd5-b5e6-453f-b817-fea212b7a2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.185895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29accd5-b5e6-453f-b817-fea212b7a2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:42.187505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29accd5-b5e6-453f-b817-fea212b7a2ce admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:42.199995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 897/1800] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:42.204984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a3c8-6db6-4ebf-af15-f61850e032b4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.217926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a3c8-6db6-4ebf-af15-f61850e032b4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:42.225141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d119d-f5d9-47bd-9ca8-c73f091b3d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:42.226101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d119d-f5d9-47bd-9ca8-c73f091b3d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.227580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d119d-f5d9-47bd-9ca8-c73f091b3d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.228884 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d119d-f5d9-47bd-9ca8-c73f091b3d8c admin admin] PATH_INFO: `/v3/projects/131b6407f90e4c0097f1901ba0572898/users/95244bb4b0f943c8a6ff9636be8e00c9/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.248129 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d119d-f5d9-47bd-9ca8-c73f091b3d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=131b6407f90e4c0097f1901ba0572898, user_id=95244bb4b0f943c8a6ff9636be8e00c9, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:42.251219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d119d-f5d9-47bd-9ca8-c73f091b3d8c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:42.419994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 904/1801] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:42 2022] PUT /identity/v3/projects/131b6407f90e4c0097f1901ba0572898/users/95244bb4b0f943c8a6ff9636be8e00c9/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:42.435464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373bd44-f028-4bb6-ab4c-9ef65668d392 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.436430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373bd44-f028-4bb6-ab4c-9ef65668d392 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.437298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373bd44-f028-4bb6-ab4c-9ef65668d392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.475030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1373bd44-f028-4bb6-ab4c-9ef65668d392 None None] MFA Rules not processed for user `95244bb4b0f943c8a6ff9636be8e00c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:42.476450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1373bd44-f028-4bb6-ab4c-9ef65668d392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:42.570860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 898/1802] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:42.577021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d119d-f5d9-47bd-9ca8-c73f091b3d8c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.652511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d119d-f5d9-47bd-9ca8-c73f091b3d8c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:42.657319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6871724-561a-4c41-b60e-1bd75b216e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:42.706778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6871724-561a-4c41-b60e-1bd75b216e2f admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:42.706778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6871724-561a-4c41-b60e-1bd75b216e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:42.706778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6871724-561a-4c41-b60e-1bd75b216e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:42.706778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6871724-561a-4c41-b60e-1bd75b216e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:42.706778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6871724-561a-4c41-b60e-1bd75b216e2f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:42.956426 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 905/1803] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:42 2022] POST /identity/v3/projects => generated 383 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:42.961710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373bd44-f028-4bb6-ab4c-9ef65668d392 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:42.997302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373bd44-f028-4bb6-ab4c-9ef65668d392 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:43.095926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404e79e-f79e-43b3-aa62-3838427057de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:43.097012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404e79e-f79e-43b3-aa62-3838427057de admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:43.097707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404e79e-f79e-43b3-aa62-3838427057de admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:43.099954 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404e79e-f79e-43b3-aa62-3838427057de admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:43.100745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404e79e-f79e-43b3-aa62-3838427057de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:43.103328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404e79e-f79e-43b3-aa62-3838427057de admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:43.210219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 899/1804] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:42 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:36:43.212225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6871724-561a-4c41-b60e-1bd75b216e2f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:43.228548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6871724-561a-4c41-b60e-1bd75b216e2f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:43.234601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b0b84-e748-46da-b195-0a7f36f5026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:43.235574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b0b84-e748-46da-b195-0a7f36f5026e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:43.236424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b0b84-e748-46da-b195-0a7f36f5026e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:43.236708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b0b84-e748-46da-b195-0a7f36f5026e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:43.237381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b0b84-e748-46da-b195-0a7f36f5026e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:43.240429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b0b84-e748-46da-b195-0a7f36f5026e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:43.266952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 906/1805] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:43.270869 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404e79e-f79e-43b3-aa62-3838427057de admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:43.293419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404e79e-f79e-43b3-aa62-3838427057de admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:43.315544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a678d7f-b94c-4acc-865b-6bfc7d569730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:43.319274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a678d7f-b94c-4acc-865b-6bfc7d569730 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:43.320587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a678d7f-b94c-4acc-865b-6bfc7d569730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:43.322126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a678d7f-b94c-4acc-865b-6bfc7d569730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:43.324968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a678d7f-b94c-4acc-865b-6bfc7d569730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:43.328275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a678d7f-b94c-4acc-865b-6bfc7d569730 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:43.360142 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b0b84-e748-46da-b195-0a7f36f5026e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:43.372591 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 900/1806] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:43.376677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b0b84-e748-46da-b195-0a7f36f5026e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:43.386875 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d151f0-9c87-4d9b-a330-aa2c534d895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:43.388326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d151f0-9c87-4d9b-a330-aa2c534d895c admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:43.388608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d151f0-9c87-4d9b-a330-aa2c534d895c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:43.388948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d151f0-9c87-4d9b-a330-aa2c534d895c admin admin] PATH_INFO: `/v3/projects/e2ef35948d93427489f5a8568dd0f73d/users/33659a27c18543c28b1aecae06ed0afd/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:43.425675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d151f0-9c87-4d9b-a330-aa2c534d895c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ef35948d93427489f5a8568dd0f73d, user_id=33659a27c18543c28b1aecae06ed0afd, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:43.429087 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d151f0-9c87-4d9b-a330-aa2c534d895c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:43.561956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 907/1807] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:43 2022] PUT /identity/v3/projects/e2ef35948d93427489f5a8568dd0f73d/users/33659a27c18543c28b1aecae06ed0afd/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:43.577587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86383c8-d36b-43fb-8a05-d50f4890be45 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:43.577998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86383c8-d36b-43fb-8a05-d50f4890be45 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:43.579051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86383c8-d36b-43fb-8a05-d50f4890be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:43.612294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c86383c8-d36b-43fb-8a05-d50f4890be45 None None] MFA Rules not processed for user `33659a27c18543c28b1aecae06ed0afd`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:43.615443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c86383c8-d36b-43fb-8a05-d50f4890be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:43.701074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 901/1808] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:43.705573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d151f0-9c87-4d9b-a330-aa2c534d895c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:43.814009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d151f0-9c87-4d9b-a330-aa2c534d895c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:43.820929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089db58-fa95-40e0-aeb3-82c035dcdc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:43.821567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089db58-fa95-40e0-aeb3-82c035dcdc1c admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:43.821847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089db58-fa95-40e0-aeb3-82c035dcdc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:43.822163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089db58-fa95-40e0-aeb3-82c035dcdc1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:43.822814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089db58-fa95-40e0-aeb3-82c035dcdc1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:43.824750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089db58-fa95-40e0-aeb3-82c035dcdc1c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:44.019157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 908/1809] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:43 2022] POST /identity/v3/projects => generated 385 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:44.024135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86383c8-d36b-43fb-8a05-d50f4890be45 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:44.038627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86383c8-d36b-43fb-8a05-d50f4890be45 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:44.066797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:44.146996 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f15213-bd57-4876-8c79-b6f1c3c37940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:44.147883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f15213-bd57-4876-8c79-b6f1c3c37940 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:44.148390 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f15213-bd57-4876-8c79-b6f1c3c37940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:44.148703 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f15213-bd57-4876-8c79-b6f1c3c37940 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:44.150548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f15213-bd57-4876-8c79-b6f1c3c37940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:44.152517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f15213-bd57-4876-8c79-b6f1c3c37940 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:44.285045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 902/1810] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:44 2022] POST /identity/v3/users => generated 299 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:44.289084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089db58-fa95-40e0-aeb3-82c035dcdc1c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:44.315545 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089db58-fa95-40e0-aeb3-82c035dcdc1c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:44.327344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5cd6-0cc6-4783-a8d7-b335fec168e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:44.328043 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5cd6-0cc6-4783-a8d7-b335fec168e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:44.328331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5cd6-0cc6-4783-a8d7-b335fec168e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:44.328604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b5cd6-0cc6-4783-a8d7-b335fec168e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:44.329319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b5cd6-0cc6-4783-a8d7-b335fec168e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:44.330972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b5cd6-0cc6-4783-a8d7-b335fec168e9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:44.352660 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 909/1811] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:44.354979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f15213-bd57-4876-8c79-b6f1c3c37940 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:44.370783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f15213-bd57-4876-8c79-b6f1c3c37940 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:44.377092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f809a-5f44-4776-b970-fc2443c5ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:44.377975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f809a-5f44-4776-b970-fc2443c5ba60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:44.378324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f809a-5f44-4776-b970-fc2443c5ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:44.378830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f809a-5f44-4776-b970-fc2443c5ba60 admin admin] PATH_INFO: `/v3/projects/073705e135464944b0c4b79f83dda5c5/users/52f61b1701684810bff5c3a76bb45cb2/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:44.403944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f809a-5f44-4776-b970-fc2443c5ba60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073705e135464944b0c4b79f83dda5c5, user_id=52f61b1701684810bff5c3a76bb45cb2, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:44.418389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f809a-5f44-4776-b970-fc2443c5ba60 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:44.565024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 903/1812] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:44 2022] PUT /identity/v3/projects/073705e135464944b0c4b79f83dda5c5/users/52f61b1701684810bff5c3a76bb45cb2/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:44.569849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5cd6-0cc6-4783-a8d7-b335fec168e9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:44.580995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b5cd6-0cc6-4783-a8d7-b335fec168e9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:44.690799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b36f56-4ecd-48f2-b32c-5ff1f813438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:44.691605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b36f56-4ecd-48f2-b32c-5ff1f813438e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:44.692586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b36f56-4ecd-48f2-b32c-5ff1f813438e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:44.693685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b36f56-4ecd-48f2-b32c-5ff1f813438e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:44.695372 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b36f56-4ecd-48f2-b32c-5ff1f813438e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:44.697438 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b36f56-4ecd-48f2-b32c-5ff1f813438e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:44.721337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f809a-5f44-4776-b970-fc2443c5ba60 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:44.721867 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 910/1813] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:44.745812 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f809a-5f44-4776-b970-fc2443c5ba60 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:44.763025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f00b99-8ad8-47bc-ae76-54fb0e75e7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:44.763724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f00b99-8ad8-47bc-ae76-54fb0e75e7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:44.764009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f00b99-8ad8-47bc-ae76-54fb0e75e7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:44.764296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f00b99-8ad8-47bc-ae76-54fb0e75e7d4 admin admin] PATH_INFO: `/v3/projects/073705e135464944b0c4b79f83dda5c5/users/52f61b1701684810bff5c3a76bb45cb2/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:44.768758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f00b99-8ad8-47bc-ae76-54fb0e75e7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073705e135464944b0c4b79f83dda5c5, user_id=52f61b1701684810bff5c3a76bb45cb2, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:44.776396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f00b99-8ad8-47bc-ae76-54fb0e75e7d4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:44.813648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 904/1814] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:44 2022] PUT /identity/v3/projects/073705e135464944b0c4b79f83dda5c5/users/52f61b1701684810bff5c3a76bb45cb2/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:44.842782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde96d2-ee25-4d96-a670-0146ff224488 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:44.853712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde96d2-ee25-4d96-a670-0146ff224488 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:44.853712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde96d2-ee25-4d96-a670-0146ff224488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:44.936496 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9bde96d2-ee25-4d96-a670-0146ff224488 None None] MFA Rules not processed for user `52f61b1701684810bff5c3a76bb45cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:44.939005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9bde96d2-ee25-4d96-a670-0146ff224488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:45.110053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 911/1815] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:45.174944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f00b99-8ad8-47bc-ae76-54fb0e75e7d4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:45.178204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-83f00b99-8ad8-47bc-ae76-54fb0e75e7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:45.275772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f00b99-8ad8-47bc-ae76-54fb0e75e7d4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:45.279685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb599d-bd90-4a5e-929d-08e630c96264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:45.280717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb599d-bd90-4a5e-929d-08e630c96264 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:45.280717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb599d-bd90-4a5e-929d-08e630c96264 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:45.280917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb599d-bd90-4a5e-929d-08e630c96264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:45.346746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb599d-bd90-4a5e-929d-08e630c96264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:45.348828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb599d-bd90-4a5e-929d-08e630c96264 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:45.359418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 905/1816] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:45.789988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:47.892636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:48.349978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:48.498421 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde96d2-ee25-4d96-a670-0146ff224488 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:48.500479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9bde96d2-ee25-4d96-a670-0146ff224488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:48.531130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb599d-bd90-4a5e-929d-08e630c96264 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:48.545810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb599d-bd90-4a5e-929d-08e630c96264 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:48.554904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116bd3b-9ec0-46d1-863b-401811925e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:48.556414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116bd3b-9ec0-46d1-863b-401811925e10 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:48.556697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116bd3b-9ec0-46d1-863b-401811925e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:48.556972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116bd3b-9ec0-46d1-863b-401811925e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:48.595937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde96d2-ee25-4d96-a670-0146ff224488 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:48.602743 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:48.603930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:48.604228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:48.604503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] PATH_INFO: `/v3/users/8a5a32d17e064c97bfa556b13ae2948e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:48.605850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5a32d17e064c97bfa556b13ae2948e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:48.608110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:48.637272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116bd3b-9ec0-46d1-863b-401811925e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:48.638744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116bd3b-9ec0-46d1-863b-401811925e10 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:48.650653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 906/1817] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:48.928808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5a32d17e064c97bfa556b13ae2948e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:48.937102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5a32d17e064c97bfa556b13ae2948e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:48.937403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5a32d17e064c97bfa556b13ae2948e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:49.140543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5a32d17e064c97bfa556b13ae2948e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:49.166096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5a32d17e064c97bfa556b13ae2948e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:49.173122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 912/1818] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:48 2022] DELETE /identity/v3/users/8a5a32d17e064c97bfa556b13ae2948e => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:49.178374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2964-0c0c-4e14-8e25-96f825653c51 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:49.178863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2964-0c0c-4e14-8e25-96f825653c51 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:49.179171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc2964-0c0c-4e14-8e25-96f825653c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:49.209504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-88cc2964-0c0c-4e14-8e25-96f825653c51 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:49.211004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-88cc2964-0c0c-4e14-8e25-96f825653c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:49.285396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 907/1819] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:49.296211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:49.297952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:49.363265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fabe31-c66d-437b-aea7-ce99115686f1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:49.367796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0609e4-9142-442a-a58a-2aa9cecc1cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:49.370209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0609e4-9142-442a-a58a-2aa9cecc1cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:49.370209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0609e4-9142-442a-a58a-2aa9cecc1cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:49.370209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0609e4-9142-442a-a58a-2aa9cecc1cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:49.380839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0609e4-9142-442a-a58a-2aa9cecc1cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:49.382654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0609e4-9142-442a-a58a-2aa9cecc1cb1 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:49.403462 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 913/1820] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:50.402777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc2964-0c0c-4e14-8e25-96f825653c51 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:50.404389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-88cc2964-0c0c-4e14-8e25-96f825653c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:50.417034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc2964-0c0c-4e14-8e25-96f825653c51 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:50.422515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:50.426992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:50.426992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:50.426992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] PATH_INFO: `/v3/projects/2ac59d6550c24208af9d898ce81fb2cd` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:50.426992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac59d6550c24208af9d898ce81fb2cd)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:50.428888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:50.664494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac59d6550c24208af9d898ce81fb2cd', 'request_id': 'req-c165f761-2d38-48e0-844c-aab1f4e41b99'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:50.674105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac59d6550c24208af9d898ce81fb2cd', 'request_id': 'req-c165f761-2d38-48e0-844c-aab1f4e41b99'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:50.681011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac59d6550c24208af9d898ce81fb2cd', 'request_id': 'req-c165f761-2d38-48e0-844c-aab1f4e41b99'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:50.822659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] The token cache is being invalidate because project 2ac59d6550c24208af9d898ce81fb2cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:50.822955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:50.825913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:50.827975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 908/1821] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:50 2022] DELETE /identity/v3/projects/2ac59d6550c24208af9d898ce81fb2cd => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:50.832615 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0609e4-9142-442a-a58a-2aa9cecc1cb1 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:50.846750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0609e4-9142-442a-a58a-2aa9cecc1cb1 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:50.952223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:50.953495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:50.954384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:50.954384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] PATH_INFO: `/v3/users/6d51d492bb084a8e8e72eb67e524c551` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:50.955405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d51d492bb084a8e8e72eb67e524c551)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:50.957429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:51.235517 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d51d492bb084a8e8e72eb67e524c551'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:51.261687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d51d492bb084a8e8e72eb67e524c551'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:51.263805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d51d492bb084a8e8e72eb67e524c551'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:51.365389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:51.367439 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:51.373507 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d51d492bb084a8e8e72eb67e524c551'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:51.404337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d51d492bb084a8e8e72eb67e524c551'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:51.419831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 914/1822] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:50 2022] DELETE /identity/v3/users/6d51d492bb084a8e8e72eb67e524c551 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:51.503912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:51.565325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165f761-2d38-48e0-844c-aab1f4e41b99 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:51.662880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9810e-3612-41ad-a657-3d5d791c94ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:51.663517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9810e-3612-41ad-a657-3d5d791c94ff service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:51.663801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9810e-3612-41ad-a657-3d5d791c94ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:51.664074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9810e-3612-41ad-a657-3d5d791c94ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:51.666190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c1f9810e-3612-41ad-a657-3d5d791c94ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:51.758546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9810e-3612-41ad-a657-3d5d791c94ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:51.760995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9810e-3612-41ad-a657-3d5d791c94ff service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:51.773363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 909/1823] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:36:52.514869 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:52.976689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:52.982973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:53.072823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff22b0-268a-4f2d-9a14-4c11cb947b22 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:53.079297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:53.079970 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:53.081405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:53.081405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] PATH_INFO: `/v3/projects/52c562e800c9487bb11035f017324d76` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:53.081690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c562e800c9487bb11035f017324d76)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:53.085567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:53.329115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c562e800c9487bb11035f017324d76', 'request_id': 'req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:53.334095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:53.339673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c562e800c9487bb11035f017324d76', 'request_id': 'req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:53.470046 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c562e800c9487bb11035f017324d76', 'request_id': 'req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:53.489663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] The token cache is being invalidate because project 52c562e800c9487bb11035f017324d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:53.491477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:53.493645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fc2b9d7f-f8fe-4974-a452-9ccb739558c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:53.498009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 915/1824] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:52 2022] DELETE /identity/v3/projects/52c562e800c9487bb11035f017324d76 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:53.503920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8bfd9-af5b-4157-85e6-a66908ad15ab None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:53.504462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8bfd9-af5b-4157-85e6-a66908ad15ab None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:53.504590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8bfd9-af5b-4157-85e6-a66908ad15ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:53.537325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fdf8bfd9-af5b-4157-85e6-a66908ad15ab None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:53.538451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fdf8bfd9-af5b-4157-85e6-a66908ad15ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:53.608079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 910/1825] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:53.616747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1af66e-e659-4f7a-b48d-a01ab349ac0f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:53.617057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1af66e-e659-4f7a-b48d-a01ab349ac0f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:53.617311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1af66e-e659-4f7a-b48d-a01ab349ac0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:53.640277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-bd1af66e-e659-4f7a-b48d-a01ab349ac0f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:53.641593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bd1af66e-e659-4f7a-b48d-a01ab349ac0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:53.650341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 916/1826] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:53.654719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8bfd9-af5b-4157-85e6-a66908ad15ab None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:53.667232 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8bfd9-af5b-4157-85e6-a66908ad15ab None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:53.677636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d2d53-4cfe-4ba6-ba16-02b883607dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:53.678322 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d2d53-4cfe-4ba6-ba16-02b883607dbc admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:53.678629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d2d53-4cfe-4ba6-ba16-02b883607dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:53.679292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d2d53-4cfe-4ba6-ba16-02b883607dbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:53.680634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d2d53-4cfe-4ba6-ba16-02b883607dbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:36:53.681144 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d2d53-4cfe-4ba6-ba16-02b883607dbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:53.684038 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d2d53-4cfe-4ba6-ba16-02b883607dbc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:53.701928 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 911/1827] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:36:53.706010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1af66e-e659-4f7a-b48d-a01ab349ac0f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:53.720178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1af66e-e659-4f7a-b48d-a01ab349ac0f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:53.726832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b135be7-ab2a-43ee-ad04-dc0dd8f0f9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:53.727488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135be7-ab2a-43ee-ad04-dc0dd8f0f9ca admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:53.727769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135be7-ab2a-43ee-ad04-dc0dd8f0f9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:53.728038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b135be7-ab2a-43ee-ad04-dc0dd8f0f9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:53.728816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b135be7-ab2a-43ee-ad04-dc0dd8f0f9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:53.730858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b135be7-ab2a-43ee-ad04-dc0dd8f0f9ca admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:53.954510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d2d53-4cfe-4ba6-ba16-02b883607dbc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:53.964618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 917/1828] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:53 2022] POST /identity/v3/projects => generated 381 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:53.977274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d2d53-4cfe-4ba6-ba16-02b883607dbc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:54.134423 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997efe-5ee0-4521-aedb-f8047534baad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:54.135798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997efe-5ee0-4521-aedb-f8047534baad admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:54.136321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997efe-5ee0-4521-aedb-f8047534baad admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:54.136917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07997efe-5ee0-4521-aedb-f8047534baad admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:54.138055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997efe-5ee0-4521-aedb-f8047534baad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:54.140178 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07997efe-5ee0-4521-aedb-f8047534baad admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:54.374681 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 912/1829] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:53 2022] POST /identity/v3/users => generated 291 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:54.383881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b135be7-ab2a-43ee-ad04-dc0dd8f0f9ca admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:54.398996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b135be7-ab2a-43ee-ad04-dc0dd8f0f9ca admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:54.403962 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d46ad-6aeb-495d-9e3c-356f80dbf8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:54.404790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d46ad-6aeb-495d-9e3c-356f80dbf8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:54.405070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d46ad-6aeb-495d-9e3c-356f80dbf8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:54.405340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d46ad-6aeb-495d-9e3c-356f80dbf8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:54.406200 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d46ad-6aeb-495d-9e3c-356f80dbf8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:54.407822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d46ad-6aeb-495d-9e3c-356f80dbf8f2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:54.420822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 918/1830] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:54.436175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997efe-5ee0-4521-aedb-f8047534baad admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:54.451657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07997efe-5ee0-4521-aedb-f8047534baad admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:54.456619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0c68e-2a53-497e-b31c-152103a1d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:54.457281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0c68e-2a53-497e-b31c-152103a1d054 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:54.457592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0c68e-2a53-497e-b31c-152103a1d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:54.458518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0c68e-2a53-497e-b31c-152103a1d054 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:54.459177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0c68e-2a53-497e-b31c-152103a1d054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:54.460770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0c68e-2a53-497e-b31c-152103a1d054 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:54.479602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 913/1831] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:54.481932 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d46ad-6aeb-495d-9e3c-356f80dbf8f2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:54.512744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d46ad-6aeb-495d-9e3c-356f80dbf8f2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:54.519479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930a9e9-3eaf-4370-9ad5-b4a9f6f30521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:54.520975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a9e9-3eaf-4370-9ad5-b4a9f6f30521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:54.521438 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a9e9-3eaf-4370-9ad5-b4a9f6f30521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:54.521842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a9e9-3eaf-4370-9ad5-b4a9f6f30521 admin admin] PATH_INFO: `/v3/projects/9d12cb7780df403c9b8869baa6b64c3b/users/1ec45720f8ee4aef879feb58f73aec1e/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:54.545661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930a9e9-3eaf-4370-9ad5-b4a9f6f30521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d12cb7780df403c9b8869baa6b64c3b, user_id=1ec45720f8ee4aef879feb58f73aec1e, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:54.548484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930a9e9-3eaf-4370-9ad5-b4a9f6f30521 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:54.679556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 919/1832] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:54 2022] PUT /identity/v3/projects/9d12cb7780df403c9b8869baa6b64c3b/users/1ec45720f8ee4aef879feb58f73aec1e/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:54.693985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac7f0f-6b7e-416c-9ddb-532e1c67f73d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:54.697454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac7f0f-6b7e-416c-9ddb-532e1c67f73d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:54.697920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac7f0f-6b7e-416c-9ddb-532e1c67f73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:54.775027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a1ac7f0f-6b7e-416c-9ddb-532e1c67f73d None None] MFA Rules not processed for user `1ec45720f8ee4aef879feb58f73aec1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:54.780417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a1ac7f0f-6b7e-416c-9ddb-532e1c67f73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:54.915137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 914/1833] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:54.920388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930a9e9-3eaf-4370-9ad5-b4a9f6f30521 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:55.043009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930a9e9-3eaf-4370-9ad5-b4a9f6f30521 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:55.050437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad84ed7-fade-4189-b9ff-fa01125bad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:55.051649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad84ed7-fade-4189-b9ff-fa01125bad1b admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:55.052263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad84ed7-fade-4189-b9ff-fa01125bad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:55.053065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad84ed7-fade-4189-b9ff-fa01125bad1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:55.054674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad84ed7-fade-4189-b9ff-fa01125bad1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:55.057370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad84ed7-fade-4189-b9ff-fa01125bad1b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:55.214065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 920/1834] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:36:54 2022] POST /identity/v3/projects => generated 383 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:55.218355 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac7f0f-6b7e-416c-9ddb-532e1c67f73d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:55.230230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac7f0f-6b7e-416c-9ddb-532e1c67f73d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:55.343744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f6c5c-77e8-4079-9b76-7851126a09ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:55.344684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f6c5c-77e8-4079-9b76-7851126a09ca admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:55.345058 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f6c5c-77e8-4079-9b76-7851126a09ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:55.345428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f6c5c-77e8-4079-9b76-7851126a09ca admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:55.346515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f6c5c-77e8-4079-9b76-7851126a09ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:55.349866 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f6c5c-77e8-4079-9b76-7851126a09ca admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:55.514914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 915/1835] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:36:55 2022] POST /identity/v3/users => generated 298 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:36:55.519405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad84ed7-fade-4189-b9ff-fa01125bad1b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:55.543989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad84ed7-fade-4189-b9ff-fa01125bad1b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:55.559056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1342d-01f2-4644-98a4-a6036b581c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:55.559056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1342d-01f2-4644-98a4-a6036b581c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:55.559056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1342d-01f2-4644-98a4-a6036b581c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:55.559056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1342d-01f2-4644-98a4-a6036b581c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:55.559334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1342d-01f2-4644-98a4-a6036b581c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:55.559334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1342d-01f2-4644-98a4-a6036b581c35 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:55.574457 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 921/1836] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:55.578609 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f6c5c-77e8-4079-9b76-7851126a09ca admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:55.596067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f6c5c-77e8-4079-9b76-7851126a09ca admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:55.604312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384f354-9728-4753-bd3a-dfd9e157e15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:55.604847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384f354-9728-4753-bd3a-dfd9e157e15d admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:55.605318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384f354-9728-4753-bd3a-dfd9e157e15d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:55.605543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384f354-9728-4753-bd3a-dfd9e157e15d admin admin] PATH_INFO: `/v3/projects/dab2e4b8245b4831ad672adc273ca5fa/users/84d2e88b37f6469cba3a84995654ad9a/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:55.629668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384f354-9728-4753-bd3a-dfd9e157e15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab2e4b8245b4831ad672adc273ca5fa, user_id=84d2e88b37f6469cba3a84995654ad9a, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:55.635391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384f354-9728-4753-bd3a-dfd9e157e15d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:55.767164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 916/1837] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:55 2022] PUT /identity/v3/projects/dab2e4b8245b4831ad672adc273ca5fa/users/84d2e88b37f6469cba3a84995654ad9a/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:55.771780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1342d-01f2-4644-98a4-a6036b581c35 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:55.782437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1342d-01f2-4644-98a4-a6036b581c35 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:55.885405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32080953-3070-4082-950b-7b30048d91c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:55.886363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32080953-3070-4082-950b-7b30048d91c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:55.886790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32080953-3070-4082-950b-7b30048d91c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:55.898060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32080953-3070-4082-950b-7b30048d91c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:55.898060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32080953-3070-4082-950b-7b30048d91c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:55.898060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32080953-3070-4082-950b-7b30048d91c0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:55.903842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 922/1838] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:36:55.908983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384f354-9728-4753-bd3a-dfd9e157e15d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:55.931493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384f354-9728-4753-bd3a-dfd9e157e15d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:55.942569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910e28a-67ba-4eaa-8e5f-0a2b6d355931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:55.942569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e28a-67ba-4eaa-8e5f-0a2b6d355931 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:55.942569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e28a-67ba-4eaa-8e5f-0a2b6d355931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:55.942569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910e28a-67ba-4eaa-8e5f-0a2b6d355931 admin admin] PATH_INFO: `/v3/projects/dab2e4b8245b4831ad672adc273ca5fa/users/84d2e88b37f6469cba3a84995654ad9a/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:55.943491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910e28a-67ba-4eaa-8e5f-0a2b6d355931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab2e4b8245b4831ad672adc273ca5fa, user_id=84d2e88b37f6469cba3a84995654ad9a, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:55.946522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910e28a-67ba-4eaa-8e5f-0a2b6d355931 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:55.997806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 917/1839] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:36:55 2022] PUT /identity/v3/projects/dab2e4b8245b4831ad672adc273ca5fa/users/84d2e88b37f6469cba3a84995654ad9a/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:56.002995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46e8a7-629a-41c0-a951-744f764bbadf None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:56.003344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46e8a7-629a-41c0-a951-744f764bbadf None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:56.003668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed46e8a7-629a-41c0-a951-744f764bbadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:56.067012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ed46e8a7-629a-41c0-a951-744f764bbadf None None] MFA Rules not processed for user `84d2e88b37f6469cba3a84995654ad9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:56.068868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ed46e8a7-629a-41c0-a951-744f764bbadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:56.190753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 923/1840] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:36:56.314273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910e28a-67ba-4eaa-8e5f-0a2b6d355931 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:56.316328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a910e28a-67ba-4eaa-8e5f-0a2b6d355931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:56.321668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:56.392571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910e28a-67ba-4eaa-8e5f-0a2b6d355931 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:56.406170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf6b20-2966-45fd-864d-0c80e89f0b00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:56.406170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf6b20-2966-45fd-864d-0c80e89f0b00 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:56.406170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf6b20-2966-45fd-864d-0c80e89f0b00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:56.406170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf6b20-2966-45fd-864d-0c80e89f0b00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:56.418613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf6b20-2966-45fd-864d-0c80e89f0b00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:56.424787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf6b20-2966-45fd-864d-0c80e89f0b00 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:56.432849 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 918/1841] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:56.611456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46e8a7-629a-41c0-a951-744f764bbadf None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:56.613401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ed46e8a7-629a-41c0-a951-744f764bbadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:56.627774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed46e8a7-629a-41c0-a951-744f764bbadf None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:56.634813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23bbd-b824-4c3f-83cc-198aaed1f5b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:56.635522 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23bbd-b824-4c3f-83cc-198aaed1f5b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:56.635841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23bbd-b824-4c3f-83cc-198aaed1f5b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:56.636121 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23bbd-b824-4c3f-83cc-198aaed1f5b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:56.732516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d23bbd-b824-4c3f-83cc-198aaed1f5b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:56.735612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d23bbd-b824-4c3f-83cc-198aaed1f5b4 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:56.752502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 924/1842] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:57.438932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf6b20-2966-45fd-864d-0c80e89f0b00 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:57.440483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4ddf6b20-2966-45fd-864d-0c80e89f0b00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:57.544538 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf6b20-2966-45fd-864d-0c80e89f0b00 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:57.550175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76912681-7c39-48d6-900e-7bf98e00c263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:57.551363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76912681-7c39-48d6-900e-7bf98e00c263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:57.552244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76912681-7c39-48d6-900e-7bf98e00c263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:57.553250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76912681-7c39-48d6-900e-7bf98e00c263 admin admin] PATH_INFO: `/v3/users/9656b7469fd042efab53d0edde0837c0` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:57.561126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76912681-7c39-48d6-900e-7bf98e00c263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9656b7469fd042efab53d0edde0837c0)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:57.561126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76912681-7c39-48d6-900e-7bf98e00c263 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:57.620957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23bbd-b824-4c3f-83cc-198aaed1f5b4 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:57.622620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b4d23bbd-b824-4c3f-83cc-198aaed1f5b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:57.639062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23bbd-b824-4c3f-83cc-198aaed1f5b4 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:57.646183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab9757-d7e9-4261-82e7-ca5a34182020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:57.646850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9757-d7e9-4261-82e7-ca5a34182020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:57.647128 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9757-d7e9-4261-82e7-ca5a34182020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:57.647397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9757-d7e9-4261-82e7-ca5a34182020 admin admin] PATH_INFO: `/v3/users/95244bb4b0f943c8a6ff9636be8e00c9` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:57.648669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab9757-d7e9-4261-82e7-ca5a34182020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95244bb4b0f943c8a6ff9636be8e00c9)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:57.650689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab9757-d7e9-4261-82e7-ca5a34182020 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:57.985200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-76912681-7c39-48d6-900e-7bf98e00c263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9656b7469fd042efab53d0edde0837c0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:57.997030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-76912681-7c39-48d6-900e-7bf98e00c263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9656b7469fd042efab53d0edde0837c0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:57.998041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-76912681-7c39-48d6-900e-7bf98e00c263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9656b7469fd042efab53d0edde0837c0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.037039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4eab9757-d7e9-4261-82e7-ca5a34182020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95244bb4b0f943c8a6ff9636be8e00c9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.063931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4eab9757-d7e9-4261-82e7-ca5a34182020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95244bb4b0f943c8a6ff9636be8e00c9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.063931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4eab9757-d7e9-4261-82e7-ca5a34182020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95244bb4b0f943c8a6ff9636be8e00c9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.121339 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-76912681-7c39-48d6-900e-7bf98e00c263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9656b7469fd042efab53d0edde0837c0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.122021 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-76912681-7c39-48d6-900e-7bf98e00c263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9656b7469fd042efab53d0edde0837c0'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.183822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 919/1843] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:57 2022] DELETE /identity/v3/users/9656b7469fd042efab53d0edde0837c0 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:58.186023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8e29-182c-47db-b700-686ce89a42d1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:58.186468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8e29-182c-47db-b700-686ce89a42d1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:58.186849 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a8e29-182c-47db-b700-686ce89a42d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:58.232698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e77a8e29-182c-47db-b700-686ce89a42d1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:58.234200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e77a8e29-182c-47db-b700-686ce89a42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:58.259485 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4eab9757-d7e9-4261-82e7-ca5a34182020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95244bb4b0f943c8a6ff9636be8e00c9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.284350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4eab9757-d7e9-4261-82e7-ca5a34182020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95244bb4b0f943c8a6ff9636be8e00c9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:58.298272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 925/1844] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:57 2022] DELETE /identity/v3/users/95244bb4b0f943c8a6ff9636be8e00c9 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:58.304790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2e6e-ffd6-4a81-bc12-77cef50a3ecc None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:58.305080 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2e6e-ffd6-4a81-bc12-77cef50a3ecc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:58.305351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa2e6e-ffd6-4a81-bc12-77cef50a3ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:58.336805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 920/1845] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:58.349675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8e29-182c-47db-b700-686ce89a42d1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:58.352951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e77a8e29-182c-47db-b700-686ce89a42d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:58.353652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-daaa2e6e-ffd6-4a81-bc12-77cef50a3ecc None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:36:58.355286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-daaa2e6e-ffd6-4a81-bc12-77cef50a3ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:58.460944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 926/1846] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:36:58.465950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a8e29-182c-47db-b700-686ce89a42d1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:58.477509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa2e6e-ffd6-4a81-bc12-77cef50a3ecc None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:58.557329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044437-9952-4b65-8b26-763410f4203b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:58.558796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044437-9952-4b65-8b26-763410f4203b service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:58.559301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044437-9952-4b65-8b26-763410f4203b service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:58.559778 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044437-9952-4b65-8b26-763410f4203b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:58.573773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52044437-9952-4b65-8b26-763410f4203b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:58.576686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52044437-9952-4b65-8b26-763410f4203b service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:58.581012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa2e6e-ffd6-4a81-bc12-77cef50a3ecc None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:58.586688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f2cb9-7433-4558-b73f-6722ce671920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:58.588310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f2cb9-7433-4558-b73f-6722ce671920 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:58.588828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f2cb9-7433-4558-b73f-6722ce671920 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:58.589113 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f2cb9-7433-4558-b73f-6722ce671920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:58.594099 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 921/1847] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:58.601606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f2cb9-7433-4558-b73f-6722ce671920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:58.603099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7f2cb9-7433-4558-b73f-6722ce671920 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:58.614946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 927/1848] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:36:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:36:59.040716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:59.329848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044437-9952-4b65-8b26-763410f4203b service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:59.331400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-52044437-9952-4b65-8b26-763410f4203b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:59.351816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044437-9952-4b65-8b26-763410f4203b service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:59.373832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:59.373832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:59.373832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:59.373832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] PATH_INFO: `/v3/projects/131b6407f90e4c0097f1901ba0572898` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:59.375472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=131b6407f90e4c0097f1901ba0572898)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:59.379463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:59.482443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f2cb9-7433-4558-b73f-6722ce671920 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:59.484058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7b7f2cb9-7433-4558-b73f-6722ce671920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:59.506401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f2cb9-7433-4558-b73f-6722ce671920 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:59.516891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:59.516891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:59.516891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:59.516891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] PATH_INFO: `/v3/projects/e7acdd5b97004934948f719d699374f2` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:59.517683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7acdd5b97004934948f719d699374f2)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:59.521107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:36:59.648886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '131b6407f90e4c0097f1901ba0572898', 'request_id': 'req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.657557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '131b6407f90e4c0097f1901ba0572898', 'request_id': 'req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.664271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '131b6407f90e4c0097f1901ba0572898', 'request_id': 'req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.784044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7acdd5b97004934948f719d699374f2', 'request_id': 'req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.794193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7acdd5b97004934948f719d699374f2', 'request_id': 'req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.813387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] The token cache is being invalidate because project 131b6407f90e4c0097f1901ba0572898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:59.813707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.814618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.816327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 922/1849] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:59 2022] DELETE /identity/v3/projects/131b6407f90e4c0097f1901ba0572898 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:36:59.821142 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:59.822649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:59.906654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db5c6b-d88c-450b-9fcc-1f72f4d3cc43 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:36:59.913021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7acdd5b97004934948f719d699374f2', 'request_id': 'req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.928115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] The token cache is being invalidate because project e7acdd5b97004934948f719d699374f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:36:59.928509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.929730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:36:59.931721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 928/1850] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:36:59 2022] DELETE /identity/v3/projects/e7acdd5b97004934948f719d699374f2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:36:59.935795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:36:59.937367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:36:59.971752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:36:59.972410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:36:59.972690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:36:59.973502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] PATH_INFO: `/v3/users/33659a27c18543c28b1aecae06ed0afd` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:36:59.974852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=33659a27c18543c28b1aecae06ed0afd)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:36:59.976972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:00.010787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5372d3-9d9f-4e14-80e9-67f8c073cd55 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:00.015694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:00.016332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:00.016613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:00.016884 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] PATH_INFO: `/v3/users/990ea4d4b4144feaa99fb6dc9ccbb01b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:00.018885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=990ea4d4b4144feaa99fb6dc9ccbb01b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:00.021459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:00.143727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:00.240211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33659a27c18543c28b1aecae06ed0afd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.253329 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33659a27c18543c28b1aecae06ed0afd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.254402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33659a27c18543c28b1aecae06ed0afd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.262626 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '990ea4d4b4144feaa99fb6dc9ccbb01b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.271270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '990ea4d4b4144feaa99fb6dc9ccbb01b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.272237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '990ea4d4b4144feaa99fb6dc9ccbb01b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.365296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33659a27c18543c28b1aecae06ed0afd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.366068 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33659a27c18543c28b1aecae06ed0afd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.394461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 923/1851] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:59 2022] DELETE /identity/v3/users/33659a27c18543c28b1aecae06ed0afd => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:00.479312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '990ea4d4b4144feaa99fb6dc9ccbb01b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.498004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '990ea4d4b4144feaa99fb6dc9ccbb01b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:00.506353 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 929/1852] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:36:59 2022] DELETE /identity/v3/users/990ea4d4b4144feaa99fb6dc9ccbb01b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:00.915230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:00.916924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:01.002616 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5a583-32b7-40b9-9c61-b3a6c01a1b8f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.019076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.021322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:01.101688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.102391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.102675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.102956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] PATH_INFO: `/v3/users/1ec45720f8ee4aef879feb58f73aec1e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.104639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec45720f8ee4aef879feb58f73aec1e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.106800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.110927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447a4b6-1302-4546-81a3-57b3469b7615 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.118775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.120095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.120482 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.120842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] PATH_INFO: `/v3/projects/e2ef35948d93427489f5a8568dd0f73d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.122651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ef35948d93427489f5a8568dd0f73d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.126381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.408835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ef35948d93427489f5a8568dd0f73d', 'request_id': 'req-17578493-f09c-4740-8d9f-91eff8970466'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.410050 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec45720f8ee4aef879feb58f73aec1e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.416327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ef35948d93427489f5a8568dd0f73d', 'request_id': 'req-17578493-f09c-4740-8d9f-91eff8970466'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.417813 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec45720f8ee4aef879feb58f73aec1e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.418621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec45720f8ee4aef879feb58f73aec1e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.560413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ef35948d93427489f5a8568dd0f73d', 'request_id': 'req-17578493-f09c-4740-8d9f-91eff8970466'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.572639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] The token cache is being invalidate because project e2ef35948d93427489f5a8568dd0f73d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:01.572927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.573595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.575161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 930/1853] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:01 2022] DELETE /identity/v3/projects/e2ef35948d93427489f5a8568dd0f73d => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:01.575961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.577249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:01.646812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17578493-f09c-4740-8d9f-91eff8970466 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.651851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.652500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.652854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.653097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] PATH_INFO: `/v3/projects/b360da0b6dd24e23a735b14e241927e1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.654434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b360da0b6dd24e23a735b14e241927e1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.656331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.697445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec45720f8ee4aef879feb58f73aec1e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.698403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec45720f8ee4aef879feb58f73aec1e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.719232 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 924/1854] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:00 2022] DELETE /identity/v3/users/1ec45720f8ee4aef879feb58f73aec1e => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:01.720100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:01.721475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:01.804327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23bd44-1b25-4154-964f-a45c22caa25e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:01.810685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:01.811539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.811793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.812093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] PATH_INFO: `/v3/users/52f61b1701684810bff5c3a76bb45cb2` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:01.813255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f61b1701684810bff5c3a76bb45cb2)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:01.815359 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:01.849781 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b360da0b6dd24e23a735b14e241927e1', 'request_id': 'req-8a32c266-66fa-4494-a678-fdaf9040fd7b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.856682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b360da0b6dd24e23a735b14e241927e1', 'request_id': 'req-8a32c266-66fa-4494-a678-fdaf9040fd7b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.971232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b360da0b6dd24e23a735b14e241927e1', 'request_id': 'req-8a32c266-66fa-4494-a678-fdaf9040fd7b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.987279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] The token cache is being invalidate because project b360da0b6dd24e23a735b14e241927e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:01.987708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.988348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a32c266-66fa-4494-a678-fdaf9040fd7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:01.993760 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 931/1855] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:01 2022] DELETE /identity/v3/projects/b360da0b6dd24e23a735b14e241927e1 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:01.995158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c440b6-c240-435d-a6a1-27d3b39a4a4f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:01.995461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c440b6-c240-435d-a6a1-27d3b39a4a4f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:01.995725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c440b6-c240-435d-a6a1-27d3b39a4a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.016766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-36c440b6-c240-435d-a6a1-27d3b39a4a4f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:02.018038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-36c440b6-c240-435d-a6a1-27d3b39a4a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:02.090489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 932/1856] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:02.091548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753807-5c7d-48f8-b604-53a149375cd0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.091891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753807-5c7d-48f8-b604-53a149375cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.092157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c753807-5c7d-48f8-b604-53a149375cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.123943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0c753807-5c7d-48f8-b604-53a149375cd0 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:02.126674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0c753807-5c7d-48f8-b604-53a149375cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:02.136742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 933/1857] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:02.137988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c753807-5c7d-48f8-b604-53a149375cd0 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:02.138225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f61b1701684810bff5c3a76bb45cb2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:02.139472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0c753807-5c7d-48f8-b604-53a149375cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:02.147011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f61b1701684810bff5c3a76bb45cb2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:02.147758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f61b1701684810bff5c3a76bb45cb2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:02.208235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c753807-5c7d-48f8-b604-53a149375cd0 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:02.212438 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cee05-29b1-4b24-bc9c-afe10fef4c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:02.216390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cee05-29b1-4b24-bc9c-afe10fef4c12 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.216390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cee05-29b1-4b24-bc9c-afe10fef4c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.216390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cee05-29b1-4b24-bc9c-afe10fef4c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.224102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cee05-29b1-4b24-bc9c-afe10fef4c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:02.225633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cee05-29b1-4b24-bc9c-afe10fef4c12 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:02.237073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 934/1858] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:02.238388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92fef-8017-430f-b22a-1afeb4cc200f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.239191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92fef-8017-430f-b22a-1afeb4cc200f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.239461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92fef-8017-430f-b22a-1afeb4cc200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.260643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e9d92fef-8017-430f-b22a-1afeb4cc200f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:02.262535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e9d92fef-8017-430f-b22a-1afeb4cc200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:02.264084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:02.273974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 935/1859] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:02.278068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d92fef-8017-430f-b22a-1afeb4cc200f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:02.292864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d92fef-8017-430f-b22a-1afeb4cc200f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:02.297951 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3e5af-e790-4526-af65-8a331116e701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:02.298582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3e5af-e790-4526-af65-8a331116e701 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.298861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3e5af-e790-4526-af65-8a331116e701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.300436 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3e5af-e790-4526-af65-8a331116e701 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.300436 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3e5af-e790-4526-af65-8a331116e701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:02.300436 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3e5af-e790-4526-af65-8a331116e701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:02.302374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3e5af-e790-4526-af65-8a331116e701 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:02.309457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f61b1701684810bff5c3a76bb45cb2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:02.311104 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f61b1701684810bff5c3a76bb45cb2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:02.315810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 936/1860] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:37:02.325807 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3e5af-e790-4526-af65-8a331116e701 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:02.328662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c7c3e5af-e790-4526-af65-8a331116e701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:02.351094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3e5af-e790-4526-af65-8a331116e701 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:02.356158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 925/1861] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:01 2022] DELETE /identity/v3/users/52f61b1701684810bff5c3a76bb45cb2 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:02.362160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46527d89-80b7-4456-afdc-33ed3287bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:02.362160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46527d89-80b7-4456-afdc-33ed3287bdac admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.362160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46527d89-80b7-4456-afdc-33ed3287bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.362160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46527d89-80b7-4456-afdc-33ed3287bdac admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.362769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46527d89-80b7-4456-afdc-33ed3287bdac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:02.365637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46527d89-80b7-4456-afdc-33ed3287bdac admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:02.506907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 937/1862] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:02 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:02.512648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:02.606277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cfa2a-3a53-4768-9ae3-b9c0e908d8fa admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:02.700708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4109d2-2bbb-4479-a274-dcef0dea5645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:02.701635 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4109d2-2bbb-4479-a274-dcef0dea5645 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.702094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4109d2-2bbb-4479-a274-dcef0dea5645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.702511 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4109d2-2bbb-4479-a274-dcef0dea5645 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.703369 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4109d2-2bbb-4479-a274-dcef0dea5645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:02.705749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4109d2-2bbb-4479-a274-dcef0dea5645 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:02.840630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 926/1863] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:02 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:02.845579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46527d89-80b7-4456-afdc-33ed3287bdac admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:02.859388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46527d89-80b7-4456-afdc-33ed3287bdac admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:02.865461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe95bf6-96c4-404f-aa49-ebce52b2a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:02.866396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95bf6-96c4-404f-aa49-ebce52b2a485 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.866810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95bf6-96c4-404f-aa49-ebce52b2a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.867292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95bf6-96c4-404f-aa49-ebce52b2a485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.868438 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe95bf6-96c4-404f-aa49-ebce52b2a485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:02.870220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe95bf6-96c4-404f-aa49-ebce52b2a485 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:02.875720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:02.892320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4109d2-2bbb-4479-a274-dcef0dea5645 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:02.894465 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4b4109d2-2bbb-4479-a274-dcef0dea5645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:02.898286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 938/1864] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:02.903787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe95bf6-96c4-404f-aa49-ebce52b2a485 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:02.909619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4109d2-2bbb-4479-a274-dcef0dea5645 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:02.914737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe95bf6-96c4-404f-aa49-ebce52b2a485 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:02.916684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:02.917488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.918040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.918040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] PATH_INFO: `/v3/projects/9d12cb7780df403c9b8869baa6b64c3b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.919138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d12cb7780df403c9b8869baa6b64c3b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:02.920838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfb600-330a-481e-a9be-ac8d4bd5f4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:02.921097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:02.921459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfb600-330a-481e-a9be-ac8d4bd5f4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.921947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfb600-330a-481e-a9be-ac8d4bd5f4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.922230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfb600-330a-481e-a9be-ac8d4bd5f4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:02.922999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfb600-330a-481e-a9be-ac8d4bd5f4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:02.924688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfb600-330a-481e-a9be-ac8d4bd5f4f8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:02.937957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 939/1865] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:02.947509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfb600-330a-481e-a9be-ac8d4bd5f4f8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:02.969068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfb600-330a-481e-a9be-ac8d4bd5f4f8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:02.977229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293c7f7-3988-44d1-9803-5ed75c5252f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:02.977944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293c7f7-3988-44d1-9803-5ed75c5252f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:02.978227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293c7f7-3988-44d1-9803-5ed75c5252f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:02.978514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293c7f7-3988-44d1-9803-5ed75c5252f6 admin admin] PATH_INFO: `/v3/projects/6773f448958d48da966aa02bb6576c5c/users/ca1417fc15b1485c9dd6e8cd3f040f19/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:03.006855 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293c7f7-3988-44d1-9803-5ed75c5252f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6773f448958d48da966aa02bb6576c5c, user_id=ca1417fc15b1485c9dd6e8cd3f040f19, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:03.009663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293c7f7-3988-44d1-9803-5ed75c5252f6 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:03.092160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 940/1866] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:02 2022] PUT /identity/v3/projects/6773f448958d48da966aa02bb6576c5c/users/ca1417fc15b1485c9dd6e8cd3f040f19/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:03.100731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d12cb7780df403c9b8869baa6b64c3b', 'request_id': 'req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.102672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293c7f7-3988-44d1-9803-5ed75c5252f6 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:03.106799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9293c7f7-3988-44d1-9803-5ed75c5252f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:03.110597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d12cb7780df403c9b8869baa6b64c3b', 'request_id': 'req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.119341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d12cb7780df403c9b8869baa6b64c3b', 'request_id': 'req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.183503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293c7f7-3988-44d1-9803-5ed75c5252f6 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:03.248185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] The token cache is being invalidate because project 9d12cb7780df403c9b8869baa6b64c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:03.249061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.250504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b2ab2cf2-bb68-4a1f-900e-abb9008c8400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.252796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 927/1867] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:02 2022] DELETE /identity/v3/projects/9d12cb7780df403c9b8869baa6b64c3b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:03.254924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9d90-b341-43ad-bb7c-a442dd6c3686 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:03.255400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9d90-b341-43ad-bb7c-a442dd6c3686 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:03.255822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b9d90-b341-43ad-bb7c-a442dd6c3686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:03.280694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:03.281918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:03.282332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:03.282717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] PATH_INFO: `/v3/projects/073705e135464944b0c4b79f83dda5c5` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:03.284457 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=073705e135464944b0c4b79f83dda5c5)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:03.289004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:03.305806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f33b9d90-b341-43ad-bb7c-a442dd6c3686 None None] MFA Rules not processed for user `ca1417fc15b1485c9dd6e8cd3f040f19`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:03.307318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f33b9d90-b341-43ad-bb7c-a442dd6c3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:03.399298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 928/1868] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:03.399298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b9d90-b341-43ad-bb7c-a442dd6c3686 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:03.399664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f33b9d90-b341-43ad-bb7c-a442dd6c3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:03.421361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b9d90-b341-43ad-bb7c-a442dd6c3686 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:03.427441 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:03.427698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:03.427849 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:03.428129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] PATH_INFO: `/v3/users/84d2e88b37f6469cba3a84995654ad9a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:03.429575 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d2e88b37f6469cba3a84995654ad9a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:03.431516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:03.449367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073705e135464944b0c4b79f83dda5c5', 'request_id': 'req-be96eb39-193b-4fad-8693-379f0eb924ea'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.460690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073705e135464944b0c4b79f83dda5c5', 'request_id': 'req-be96eb39-193b-4fad-8693-379f0eb924ea'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.646199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073705e135464944b0c4b79f83dda5c5', 'request_id': 'req-be96eb39-193b-4fad-8693-379f0eb924ea'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.657950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] The token cache is being invalidate because project 073705e135464944b0c4b79f83dda5c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:03.658250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.658964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.672315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 941/1869] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:03 2022] DELETE /identity/v3/projects/073705e135464944b0c4b79f83dda5c5 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:03.672315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:03.672315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:03.751530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96eb39-193b-4fad-8693-379f0eb924ea admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:03.756427 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643447c-97f7-4c10-b9fa-d02a271f5021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:03.757023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643447c-97f7-4c10-b9fa-d02a271f5021 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:03.757303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643447c-97f7-4c10-b9fa-d02a271f5021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:03.757573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643447c-97f7-4c10-b9fa-d02a271f5021 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:03.758249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643447c-97f7-4c10-b9fa-d02a271f5021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:03.760172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643447c-97f7-4c10-b9fa-d02a271f5021 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:03.841891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d2e88b37f6469cba3a84995654ad9a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.849769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d2e88b37f6469cba3a84995654ad9a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.850509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d2e88b37f6469cba3a84995654ad9a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.955811 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 942/1870] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:03 2022] POST /identity/v3/projects => generated 387 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:03.957845 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a2e2c-364b-4139-8c00-05a50bd7ee45 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:03.958369 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a2e2c-364b-4139-8c00-05a50bd7ee45 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:03.974074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a2e2c-364b-4139-8c00-05a50bd7ee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:03.974227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d2e88b37f6469cba3a84995654ad9a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.974227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d2e88b37f6469cba3a84995654ad9a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:03.981086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d55a2e2c-364b-4139-8c00-05a50bd7ee45 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:03.982337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d55a2e2c-364b-4139-8c00-05a50bd7ee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:03.983451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 929/1871] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:03 2022] DELETE /identity/v3/users/84d2e88b37f6469cba3a84995654ad9a => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:03.984323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:03.987595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:04.061918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 943/1872] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:04.071168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5948-fa78-4e66-9203-3728415c00c8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.071488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5948-fa78-4e66-9203-3728415c00c8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.071769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a5948-fa78-4e66-9203-3728415c00c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.079005 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172ad00-f01b-4b37-9524-72143b3f0673 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.091836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964870e-298c-4be4-9e9b-f46a3bd9a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.092466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964870e-298c-4be4-9e9b-f46a3bd9a117 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.092758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964870e-298c-4be4-9e9b-f46a3bd9a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.093037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964870e-298c-4be4-9e9b-f46a3bd9a117 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.093747 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964870e-298c-4be4-9e9b-f46a3bd9a117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.096334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964870e-298c-4be4-9e9b-f46a3bd9a117 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.102043 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-843a5948-fa78-4e66-9203-3728415c00c8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:04.116800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-843a5948-fa78-4e66-9203-3728415c00c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:04.116800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 944/1873] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:04.120011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a5948-fa78-4e66-9203-3728415c00c8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.131932 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a5948-fa78-4e66-9203-3728415c00c8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.141045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e5dc0-30c5-4152-b745-f0fd3ce2ac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.141709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e5dc0-30c5-4152-b745-f0fd3ce2ac93 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.142031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e5dc0-30c5-4152-b745-f0fd3ce2ac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.142306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e5dc0-30c5-4152-b745-f0fd3ce2ac93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.142965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e5dc0-30c5-4152-b745-f0fd3ce2ac93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:04.143272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e5dc0-30c5-4152-b745-f0fd3ce2ac93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.148133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e5dc0-30c5-4152-b745-f0fd3ce2ac93 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.162772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 945/1874] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:37:04.166888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e5dc0-30c5-4152-b745-f0fd3ce2ac93 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.179720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e5dc0-30c5-4152-b745-f0fd3ce2ac93 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.183873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8c028-4b32-4ca7-88df-35dd1fbd3651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.200031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c028-4b32-4ca7-88df-35dd1fbd3651 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.200031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c028-4b32-4ca7-88df-35dd1fbd3651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.200031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8c028-4b32-4ca7-88df-35dd1fbd3651 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.200031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c028-4b32-4ca7-88df-35dd1fbd3651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.200031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8c028-4b32-4ca7-88df-35dd1fbd3651 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.317520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 930/1875] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:03 2022] POST /identity/v3/users => generated 300 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:04.321507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964870e-298c-4be4-9e9b-f46a3bd9a117 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.335235 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964870e-298c-4be4-9e9b-f46a3bd9a117 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.344891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dedf7-0193-42df-b0f8-468f900c32ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.344891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dedf7-0193-42df-b0f8-468f900c32ed admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.344891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dedf7-0193-42df-b0f8-468f900c32ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.344891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633dedf7-0193-42df-b0f8-468f900c32ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.345274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dedf7-0193-42df-b0f8-468f900c32ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.346783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633dedf7-0193-42df-b0f8-468f900c32ed admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.361133 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 931/1876] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:04.367032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dedf7-0193-42df-b0f8-468f900c32ed admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.384118 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 946/1877] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:04 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:04.385449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633dedf7-0193-42df-b0f8-468f900c32ed admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.386716 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8c028-4b32-4ca7-88df-35dd1fbd3651 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.474608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8c028-4b32-4ca7-88df-35dd1fbd3651 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.478608 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a676fb-0a49-421f-b7b9-d0776e2a8598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.481870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a676fb-0a49-421f-b7b9-d0776e2a8598 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.482037 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096017b2-306a-4b44-aa39-e6fe6ef0bc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.482229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a676fb-0a49-421f-b7b9-d0776e2a8598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.482328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096017b2-306a-4b44-aa39-e6fe6ef0bc79 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.482408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a676fb-0a49-421f-b7b9-d0776e2a8598 admin admin] PATH_INFO: `/v3/projects/e855f00155bd4448ae4e6bf446815822/users/fb5ed0226d5842aa96e3f7943f827c95/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.482481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096017b2-306a-4b44-aa39-e6fe6ef0bc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.482481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096017b2-306a-4b44-aa39-e6fe6ef0bc79 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.482703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096017b2-306a-4b44-aa39-e6fe6ef0bc79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.484741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096017b2-306a-4b44-aa39-e6fe6ef0bc79 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.500840 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a676fb-0a49-421f-b7b9-d0776e2a8598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e855f00155bd4448ae4e6bf446815822, user_id=fb5ed0226d5842aa96e3f7943f827c95, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.503769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a676fb-0a49-421f-b7b9-d0776e2a8598 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.578590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 947/1878] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:04 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:04.583356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096017b2-306a-4b44-aa39-e6fe6ef0bc79 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.594152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096017b2-306a-4b44-aa39-e6fe6ef0bc79 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.602524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e62f8-07c6-4b22-8254-e44090cc5370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.603249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e62f8-07c6-4b22-8254-e44090cc5370 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.603833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e62f8-07c6-4b22-8254-e44090cc5370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.603833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e62f8-07c6-4b22-8254-e44090cc5370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.604473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e62f8-07c6-4b22-8254-e44090cc5370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.606135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e62f8-07c6-4b22-8254-e44090cc5370 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.624322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 948/1879] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:04.632051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e62f8-07c6-4b22-8254-e44090cc5370 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.632251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 932/1880] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:04 2022] PUT /identity/v3/projects/e855f00155bd4448ae4e6bf446815822/users/fb5ed0226d5842aa96e3f7943f827c95/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:04.634566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a676fb-0a49-421f-b7b9-d0776e2a8598 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.638631 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e62f8-07c6-4b22-8254-e44090cc5370 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.730039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a676fb-0a49-421f-b7b9-d0776e2a8598 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.730236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb2328-5146-4e50-952c-e599d1e5d14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.730236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb2328-5146-4e50-952c-e599d1e5d14e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.731049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb2328-5146-4e50-952c-e599d1e5d14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.731415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb2328-5146-4e50-952c-e599d1e5d14e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.732158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb2328-5146-4e50-952c-e599d1e5d14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.734034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb2328-5146-4e50-952c-e599d1e5d14e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.735052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b10c6-3f0e-4746-96e7-f85f67cc5b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.735698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b10c6-3f0e-4746-96e7-f85f67cc5b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.736065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b10c6-3f0e-4746-96e7-f85f67cc5b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.736300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b10c6-3f0e-4746-96e7-f85f67cc5b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.736932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b10c6-3f0e-4746-96e7-f85f67cc5b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.739243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b10c6-3f0e-4746-96e7-f85f67cc5b76 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.748667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 949/1881] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:04.751082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 933/1882] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:04.755812 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b10c6-3f0e-4746-96e7-f85f67cc5b76 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.756063 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb2328-5146-4e50-952c-e599d1e5d14e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.766854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb2328-5146-4e50-952c-e599d1e5d14e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.769346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b10c6-3f0e-4746-96e7-f85f67cc5b76 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:04.774572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ed1b1-126a-47ea-a31d-b032239dcc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.776130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73072ad7-f050-4184-aa93-905906827281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:04.776271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed1b1-126a-47ea-a31d-b032239dcc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.776271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed1b1-126a-47ea-a31d-b032239dcc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.776424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072ad7-f050-4184-aa93-905906827281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.776424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072ad7-f050-4184-aa93-905906827281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.776570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ed1b1-126a-47ea-a31d-b032239dcc9b admin admin] PATH_INFO: `/v3/projects/323d6612105e4b6cb1a78c0a5c910b46/users/cc98fc52cf0f4e83ab8369221a6ba551/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.776665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73072ad7-f050-4184-aa93-905906827281 admin admin] PATH_INFO: `/v3/projects/e855f00155bd4448ae4e6bf446815822/users/fb5ed0226d5842aa96e3f7943f827c95/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.778665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73072ad7-f050-4184-aa93-905906827281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e855f00155bd4448ae4e6bf446815822, user_id=fb5ed0226d5842aa96e3f7943f827c95, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.781507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73072ad7-f050-4184-aa93-905906827281 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.794825 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 934/1883] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:04 2022] PUT /identity/v3/projects/e855f00155bd4448ae4e6bf446815822/users/fb5ed0226d5842aa96e3f7943f827c95/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:04.804399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ed1b1-126a-47ea-a31d-b032239dcc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=323d6612105e4b6cb1a78c0a5c910b46, user_id=cc98fc52cf0f4e83ab8369221a6ba551, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:04.807145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad329f-e29f-4776-a484-71a07525f313 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.807428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad329f-e29f-4776-a484-71a07525f313 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.807712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad329f-e29f-4776-a484-71a07525f313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.808981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ed1b1-126a-47ea-a31d-b032239dcc9b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:04.842445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0cad329f-e29f-4776-a484-71a07525f313 None None] MFA Rules not processed for user `fb5ed0226d5842aa96e3f7943f827c95`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:04.843703 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0cad329f-e29f-4776-a484-71a07525f313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:04.928758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 950/1884] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:04 2022] PUT /identity/v3/projects/323d6612105e4b6cb1a78c0a5c910b46/users/cc98fc52cf0f4e83ab8369221a6ba551/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:04.934556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ed1b1-126a-47ea-a31d-b032239dcc9b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:04.935819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4d5ed1b1-126a-47ea-a31d-b032239dcc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:04.955974 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 935/1885] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:04.957378 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf94f53-6126-4f9d-ab9c-882ddbdb6e3c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:04.957674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf94f53-6126-4f9d-ab9c-882ddbdb6e3c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:04.958041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf94f53-6126-4f9d-ab9c-882ddbdb6e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:04.983008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-faf94f53-6126-4f9d-ab9c-882ddbdb6e3c None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:04.984455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-faf94f53-6126-4f9d-ab9c-882ddbdb6e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:05.024829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ed1b1-126a-47ea-a31d-b032239dcc9b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:05.031622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:05.043699 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:05.043699 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:05.043699 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] PATH_INFO: `/v3/projects/dab2e4b8245b4831ad672adc273ca5fa` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:05.043699 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab2e4b8245b4831ad672adc273ca5fa)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:05.043699 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:05.087574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 936/1886] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:05.088324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf94f53-6126-4f9d-ab9c-882ddbdb6e3c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:05.089665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-faf94f53-6126-4f9d-ab9c-882ddbdb6e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:05.164223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf94f53-6126-4f9d-ab9c-882ddbdb6e3c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:05.168117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e31dd6-80ab-4441-9555-3e79c80a47a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:05.168740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e31dd6-80ab-4441-9555-3e79c80a47a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:05.169016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e31dd6-80ab-4441-9555-3e79c80a47a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:05.169287 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e31dd6-80ab-4441-9555-3e79c80a47a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:05.192983 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab2e4b8245b4831ad672adc273ca5fa', 'request_id': 'req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:05.200798 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab2e4b8245b4831ad672adc273ca5fa', 'request_id': 'req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:05.239445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e31dd6-80ab-4441-9555-3e79c80a47a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:05.241060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e31dd6-80ab-4441-9555-3e79c80a47a1 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:05.252970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 937/1887] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:05.254057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e31dd6-80ab-4441-9555-3e79c80a47a1 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:05.256643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-38e31dd6-80ab-4441-9555-3e79c80a47a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:05.314035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab2e4b8245b4831ad672adc273ca5fa', 'request_id': 'req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:05.328484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] The token cache is being invalidate because project dab2e4b8245b4831ad672adc273ca5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:05.328773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:05.329488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:05.331466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 951/1888] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:04 2022] DELETE /identity/v3/projects/dab2e4b8245b4831ad672adc273ca5fa => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:05.331930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:05.334163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:05.342795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e31dd6-80ab-4441-9555-3e79c80a47a1 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:05.412244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f0239-a343-4f19-85dc-c348996c19ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:05.413262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f0239-a343-4f19-85dc-c348996c19ef service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:05.413960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f0239-a343-4f19-85dc-c348996c19ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:05.414424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f0239-a343-4f19-85dc-c348996c19ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:05.417392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-604f0239-a343-4f19-85dc-c348996c19ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:05.429450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ebefc-fba5-4947-a638-ba6dd3cb4b75 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:05.435299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f0239-a343-4f19-85dc-c348996c19ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:05.436855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f0239-a343-4f19-85dc-c348996c19ef service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:05.437230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a6180-0db8-430d-be23-b2df137d111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:05.438187 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a6180-0db8-430d-be23-b2df137d111f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:05.438612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a6180-0db8-430d-be23-b2df137d111f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:05.439033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a6180-0db8-430d-be23-b2df137d111f admin admin] PATH_INFO: `/v3/users/ca1417fc15b1485c9dd6e8cd3f040f19` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:05.440565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a6180-0db8-430d-be23-b2df137d111f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1417fc15b1485c9dd6e8cd3f040f19)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:05.443956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a6180-0db8-430d-be23-b2df137d111f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:05.449682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 938/1889] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:05.450997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb18d16-ac04-4fe0-8935-131c8188467b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:05.451373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb18d16-ac04-4fe0-8935-131c8188467b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:05.451789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb18d16-ac04-4fe0-8935-131c8188467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:05.475302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6eb18d16-ac04-4fe0-8935-131c8188467b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:05.476689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6eb18d16-ac04-4fe0-8935-131c8188467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:05.494240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 939/1890] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:05.504233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a093-8dfc-42c1-9104-4d9782f0ba36 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:05.504658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a093-8dfc-42c1-9104-4d9782f0ba36 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:05.505063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3a093-8dfc-42c1-9104-4d9782f0ba36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:05.531114 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-dce3a093-8dfc-42c1-9104-4d9782f0ba36 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:05.532357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dce3a093-8dfc-42c1-9104-4d9782f0ba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:05.543991 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 940/1891] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:05.551315 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3a093-8dfc-42c1-9104-4d9782f0ba36 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:05.558929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3a093-8dfc-42c1-9104-4d9782f0ba36 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:05.565658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e55f4b-5958-4f19-baa0-b015e015d0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:05.566813 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55f4b-5958-4f19-baa0-b015e015d0ba admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:05.567782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55f4b-5958-4f19-baa0-b015e015d0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:05.567925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e55f4b-5958-4f19-baa0-b015e015d0ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:05.569998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e55f4b-5958-4f19-baa0-b015e015d0ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:05.569998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e55f4b-5958-4f19-baa0-b015e015d0ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:05.572793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e55f4b-5958-4f19-baa0-b015e015d0ba admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:05.592741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 941/1892] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:37:05.597614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e55f4b-5958-4f19-baa0-b015e015d0ba admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:05.616572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e55f4b-5958-4f19-baa0-b015e015d0ba admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:05.623604 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf8f78-e6e7-4058-9359-107bcebd9a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:05.627686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf8f78-e6e7-4058-9359-107bcebd9a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:05.627686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf8f78-e6e7-4058-9359-107bcebd9a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:05.627686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf8f78-e6e7-4058-9359-107bcebd9a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:05.627686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf8f78-e6e7-4058-9359-107bcebd9a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:05.627686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf8f78-e6e7-4058-9359-107bcebd9a42 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:05.931542 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 942/1893] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:05 2022] POST /identity/v3/projects => generated 383 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:05.932715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf8f78-e6e7-4058-9359-107bcebd9a42 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:05.963379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:05.992200 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b88a6180-0db8-430d-be23-b2df137d111f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1417fc15b1485c9dd6e8cd3f040f19'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:06.014116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b88a6180-0db8-430d-be23-b2df137d111f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1417fc15b1485c9dd6e8cd3f040f19'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:06.024292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b88a6180-0db8-430d-be23-b2df137d111f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1417fc15b1485c9dd6e8cd3f040f19'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:06.036077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf8f78-e6e7-4058-9359-107bcebd9a42 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:06.043530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e5f5e-3087-43d9-9888-437ec1342f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:06.044507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e5f5e-3087-43d9-9888-437ec1342f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:06.044945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e5f5e-3087-43d9-9888-437ec1342f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:06.045386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e5f5e-3087-43d9-9888-437ec1342f91 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:06.046224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e5f5e-3087-43d9-9888-437ec1342f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:06.049040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e5f5e-3087-43d9-9888-437ec1342f91 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:06.231036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b88a6180-0db8-430d-be23-b2df137d111f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1417fc15b1485c9dd6e8cd3f040f19'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:06.236954 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 943/1894] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:05 2022] POST /identity/v3/users => generated 292 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:06.241941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e5f5e-3087-43d9-9888-437ec1342f91 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:06.247042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b88a6180-0db8-430d-be23-b2df137d111f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1417fc15b1485c9dd6e8cd3f040f19'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:06.255471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e5f5e-3087-43d9-9888-437ec1342f91 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:06.257452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 952/1895] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:05 2022] DELETE /identity/v3/users/ca1417fc15b1485c9dd6e8cd3f040f19 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:06.262978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea1391-eacb-4291-b3b0-ffe06182dfd4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:06.270558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea1391-eacb-4291-b3b0-ffe06182dfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:06.270558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ea1391-eacb-4291-b3b0-ffe06182dfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:06.285211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-40ea1391-eacb-4291-b3b0-ffe06182dfd4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:06.287082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-40ea1391-eacb-4291-b3b0-ffe06182dfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:06.323544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a3028-96f6-431b-b5ac-d4e3e86e507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:06.324318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3028-96f6-431b-b5ac-d4e3e86e507b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:06.324692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3028-96f6-431b-b5ac-d4e3e86e507b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:06.325061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a3028-96f6-431b-b5ac-d4e3e86e507b admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:06.325801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a3028-96f6-431b-b5ac-d4e3e86e507b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:06.327513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a3028-96f6-431b-b5ac-d4e3e86e507b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:06.352360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 944/1896] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:06.354051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a3028-96f6-431b-b5ac-d4e3e86e507b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:06.355979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b61a3028-96f6-431b-b5ac-d4e3e86e507b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:06.371152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 953/1897] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:06.377499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a3028-96f6-431b-b5ac-d4e3e86e507b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:06.383262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8f7fb-abe1-47d2-bca5-012d062f6bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:06.383898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f7fb-abe1-47d2-bca5-012d062f6bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:06.384179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f7fb-abe1-47d2-bca5-012d062f6bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:06.384452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f7fb-abe1-47d2-bca5-012d062f6bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:06.385294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8f7fb-abe1-47d2-bca5-012d062f6bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:06.385517 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea1391-eacb-4291-b3b0-ffe06182dfd4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:06.386790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8f7fb-abe1-47d2-bca5-012d062f6bbc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:06.396835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-40ea1391-eacb-4291-b3b0-ffe06182dfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:06.399282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 945/1898] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:06.403745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8f7fb-abe1-47d2-bca5-012d062f6bbc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:06.415317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8f7fb-abe1-47d2-bca5-012d062f6bbc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:06.428860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e3088-016c-4c84-866d-43ddc7571a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:06.428860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3088-016c-4c84-866d-43ddc7571a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:06.428860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3088-016c-4c84-866d-43ddc7571a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:06.428860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e3088-016c-4c84-866d-43ddc7571a1a admin admin] PATH_INFO: `/v3/projects/0f020112e50f498eaf8a66078030a3c1/users/fe576fff1c7c47d8a5e8955e58686d6d/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:06.449117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e3088-016c-4c84-866d-43ddc7571a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f020112e50f498eaf8a66078030a3c1, user_id=fe576fff1c7c47d8a5e8955e58686d6d, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:06.452641 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e3088-016c-4c84-866d-43ddc7571a1a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:06.491133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ea1391-eacb-4291-b3b0-ffe06182dfd4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:06.495242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74d061-d9d4-473a-9af4-b538f53b6f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:06.496118 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74d061-d9d4-473a-9af4-b538f53b6f98 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:06.496372 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74d061-d9d4-473a-9af4-b538f53b6f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:06.496704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74d061-d9d4-473a-9af4-b538f53b6f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:06.508817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74d061-d9d4-473a-9af4-b538f53b6f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:06.510333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74d061-d9d4-473a-9af4-b538f53b6f98 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:06.522778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 954/1899] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:06.583217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 946/1900] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:06 2022] PUT /identity/v3/projects/0f020112e50f498eaf8a66078030a3c1/users/fe576fff1c7c47d8a5e8955e58686d6d/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:06.590119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:06.592061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caf2e1-8af0-41d8-ae20-5eff793d5dec None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:06.592406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caf2e1-8af0-41d8-ae20-5eff793d5dec None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:06.592668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caf2e1-8af0-41d8-ae20-5eff793d5dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:06.642270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-93caf2e1-8af0-41d8-ae20-5eff793d5dec None None] MFA Rules not processed for user `fe576fff1c7c47d8a5e8955e58686d6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:06.645382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-93caf2e1-8af0-41d8-ae20-5eff793d5dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:06.730371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 955/1901] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:06.742678 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e3088-016c-4c84-866d-43ddc7571a1a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:06.745117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-284e3088-016c-4c84-866d-43ddc7571a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:06.849685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e3088-016c-4c84-866d-43ddc7571a1a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:06.860831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3086f-cb85-4126-9a4b-cb39c90b88f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:06.866128 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3086f-cb85-4126-9a4b-cb39c90b88f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:06.866482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3086f-cb85-4126-9a4b-cb39c90b88f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:06.866865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3086f-cb85-4126-9a4b-cb39c90b88f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:06.882977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3086f-cb85-4126-9a4b-cb39c90b88f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:06.893930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f3086f-cb85-4126-9a4b-cb39c90b88f8 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:06.929570 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 947/1902] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:07.237584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caf2e1-8af0-41d8-ae20-5eff793d5dec None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:07.237584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-93caf2e1-8af0-41d8-ae20-5eff793d5dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:07.319940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caf2e1-8af0-41d8-ae20-5eff793d5dec None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:07.326981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:07.334741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:07.334741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:07.334741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] PATH_INFO: `/v3/projects/6773f448958d48da966aa02bb6576c5c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:07.334741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6773f448958d48da966aa02bb6576c5c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:07.334741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:07.523501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6773f448958d48da966aa02bb6576c5c', 'request_id': 'req-af894648-26fc-421b-ade0-c18e006ce7e8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:07.529663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6773f448958d48da966aa02bb6576c5c', 'request_id': 'req-af894648-26fc-421b-ade0-c18e006ce7e8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:07.628809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6773f448958d48da966aa02bb6576c5c', 'request_id': 'req-af894648-26fc-421b-ade0-c18e006ce7e8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:07.643764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] The token cache is being invalidate because project 6773f448958d48da966aa02bb6576c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:07.644123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:07.644889 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-af894648-26fc-421b-ade0-c18e006ce7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:07.649941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 956/1903] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:07 2022] DELETE /identity/v3/projects/6773f448958d48da966aa02bb6576c5c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:07.651286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3086f-cb85-4126-9a4b-cb39c90b88f8 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:07.675750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3086f-cb85-4126-9a4b-cb39c90b88f8 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:07.797899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e09d0-d1c6-467d-bf35-6ccbe61fc20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:07.798822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e09d0-d1c6-467d-bf35-6ccbe61fc20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:07.799316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e09d0-d1c6-467d-bf35-6ccbe61fc20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:07.800010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e09d0-d1c6-467d-bf35-6ccbe61fc20a admin admin] PATH_INFO: `/v3/users/fb5ed0226d5842aa96e3f7943f827c95` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:07.807805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e09d0-d1c6-467d-bf35-6ccbe61fc20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5ed0226d5842aa96e3f7943f827c95)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:07.813407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e09d0-d1c6-467d-bf35-6ccbe61fc20a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:07.852392 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6832d9-7a3d-45d0-abe5-b7ec78e73796 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:07.852857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6832d9-7a3d-45d0-abe5-b7ec78e73796 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:07.853322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6832d9-7a3d-45d0-abe5-b7ec78e73796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:07.906198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-fb6832d9-7a3d-45d0-abe5-b7ec78e73796 None None] MFA Rules not processed for user `cc98fc52cf0f4e83ab8369221a6ba551`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:07.907642 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fb6832d9-7a3d-45d0-abe5-b7ec78e73796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:08.029862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 957/1904] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:08.042531 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6832d9-7a3d-45d0-abe5-b7ec78e73796 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:08.045722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fb6832d9-7a3d-45d0-abe5-b7ec78e73796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:08.120379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6832d9-7a3d-45d0-abe5-b7ec78e73796 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:08.125247 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e1dbd-482e-4b15-9772-f54f064aaf4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:08.130498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e1dbd-482e-4b15-9772-f54f064aaf4c service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:08.130498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e1dbd-482e-4b15-9772-f54f064aaf4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:08.130498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e1dbd-482e-4b15-9772-f54f064aaf4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:08.147155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e1dbd-482e-4b15-9772-f54f064aaf4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:08.148879 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e1dbd-482e-4b15-9772-f54f064aaf4c service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:08.153398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b04e09d0-d1c6-467d-bf35-6ccbe61fc20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5ed0226d5842aa96e3f7943f827c95'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:08.165633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 958/1905] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:08.169908 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b04e09d0-d1c6-467d-bf35-6ccbe61fc20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5ed0226d5842aa96e3f7943f827c95'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:08.170774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b04e09d0-d1c6-467d-bf35-6ccbe61fc20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5ed0226d5842aa96e3f7943f827c95'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:08.339099 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b04e09d0-d1c6-467d-bf35-6ccbe61fc20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5ed0226d5842aa96e3f7943f827c95'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:08.339099 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b04e09d0-d1c6-467d-bf35-6ccbe61fc20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5ed0226d5842aa96e3f7943f827c95'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:08.363240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 948/1906] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:07 2022] DELETE /identity/v3/users/fb5ed0226d5842aa96e3f7943f827c95 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:08.927002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:08.935302 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e1dbd-482e-4b15-9772-f54f064aaf4c service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:08.937112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0a7e1dbd-482e-4b15-9772-f54f064aaf4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:08.964656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e1dbd-482e-4b15-9772-f54f064aaf4c service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:09.057541 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:09.058991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:09.059216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:09.059496 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] PATH_INFO: `/v3/projects/e855f00155bd4448ae4e6bf446815822` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:09.060756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e855f00155bd4448ae4e6bf446815822)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:09.063382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:09.203040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:09.263271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e855f00155bd4448ae4e6bf446815822', 'request_id': 'req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:09.277590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e855f00155bd4448ae4e6bf446815822', 'request_id': 'req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:09.400130 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e855f00155bd4448ae4e6bf446815822', 'request_id': 'req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:09.426591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] The token cache is being invalidate because project e855f00155bd4448ae4e6bf446815822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:09.427791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:09.428952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c10528ab-6ec0-43ac-b9d5-e0a15dbff78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:09.431470 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 959/1907] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:08 2022] DELETE /identity/v3/projects/e855f00155bd4448ae4e6bf446815822 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:09.436769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad642-90f4-42b1-b372-141d7a81ee86 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:09.437062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad642-90f4-42b1-b372-141d7a81ee86 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:09.440454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad642-90f4-42b1-b372-141d7a81ee86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:09.479813 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c85ad642-90f4-42b1-b372-141d7a81ee86 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:09.481402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c85ad642-90f4-42b1-b372-141d7a81ee86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:09.601571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 949/1908] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:09.609804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee6fec-fc76-4d0b-be28-ae18e483b9c6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:09.610129 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee6fec-fc76-4d0b-be28-ae18e483b9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:09.610416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee6fec-fc76-4d0b-be28-ae18e483b9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:09.635858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-89ee6fec-fc76-4d0b-be28-ae18e483b9c6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:09.637293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-89ee6fec-fc76-4d0b-be28-ae18e483b9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:09.646871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 960/1909] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:09.651216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ad642-90f4-42b1-b372-141d7a81ee86 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:09.662502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ad642-90f4-42b1-b372-141d7a81ee86 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:09.667451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4880479-08bb-4369-be1e-27f3e0c0b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:09.667987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4880479-08bb-4369-be1e-27f3e0c0b439 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:09.668266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4880479-08bb-4369-be1e-27f3e0c0b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:09.668540 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4880479-08bb-4369-be1e-27f3e0c0b439 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:09.669191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4880479-08bb-4369-be1e-27f3e0c0b439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:09.669497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4880479-08bb-4369-be1e-27f3e0c0b439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:09.671123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4880479-08bb-4369-be1e-27f3e0c0b439 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:09.684885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 950/1910] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:09.695759 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee6fec-fc76-4d0b-be28-ae18e483b9c6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:09.705343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee6fec-fc76-4d0b-be28-ae18e483b9c6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:09.710491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6062f-6d1e-4e1c-8073-9416d5bd6ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:09.711093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6062f-6d1e-4e1c-8073-9416d5bd6ffb admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:09.711369 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6062f-6d1e-4e1c-8073-9416d5bd6ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:09.711638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6062f-6d1e-4e1c-8073-9416d5bd6ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:09.712268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6062f-6d1e-4e1c-8073-9416d5bd6ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:09.714304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6062f-6d1e-4e1c-8073-9416d5bd6ffb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:09.908121 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 961/1911] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:09 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:09.909058 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4880479-08bb-4369-be1e-27f3e0c0b439 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:09.922216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4880479-08bb-4369-be1e-27f3e0c0b439 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:09.936723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88dc0-93a2-407a-92d7-d44374afa2fb None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:09.937225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88dc0-93a2-407a-92d7-d44374afa2fb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:09.937529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88dc0-93a2-407a-92d7-d44374afa2fb None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:09.939649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 962/1912] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 1 16:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 16:37:09.950655 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca0d2-7d3f-4e56-aead-1233cb56ec83 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:09.951199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca0d2-7d3f-4e56-aead-1233cb56ec83 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:09.951626 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca0d2-7d3f-4e56-aead-1233cb56ec83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:09.974044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-673ca0d2-7d3f-4e56-aead-1233cb56ec83 None None] MFA Rules not processed for user `61d15478ca864f49aae2301e2328fe23`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:10.012045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-673ca0d2-7d3f-4e56-aead-1233cb56ec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:10.012216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5824229-20fa-4d59-a397-090977ef4dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:10.012216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5824229-20fa-4d59-a397-090977ef4dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:10.012216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5824229-20fa-4d59-a397-090977ef4dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:10.012216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5824229-20fa-4d59-a397-090977ef4dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:10.012949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5824229-20fa-4d59-a397-090977ef4dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:10.012949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5824229-20fa-4d59-a397-090977ef4dc4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:10.046882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 963/1913] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 1 16:37:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:10.059110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ca0d2-7d3f-4e56-aead-1233cb56ec83 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:10.060545 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-673ca0d2-7d3f-4e56-aead-1233cb56ec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:10.074723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ca0d2-7d3f-4e56-aead-1233cb56ec83 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:10.080739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48328fc-8f05-4c8f-8a4a-caf98ad1e154 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d15478ca864f49aae2301e2328fe23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:10.081364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48328fc-8f05-4c8f-8a4a-caf98ad1e154 service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:10.081638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48328fc-8f05-4c8f-8a4a-caf98ad1e154 service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:10.081930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48328fc-8f05-4c8f-8a4a-caf98ad1e154 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:10.091600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48328fc-8f05-4c8f-8a4a-caf98ad1e154 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:10.093379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48328fc-8f05-4c8f-8a4a-caf98ad1e154 service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:10.116294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 964/1914] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:10.157940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 951/1915] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:09 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:10.161082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48328fc-8f05-4c8f-8a4a-caf98ad1e154 service placement] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:10.173358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48328fc-8f05-4c8f-8a4a-caf98ad1e154 service placement] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:10.177545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5824229-20fa-4d59-a397-090977ef4dc4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:10.179096 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b5824229-20fa-4d59-a397-090977ef4dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:10.182911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c5ae-9dbe-406b-906d-ac4b1ba1659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:10.183744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c5ae-9dbe-406b-906d-ac4b1ba1659c admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:10.184021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c5ae-9dbe-406b-906d-ac4b1ba1659c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:10.184287 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c5ae-9dbe-406b-906d-ac4b1ba1659c admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:10.184938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032c5ae-9dbe-406b-906d-ac4b1ba1659c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:10.194782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032c5ae-9dbe-406b-906d-ac4b1ba1659c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:10.198966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5824229-20fa-4d59-a397-090977ef4dc4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:10.206352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:10.207002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:10.207946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:10.208242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] PATH_INFO: `/v3/users/744cf2055b244186afa58ec86a7d3b73` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:10.209556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744cf2055b244186afa58ec86a7d3b73)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:10.211399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:10.217758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 965/1916] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:10.220211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c5ae-9dbe-406b-906d-ac4b1ba1659c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:10.229691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c5ae-9dbe-406b-906d-ac4b1ba1659c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:10.236647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a33cd-313b-42fb-aa1b-c7fbb306972e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:10.237276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a33cd-313b-42fb-aa1b-c7fbb306972e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:10.237554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a33cd-313b-42fb-aa1b-c7fbb306972e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:10.237833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a33cd-313b-42fb-aa1b-c7fbb306972e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:10.238853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a33cd-313b-42fb-aa1b-c7fbb306972e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:10.240527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a33cd-313b-42fb-aa1b-c7fbb306972e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:10.253282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 966/1917] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:10.258810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a33cd-313b-42fb-aa1b-c7fbb306972e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:10.268889 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a33cd-313b-42fb-aa1b-c7fbb306972e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:10.275386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab0e71-594d-4306-9fac-216e33c7c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:10.276070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab0e71-594d-4306-9fac-216e33c7c5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:10.276346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab0e71-594d-4306-9fac-216e33c7c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:10.276615 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab0e71-594d-4306-9fac-216e33c7c5f9 admin admin] PATH_INFO: `/v3/projects/15a39cb7fd854fb399d6e2076595dce8/users/81a42d77fd3d4f90bcf2309164888443/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:10.293345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab0e71-594d-4306-9fac-216e33c7c5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a39cb7fd854fb399d6e2076595dce8, user_id=81a42d77fd3d4f90bcf2309164888443, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:10.296069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab0e71-594d-4306-9fac-216e33c7c5f9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:10.447414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 967/1918] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:10 2022] PUT /identity/v3/projects/15a39cb7fd854fb399d6e2076595dce8/users/81a42d77fd3d4f90bcf2309164888443/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:10.448627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133791c8-12ce-4529-a707-15486027db00 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:10.448965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133791c8-12ce-4529-a707-15486027db00 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:10.449360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133791c8-12ce-4529-a707-15486027db00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:10.469708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-133791c8-12ce-4529-a707-15486027db00 None None] MFA Rules not processed for user `cc98fc52cf0f4e83ab8369221a6ba551`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:10.471022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-133791c8-12ce-4529-a707-15486027db00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:10.529913 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 968/1919] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:10.531210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f009-c077-49b8-ab78-7ea278a2f1e5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:10.531494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f009-c077-49b8-ab78-7ea278a2f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:10.531734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f009-c077-49b8-ab78-7ea278a2f1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:10.547054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744cf2055b244186afa58ec86a7d3b73'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:10.555919 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744cf2055b244186afa58ec86a7d3b73'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:10.556700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744cf2055b244186afa58ec86a7d3b73'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:10.577236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f1e6f009-c077-49b8-ab78-7ea278a2f1e5 None None] MFA Rules not processed for user `81a42d77fd3d4f90bcf2309164888443`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:10.579117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f1e6f009-c077-49b8-ab78-7ea278a2f1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:10.647062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:10.678069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 969/1920] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:10.682660 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6f009-c077-49b8-ab78-7ea278a2f1e5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:10.703113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744cf2055b244186afa58ec86a7d3b73'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:10.704016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744cf2055b244186afa58ec86a7d3b73'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:10.736140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 952/1921] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:10 2022] DELETE /identity/v3/users/744cf2055b244186afa58ec86a7d3b73 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:10.789225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6f009-c077-49b8-ab78-7ea278a2f1e5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:10.892914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee2646-b9fb-4d70-8dc9-6b1792a064c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:10.892914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2646-b9fb-4d70-8dc9-6b1792a064c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:10.892914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2646-b9fb-4d70-8dc9-6b1792a064c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:10.892914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee2646-b9fb-4d70-8dc9-6b1792a064c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:10.893676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee2646-b9fb-4d70-8dc9-6b1792a064c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:10.896160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee2646-b9fb-4d70-8dc9-6b1792a064c1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:11.045917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 970/1922] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:10 2022] POST /identity/v3/projects => generated 383 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:11.047689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:11.049157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:11.063528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fdb8e-b1ee-42d8-8eaa-6061ffb090f0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:11.134380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe3079-896d-4288-b930-56c54c9d78fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:11.135175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe3079-896d-4288-b930-56c54c9d78fc admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.135755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe3079-896d-4288-b930-56c54c9d78fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.136230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe3079-896d-4288-b930-56c54c9d78fc admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.137366 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe3079-896d-4288-b930-56c54c9d78fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:11.141027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe3079-896d-4288-b930-56c54c9d78fc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:11.179430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee2646-b9fb-4d70-8dc9-6b1792a064c1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:11.181340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-37ee2646-b9fb-4d70-8dc9-6b1792a064c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:11.197434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee2646-b9fb-4d70-8dc9-6b1792a064c1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:11.202581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:11.203679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.203679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.204184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] PATH_INFO: `/v3/projects/e81d8e66d2a0422fb157993a191c289b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.206017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81d8e66d2a0422fb157993a191c289b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:11.211803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:11.242974 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 953/1923] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:11 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:11.251323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe3079-896d-4288-b930-56c54c9d78fc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:11.259221 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe3079-896d-4288-b930-56c54c9d78fc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:11.264661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df87b92-b859-4ddd-aee7-3ce24d509b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:11.265291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df87b92-b859-4ddd-aee7-3ce24d509b9c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.265577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df87b92-b859-4ddd-aee7-3ce24d509b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.265849 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df87b92-b859-4ddd-aee7-3ce24d509b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.266535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df87b92-b859-4ddd-aee7-3ce24d509b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:11.268280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df87b92-b859-4ddd-aee7-3ce24d509b9c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:11.283752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 954/1924] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:11.289802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df87b92-b859-4ddd-aee7-3ce24d509b9c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:11.301307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df87b92-b859-4ddd-aee7-3ce24d509b9c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:11.308331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe229d-cb6b-4275-ba22-809208c99bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:11.309006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe229d-cb6b-4275-ba22-809208c99bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.309322 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe229d-cb6b-4275-ba22-809208c99bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.309600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe229d-cb6b-4275-ba22-809208c99bf2 admin admin] PATH_INFO: `/v3/projects/735bc6ffecc14753a67b7bc5fb5dac70/users/8f0af60ed02540eb8b68b66982b69239/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.327184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe229d-cb6b-4275-ba22-809208c99bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735bc6ffecc14753a67b7bc5fb5dac70, user_id=8f0af60ed02540eb8b68b66982b69239, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:11.330333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe229d-cb6b-4275-ba22-809208c99bf2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:11.468071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 955/1925] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:11 2022] PUT /identity/v3/projects/735bc6ffecc14753a67b7bc5fb5dac70/users/8f0af60ed02540eb8b68b66982b69239/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:11.470790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe229d-cb6b-4275-ba22-809208c99bf2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:11.486168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81d8e66d2a0422fb157993a191c289b', 'request_id': 'req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:11.495071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81d8e66d2a0422fb157993a191c289b', 'request_id': 'req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:11.564311 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe229d-cb6b-4275-ba22-809208c99bf2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:11.588625 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81d8e66d2a0422fb157993a191c289b', 'request_id': 'req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:11.602986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] The token cache is being invalidate because project e81d8e66d2a0422fb157993a191c289b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:11.603284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:11.604154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-73a454bf-4fe7-4f12-9d64-c60e57d0aea7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:11.606528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 971/1926] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:11 2022] DELETE /identity/v3/projects/e81d8e66d2a0422fb157993a191c289b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:11.611782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876eb2d-ce8d-4d35-8e0f-27c930d1ef72 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.612354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876eb2d-ce8d-4d35-8e0f-27c930d1ef72 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.612849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876eb2d-ce8d-4d35-8e0f-27c930d1ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.628305 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc97c-3872-40d4-a780-a836134a01fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:11.628916 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc97c-3872-40d4-a780-a836134a01fe admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.629857 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc97c-3872-40d4-a780-a836134a01fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.630362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc97c-3872-40d4-a780-a836134a01fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.631195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dc97c-3872-40d4-a780-a836134a01fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:11.632888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dc97c-3872-40d4-a780-a836134a01fe admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:11.634743 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-8876eb2d-ce8d-4d35-8e0f-27c930d1ef72 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:11.636018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8876eb2d-ce8d-4d35-8e0f-27c930d1ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:11.643133 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 956/1927] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:11.643838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 972/1928] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:11.647808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc97c-3872-40d4-a780-a836134a01fe admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:11.652051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-641dc97c-3872-40d4-a780-a836134a01fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:11.653455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4af7c-bb73-42fd-b3e1-88f6c9db110f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.653740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4af7c-bb73-42fd-b3e1-88f6c9db110f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.654040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4af7c-bb73-42fd-b3e1-88f6c9db110f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.666332 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc97c-3872-40d4-a780-a836134a01fe admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:11.671213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222b2b-2bdd-46ca-861a-9751a638a658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:11.671883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222b2b-2bdd-46ca-861a-9751a638a658 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.672166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222b2b-2bdd-46ca-861a-9751a638a658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.672510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222b2b-2bdd-46ca-861a-9751a638a658 admin admin] PATH_INFO: `/v3/projects/735bc6ffecc14753a67b7bc5fb5dac70/users/8f0af60ed02540eb8b68b66982b69239/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.674495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c222b2b-2bdd-46ca-861a-9751a638a658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735bc6ffecc14753a67b7bc5fb5dac70, user_id=8f0af60ed02540eb8b68b66982b69239, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:11.677659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c222b2b-2bdd-46ca-861a-9751a638a658 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:11.680154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-44c4af7c-bb73-42fd-b3e1-88f6c9db110f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:11.682863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-44c4af7c-bb73-42fd-b3e1-88f6c9db110f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:11.688997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 957/1929] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:11 2022] PUT /identity/v3/projects/735bc6ffecc14753a67b7bc5fb5dac70/users/8f0af60ed02540eb8b68b66982b69239/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:11.701145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aea560-583f-4f96-b9e4-9d9d13af64d2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.701426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aea560-583f-4f96-b9e4-9d9d13af64d2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.701909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aea560-583f-4f96-b9e4-9d9d13af64d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.737132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-59aea560-583f-4f96-b9e4-9d9d13af64d2 None None] MFA Rules not processed for user `8f0af60ed02540eb8b68b66982b69239`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:11.738485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-59aea560-583f-4f96-b9e4-9d9d13af64d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:11.765021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 973/1930] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:11.769696 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4af7c-bb73-42fd-b3e1-88f6c9db110f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:11.780507 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4af7c-bb73-42fd-b3e1-88f6c9db110f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:11.786244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b1468-4551-40cf-ab2b-7f5e1dd134dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:11.786853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b1468-4551-40cf-ab2b-7f5e1dd134dd admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.787135 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b1468-4551-40cf-ab2b-7f5e1dd134dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.787405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b1468-4551-40cf-ab2b-7f5e1dd134dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.788206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b1468-4551-40cf-ab2b-7f5e1dd134dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:11.788512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b1468-4551-40cf-ab2b-7f5e1dd134dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:11.790141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b1468-4551-40cf-ab2b-7f5e1dd134dd admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:11.807378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 974/1931] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:37:11.808418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b1468-4551-40cf-ab2b-7f5e1dd134dd admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:11.821035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 958/1932] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:11.822122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b1468-4551-40cf-ab2b-7f5e1dd134dd admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:11.827035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb16be-2429-45e7-865f-3b4eafa117e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:11.827527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb16be-2429-45e7-865f-3b4eafa117e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.827804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb16be-2429-45e7-865f-3b4eafa117e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.828075 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb16be-2429-45e7-865f-3b4eafa117e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.828706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb16be-2429-45e7-865f-3b4eafa117e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:11.830641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb16be-2429-45e7-865f-3b4eafa117e8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:11.833348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aea560-583f-4f96-b9e4-9d9d13af64d2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:11.834926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-59aea560-583f-4f96-b9e4-9d9d13af64d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:11.908565 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aea560-583f-4f96-b9e4-9d9d13af64d2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:11.912336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f571ccc-d54e-441b-902a-17736bd2a1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:11.912955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f571ccc-d54e-441b-902a-17736bd2a1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:11.913249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f571ccc-d54e-441b-902a-17736bd2a1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:11.913514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f571ccc-d54e-441b-902a-17736bd2a1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:11.925761 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f571ccc-d54e-441b-902a-17736bd2a1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:11.929808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f571ccc-d54e-441b-902a-17736bd2a1a1 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:11.943894 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 959/1933] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:12.031073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 975/1934] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:11 2022] POST /identity/v3/projects => generated 375 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:12.038640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f571ccc-d54e-441b-902a-17736bd2a1a1 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:12.042105 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb16be-2429-45e7-865f-3b4eafa117e8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:12.056429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f571ccc-d54e-441b-902a-17736bd2a1a1 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:12.075786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:12.162627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb16be-2429-45e7-865f-3b4eafa117e8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:12.165185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58d2c9-3fac-4ec7-8bdc-9dbfa51ee4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:12.165909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58d2c9-3fac-4ec7-8bdc-9dbfa51ee4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:12.166195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58d2c9-3fac-4ec7-8bdc-9dbfa51ee4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:12.166466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58d2c9-3fac-4ec7-8bdc-9dbfa51ee4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:12.167647 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58d2c9-3fac-4ec7-8bdc-9dbfa51ee4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:12.168131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7a568-07ef-4d1f-914e-71d3ce77c8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:12.168851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7a568-07ef-4d1f-914e-71d3ce77c8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:12.169649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7a568-07ef-4d1f-914e-71d3ce77c8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:12.169649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7a568-07ef-4d1f-914e-71d3ce77c8d2 admin admin] PATH_INFO: `/v3/users/81a42d77fd3d4f90bcf2309164888443` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:12.169912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58d2c9-3fac-4ec7-8bdc-9dbfa51ee4b7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:12.171171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7a568-07ef-4d1f-914e-71d3ce77c8d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a42d77fd3d4f90bcf2309164888443)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:12.173339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f7a568-07ef-4d1f-914e-71d3ce77c8d2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:12.307792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 960/1935] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:12 2022] POST /identity/v3/users => generated 288 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:12.314019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58d2c9-3fac-4ec7-8bdc-9dbfa51ee4b7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:12.326471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58d2c9-3fac-4ec7-8bdc-9dbfa51ee4b7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:12.332309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8f830-f0b0-460e-b1cf-b5c44f7bcecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:12.333315 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f830-f0b0-460e-b1cf-b5c44f7bcecd admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:12.333792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f830-f0b0-460e-b1cf-b5c44f7bcecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:12.334295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8f830-f0b0-460e-b1cf-b5c44f7bcecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:12.335558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8f830-f0b0-460e-b1cf-b5c44f7bcecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:12.338404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8f830-f0b0-460e-b1cf-b5c44f7bcecd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:12.359521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 961/1936] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:12.362965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8f830-f0b0-460e-b1cf-b5c44f7bcecd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:12.374542 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8f830-f0b0-460e-b1cf-b5c44f7bcecd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:12.380645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fc031-bbb7-4672-aaee-911006e354bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:12.381504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fc031-bbb7-4672-aaee-911006e354bd admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:12.381785 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fc031-bbb7-4672-aaee-911006e354bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:12.382109 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293fc031-bbb7-4672-aaee-911006e354bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:12.382763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fc031-bbb7-4672-aaee-911006e354bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:12.384404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293fc031-bbb7-4672-aaee-911006e354bd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:12.395729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 962/1937] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:12.399898 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fc031-bbb7-4672-aaee-911006e354bd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:12.412799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293fc031-bbb7-4672-aaee-911006e354bd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:12.419676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6c797-6af8-4af1-8d7c-05014c689b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:12.420775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6c797-6af8-4af1-8d7c-05014c689b7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:12.420775 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6c797-6af8-4af1-8d7c-05014c689b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:12.420975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6c797-6af8-4af1-8d7c-05014c689b7f admin admin] PATH_INFO: `/v3/projects/dba6bdfa40cc43ff9a8a4f0b622ae41a/users/26cd5ab96976405b9c81c25857a28a95/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:12.446338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6c797-6af8-4af1-8d7c-05014c689b7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba6bdfa40cc43ff9a8a4f0b622ae41a, user_id=26cd5ab96976405b9c81c25857a28a95, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:12.449988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6c797-6af8-4af1-8d7c-05014c689b7f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:12.451494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-02f7a568-07ef-4d1f-914e-71d3ce77c8d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a42d77fd3d4f90bcf2309164888443'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:12.459365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-02f7a568-07ef-4d1f-914e-71d3ce77c8d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a42d77fd3d4f90bcf2309164888443'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:12.460677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-02f7a568-07ef-4d1f-914e-71d3ce77c8d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a42d77fd3d4f90bcf2309164888443'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:12.566159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-02f7a568-07ef-4d1f-914e-71d3ce77c8d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a42d77fd3d4f90bcf2309164888443'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:12.574083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 963/1938] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:12 2022] PUT /identity/v3/projects/dba6bdfa40cc43ff9a8a4f0b622ae41a/users/26cd5ab96976405b9c81c25857a28a95/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:12.581489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-02f7a568-07ef-4d1f-914e-71d3ce77c8d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a42d77fd3d4f90bcf2309164888443'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:12.584881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e22e-cb19-42f2-8c38-ac233ca8e522 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:12.585166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e22e-cb19-42f2-8c38-ac233ca8e522 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:12.585803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0e22e-cb19-42f2-8c38-ac233ca8e522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:12.592947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 976/1939] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:12 2022] DELETE /identity/v3/users/81a42d77fd3d4f90bcf2309164888443 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:12.596856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81406a-56a1-4f56-a14b-b43ae47266a2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:12.598377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81406a-56a1-4f56-a14b-b43ae47266a2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:12.598776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81406a-56a1-4f56-a14b-b43ae47266a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:12.626342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-3f81406a-56a1-4f56-a14b-b43ae47266a2 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:12.627590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3f81406a-56a1-4f56-a14b-b43ae47266a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:12.627888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-11b0e22e-cb19-42f2-8c38-ac233ca8e522 None None] MFA Rules not processed for user `26cd5ab96976405b9c81c25857a28a95`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:12.629141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-11b0e22e-cb19-42f2-8c38-ac233ca8e522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:12.717681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 977/1940] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:12.733140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81406a-56a1-4f56-a14b-b43ae47266a2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:12.735786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3f81406a-56a1-4f56-a14b-b43ae47266a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:12.741787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 964/1941] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:12.745353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0e22e-cb19-42f2-8c38-ac233ca8e522 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:12.746835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-11b0e22e-cb19-42f2-8c38-ac233ca8e522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:12.762480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0e22e-cb19-42f2-8c38-ac233ca8e522 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:12.778585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4dd41-3941-4c50-b6dd-044790fac93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:12.778585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4dd41-3941-4c50-b6dd-044790fac93c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:12.778585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4dd41-3941-4c50-b6dd-044790fac93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:12.778585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4dd41-3941-4c50-b6dd-044790fac93c admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:12.780824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4dd41-3941-4c50-b6dd-044790fac93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:12.783061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4dd41-3941-4c50-b6dd-044790fac93c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:12.812658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f81406a-56a1-4f56-a14b-b43ae47266a2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:12.824051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54f3ef-c7a0-43f7-8e12-fbafd26b734d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:12.824051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f3ef-c7a0-43f7-8e12-fbafd26b734d service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:12.824051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f3ef-c7a0-43f7-8e12-fbafd26b734d service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:12.824051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f3ef-c7a0-43f7-8e12-fbafd26b734d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:12.837906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54f3ef-c7a0-43f7-8e12-fbafd26b734d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:12.839235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54f3ef-c7a0-43f7-8e12-fbafd26b734d service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:12.853307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 978/1942] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:13.009027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 965/1943] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:12 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:13.009186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54f3ef-c7a0-43f7-8e12-fbafd26b734d service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:13.019529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54f3ef-c7a0-43f7-8e12-fbafd26b734d service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:13.085444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777307-aff6-46af-9781-b9045c7ee3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:13.086140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777307-aff6-46af-9781-b9045c7ee3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:13.086280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777307-aff6-46af-9781-b9045c7ee3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:13.086548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62777307-aff6-46af-9781-b9045c7ee3b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:13.087177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62777307-aff6-46af-9781-b9045c7ee3b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:13.089086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62777307-aff6-46af-9781-b9045c7ee3b5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:13.218405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 979/1944] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:13 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:13.222052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4dd41-3941-4c50-b6dd-044790fac93c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:13.240643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4dd41-3941-4c50-b6dd-044790fac93c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:13.251101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e06cd-996c-4815-8e7b-00b52b196f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:13.252016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e06cd-996c-4815-8e7b-00b52b196f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:13.256557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e06cd-996c-4815-8e7b-00b52b196f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:13.256557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e06cd-996c-4815-8e7b-00b52b196f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:13.256557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e06cd-996c-4815-8e7b-00b52b196f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:13.256557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6e06cd-996c-4815-8e7b-00b52b196f03 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:13.276652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 966/1945] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:13.277958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777307-aff6-46af-9781-b9045c7ee3b5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:13.290922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62777307-aff6-46af-9781-b9045c7ee3b5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:13.297826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63817f-ee70-4567-82ed-9d73e73154f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:13.298604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63817f-ee70-4567-82ed-9d73e73154f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:13.299044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63817f-ee70-4567-82ed-9d73e73154f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:13.299473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63817f-ee70-4567-82ed-9d73e73154f7 admin admin] PATH_INFO: `/v3/projects/615a361ef8bb4121a16d7cba476d0c44/users/c0dca2249b764657b3eb5972e25d1962/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:13.322809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63817f-ee70-4567-82ed-9d73e73154f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615a361ef8bb4121a16d7cba476d0c44, user_id=c0dca2249b764657b3eb5972e25d1962, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:13.326048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63817f-ee70-4567-82ed-9d73e73154f7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:13.456825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 980/1946] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:13 2022] PUT /identity/v3/projects/615a361ef8bb4121a16d7cba476d0c44/users/c0dca2249b764657b3eb5972e25d1962/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:13.461647 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e06cd-996c-4815-8e7b-00b52b196f03 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:13.472588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e06cd-996c-4815-8e7b-00b52b196f03 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:13.539482 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63817f-ee70-4567-82ed-9d73e73154f7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:13.546055 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3c63817f-ee70-4567-82ed-9d73e73154f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:13.554510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82811797-57c7-4688-805f-786b6a382c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:13.555138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82811797-57c7-4688-805f-786b6a382c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:13.555421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82811797-57c7-4688-805f-786b6a382c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:13.555693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82811797-57c7-4688-805f-786b6a382c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:13.556349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82811797-57c7-4688-805f-786b6a382c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:13.558043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82811797-57c7-4688-805f-786b6a382c8a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:13.571541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 967/1947] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:13.575858 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82811797-57c7-4688-805f-786b6a382c8a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:13.586924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82811797-57c7-4688-805f-786b6a382c8a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:13.593493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b9fef-1f9e-427f-a9d7-909f9fd41303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:13.596682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b9fef-1f9e-427f-a9d7-909f9fd41303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:13.596682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b9fef-1f9e-427f-a9d7-909f9fd41303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:13.596682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b9fef-1f9e-427f-a9d7-909f9fd41303 admin admin] PATH_INFO: `/v3/projects/615a361ef8bb4121a16d7cba476d0c44/users/c0dca2249b764657b3eb5972e25d1962/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:13.598264 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b9fef-1f9e-427f-a9d7-909f9fd41303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=615a361ef8bb4121a16d7cba476d0c44, user_id=c0dca2249b764657b3eb5972e25d1962, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:13.601909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b9fef-1f9e-427f-a9d7-909f9fd41303 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:13.618273 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:13.620776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 968/1948] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:13 2022] PUT /identity/v3/projects/615a361ef8bb4121a16d7cba476d0c44/users/c0dca2249b764657b3eb5972e25d1962/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:13.649565 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ddf7-a531-442a-b89a-68a318447ab5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:13.650100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ddf7-a531-442a-b89a-68a318447ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:13.650585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3ddf7-a531-442a-b89a-68a318447ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:13.652201 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63817f-ee70-4567-82ed-9d73e73154f7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:13.694258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-36e3ddf7-a531-442a-b89a-68a318447ab5 None None] MFA Rules not processed for user `c0dca2249b764657b3eb5972e25d1962`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:13.696168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-36e3ddf7-a531-442a-b89a-68a318447ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:13.726771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:13.727426 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:13.734621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:13.734621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] PATH_INFO: `/v3/projects/15a39cb7fd854fb399d6e2076595dce8` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:13.734621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a39cb7fd854fb399d6e2076595dce8)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:13.734621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:13.793826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 969/1949] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:13.807561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ddf7-a531-442a-b89a-68a318447ab5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:13.809075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-36e3ddf7-a531-442a-b89a-68a318447ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:13.882097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3ddf7-a531-442a-b89a-68a318447ab5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:13.885918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc5aeb-d583-4706-bf6b-5700a6efc271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:13.886535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc5aeb-d583-4706-bf6b-5700a6efc271 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:13.886816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc5aeb-d583-4706-bf6b-5700a6efc271 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:13.887088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc5aeb-d583-4706-bf6b-5700a6efc271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:13.922117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a39cb7fd854fb399d6e2076595dce8', 'request_id': 'req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:13.937559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a39cb7fd854fb399d6e2076595dce8', 'request_id': 'req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:13.958656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc5aeb-d583-4706-bf6b-5700a6efc271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:13.960096 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc5aeb-d583-4706-bf6b-5700a6efc271 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:13.969667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 970/1950] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:14.079822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a39cb7fd854fb399d6e2076595dce8', 'request_id': 'req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:14.096478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] The token cache is being invalidate because project 15a39cb7fd854fb399d6e2076595dce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:14.097449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:14.104693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:14.108085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 981/1951] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:13 2022] DELETE /identity/v3/projects/15a39cb7fd854fb399d6e2076595dce8 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:14.112057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc5aeb-d583-4706-bf6b-5700a6efc271 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:14.112474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:14.133904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc5aeb-d583-4706-bf6b-5700a6efc271 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:14.206519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607889ae-7cbb-4e9b-9804-006284c56bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:14.207519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607889ae-7cbb-4e9b-9804-006284c56bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:14.208004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607889ae-7cbb-4e9b-9804-006284c56bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:14.208482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607889ae-7cbb-4e9b-9804-006284c56bbb admin admin] PATH_INFO: `/v3/users/8f0af60ed02540eb8b68b66982b69239` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:14.209777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607889ae-7cbb-4e9b-9804-006284c56bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0af60ed02540eb8b68b66982b69239)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:14.211862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607889ae-7cbb-4e9b-9804-006284c56bbb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:14.525453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-607889ae-7cbb-4e9b-9804-006284c56bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0af60ed02540eb8b68b66982b69239'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:14.537405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-607889ae-7cbb-4e9b-9804-006284c56bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0af60ed02540eb8b68b66982b69239'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:14.538567 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-607889ae-7cbb-4e9b-9804-006284c56bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0af60ed02540eb8b68b66982b69239'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:14.640940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-607889ae-7cbb-4e9b-9804-006284c56bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0af60ed02540eb8b68b66982b69239'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:14.641509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-607889ae-7cbb-4e9b-9804-006284c56bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0af60ed02540eb8b68b66982b69239'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:14.666426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 971/1952] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:14 2022] DELETE /identity/v3/users/8f0af60ed02540eb8b68b66982b69239 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:15.184387 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:15.186309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:15.203222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb6ff1d-4f64-4c0e-889c-58b8419b5b4d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:15.304916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:15.305963 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:15.306244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:15.306667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] PATH_INFO: `/v3/projects/735bc6ffecc14753a67b7bc5fb5dac70` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:15.308083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=735bc6ffecc14753a67b7bc5fb5dac70)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:15.310073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:15.478717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735bc6ffecc14753a67b7bc5fb5dac70', 'request_id': 'req-b4921b50-6372-4938-9e45-3f44351a41ea'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:15.485374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735bc6ffecc14753a67b7bc5fb5dac70', 'request_id': 'req-b4921b50-6372-4938-9e45-3f44351a41ea'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:15.653173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735bc6ffecc14753a67b7bc5fb5dac70', 'request_id': 'req-b4921b50-6372-4938-9e45-3f44351a41ea'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:15.669372 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] The token cache is being invalidate because project 735bc6ffecc14753a67b7bc5fb5dac70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:15.669860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:15.671002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:15.673842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 982/1953] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:15 2022] DELETE /identity/v3/projects/735bc6ffecc14753a67b7bc5fb5dac70 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:15.680185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ca7c-b2e7-4d68-9929-097ada6ea0d3 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:15.680949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ca7c-b2e7-4d68-9929-097ada6ea0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:15.680949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693ca7c-b2e7-4d68-9929-097ada6ea0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:15.705228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a693ca7c-b2e7-4d68-9929-097ada6ea0d3 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:15.706540 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a693ca7c-b2e7-4d68-9929-097ada6ea0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:15.724928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:15.726457 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:15.800079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 972/1954] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:15.807250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce7e7-75b1-4376-a078-ffd22cf10e37 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:15.807250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce7e7-75b1-4376-a078-ffd22cf10e37 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:15.807250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce7e7-75b1-4376-a078-ffd22cf10e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:15.828009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4921b50-6372-4938-9e45-3f44351a41ea admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:15.836496 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8d52f-abaf-4f1e-9dea-b6847b1932bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:15.837278 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d52f-abaf-4f1e-9dea-b6847b1932bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:15.837558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d52f-abaf-4f1e-9dea-b6847b1932bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:15.837830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8d52f-abaf-4f1e-9dea-b6847b1932bf admin admin] PATH_INFO: `/v3/users/fe576fff1c7c47d8a5e8955e58686d6d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:15.839064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8d52f-abaf-4f1e-9dea-b6847b1932bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe576fff1c7c47d8a5e8955e58686d6d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:15.841004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8d52f-abaf-4f1e-9dea-b6847b1932bf admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:15.844744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1b5ce7e7-75b1-4376-a078-ffd22cf10e37 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:15.847471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1b5ce7e7-75b1-4376-a078-ffd22cf10e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:15.869646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 973/1955] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:15.876601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ce7e7-75b1-4376-a078-ffd22cf10e37 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:15.888019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ce7e7-75b1-4376-a078-ffd22cf10e37 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:15.894356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e53cc-91b3-40a8-ac99-ac8871579bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:15.897617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e53cc-91b3-40a8-ac99-ac8871579bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:15.897617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e53cc-91b3-40a8-ac99-ac8871579bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:15.897617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e53cc-91b3-40a8-ac99-ac8871579bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:15.897617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e53cc-91b3-40a8-ac99-ac8871579bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:15.897617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e53cc-91b3-40a8-ac99-ac8871579bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:15.898360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e53cc-91b3-40a8-ac99-ac8871579bfd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:15.913293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 974/1956] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:15.917851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e53cc-91b3-40a8-ac99-ac8871579bfd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:15.931515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e53cc-91b3-40a8-ac99-ac8871579bfd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:15.937643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a40f0-0de4-4d72-b5f4-7d227c79b038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:15.938352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a40f0-0de4-4d72-b5f4-7d227c79b038 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:15.938812 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a40f0-0de4-4d72-b5f4-7d227c79b038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:15.939228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a40f0-0de4-4d72-b5f4-7d227c79b038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:15.940086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a40f0-0de4-4d72-b5f4-7d227c79b038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:15.942835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a40f0-0de4-4d72-b5f4-7d227c79b038 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:16.045033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fed8d52f-abaf-4f1e-9dea-b6847b1932bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe576fff1c7c47d8a5e8955e58686d6d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:16.063003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fed8d52f-abaf-4f1e-9dea-b6847b1932bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe576fff1c7c47d8a5e8955e58686d6d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:16.064487 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fed8d52f-abaf-4f1e-9dea-b6847b1932bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe576fff1c7c47d8a5e8955e58686d6d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:16.071862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 975/1957] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:15 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:16.076132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a40f0-0de4-4d72-b5f4-7d227c79b038 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:16.148145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a40f0-0de4-4d72-b5f4-7d227c79b038 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:16.153936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00679697-78fa-43fa-bad0-56ab592e1d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:16.154571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00679697-78fa-43fa-bad0-56ab592e1d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:16.154857 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00679697-78fa-43fa-bad0-56ab592e1d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:16.155132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00679697-78fa-43fa-bad0-56ab592e1d08 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:16.155851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00679697-78fa-43fa-bad0-56ab592e1d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:16.157697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00679697-78fa-43fa-bad0-56ab592e1d08 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:16.165115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fed8d52f-abaf-4f1e-9dea-b6847b1932bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe576fff1c7c47d8a5e8955e58686d6d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:16.180723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-fed8d52f-abaf-4f1e-9dea-b6847b1932bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe576fff1c7c47d8a5e8955e58686d6d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:16.187861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 983/1958] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:15 2022] DELETE /identity/v3/users/fe576fff1c7c47d8a5e8955e58686d6d => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:16.192304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b3354-200c-4575-a4c7-17e0c6946cc5 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:16.192591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b3354-200c-4575-a4c7-17e0c6946cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:16.192855 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b3354-200c-4575-a4c7-17e0c6946cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:16.212897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-567b3354-200c-4575-a4c7-17e0c6946cc5 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:16.214332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-567b3354-200c-4575-a4c7-17e0c6946cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:16.291185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 984/1959] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:16.306607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b3354-200c-4575-a4c7-17e0c6946cc5 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:16.306607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-567b3354-200c-4575-a4c7-17e0c6946cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:16.357361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 976/1960] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:16 2022] POST /identity/v3/users => generated 294 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:16.362558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00679697-78fa-43fa-bad0-56ab592e1d08 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:16.366299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-00679697-78fa-43fa-bad0-56ab592e1d08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:16.377633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b3354-200c-4575-a4c7-17e0c6946cc5 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:16.381557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00679697-78fa-43fa-bad0-56ab592e1d08 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:16.383818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5287c-d924-4218-a777-afcadae5b249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:16.385143 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5287c-d924-4218-a777-afcadae5b249 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:16.385494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5287c-d924-4218-a777-afcadae5b249 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:16.385832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5287c-d924-4218-a777-afcadae5b249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:16.386588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7894-1f30-46c2-964b-d55095c18d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:16.387275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7894-1f30-46c2-964b-d55095c18d10 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:16.387552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7894-1f30-46c2-964b-d55095c18d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:16.387829 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a7894-1f30-46c2-964b-d55095c18d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:16.388480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a7894-1f30-46c2-964b-d55095c18d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:16.390138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a7894-1f30-46c2-964b-d55095c18d10 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:16.397077 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5287c-d924-4218-a777-afcadae5b249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:16.398755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5287c-d924-4218-a777-afcadae5b249 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:16.405967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 977/1961] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:16.415604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 985/1962] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:16.415734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7894-1f30-46c2-964b-d55095c18d10 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:16.423811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a7894-1f30-46c2-964b-d55095c18d10 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:16.430654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac10887-3cf9-4022-8283-81633c5f6823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:16.431289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac10887-3cf9-4022-8283-81633c5f6823 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:16.431563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac10887-3cf9-4022-8283-81633c5f6823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:16.431836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac10887-3cf9-4022-8283-81633c5f6823 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:16.432566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac10887-3cf9-4022-8283-81633c5f6823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:16.434241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac10887-3cf9-4022-8283-81633c5f6823 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:16.448830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 978/1963] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:16.463169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5287c-d924-4218-a777-afcadae5b249 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:16.481820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5287c-d924-4218-a777-afcadae5b249 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:16.487516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1038744-0abd-410a-9022-9690f3ca2fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:16.488203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038744-0abd-410a-9022-9690f3ca2fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:16.489096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038744-0abd-410a-9022-9690f3ca2fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:16.489676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1038744-0abd-410a-9022-9690f3ca2fd1 admin admin] PATH_INFO: `/v3/projects/97a9fd5d89324a7786aec38655c9374f/users/8f7f65e8a2f24ab09c2bdcb14c480295/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:16.497565 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:16.511782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1038744-0abd-410a-9022-9690f3ca2fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a9fd5d89324a7786aec38655c9374f, user_id=8f7f65e8a2f24ab09c2bdcb14c480295, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:16.514762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1038744-0abd-410a-9022-9690f3ca2fd1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:16.712862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 986/1964] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:16 2022] PUT /identity/v3/projects/97a9fd5d89324a7786aec38655c9374f/users/8f7f65e8a2f24ab09c2bdcb14c480295/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:16.725610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dd33c-fd05-44e9-81d4-597be3719400 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:16.726066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dd33c-fd05-44e9-81d4-597be3719400 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:16.726165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dd33c-fd05-44e9-81d4-597be3719400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:16.769214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1b8dd33c-fd05-44e9-81d4-597be3719400 None None] MFA Rules not processed for user `8f7f65e8a2f24ab09c2bdcb14c480295`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:16.772541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1b8dd33c-fd05-44e9-81d4-597be3719400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:16.870254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 979/1965] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:16.871912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1038744-0abd-410a-9022-9690f3ca2fd1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:16.960769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1038744-0abd-410a-9022-9690f3ca2fd1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:16.965742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e75aea-949e-4d44-b500-ec2b8ae2eeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:16.966671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75aea-949e-4d44-b500-ec2b8ae2eeee admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:16.966955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75aea-949e-4d44-b500-ec2b8ae2eeee admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:16.967222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e75aea-949e-4d44-b500-ec2b8ae2eeee admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:16.968031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e75aea-949e-4d44-b500-ec2b8ae2eeee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:16.974924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e75aea-949e-4d44-b500-ec2b8ae2eeee admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:17.153871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 987/1966] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:16 2022] POST /identity/v3/projects => generated 387 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:17.161089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dd33c-fd05-44e9-81d4-597be3719400 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:17.178124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dd33c-fd05-44e9-81d4-597be3719400 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:17.248378 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025accd-5fd3-44af-ba66-11e88a44d01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:17.249308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025accd-5fd3-44af-ba66-11e88a44d01d admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:17.249593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025accd-5fd3-44af-ba66-11e88a44d01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:17.250230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025accd-5fd3-44af-ba66-11e88a44d01d admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:17.250877 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025accd-5fd3-44af-ba66-11e88a44d01d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:17.253310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025accd-5fd3-44af-ba66-11e88a44d01d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:17.271971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e75aea-949e-4d44-b500-ec2b8ae2eeee admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:17.274333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-99e75aea-949e-4d44-b500-ec2b8ae2eeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:17.292219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e75aea-949e-4d44-b500-ec2b8ae2eeee admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:17.298924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:17.305544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:17.314950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:17.314950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:17.314950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] PATH_INFO: `/v3/projects/0f020112e50f498eaf8a66078030a3c1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:17.314950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f020112e50f498eaf8a66078030a3c1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:17.314950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:17.448337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 980/1967] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:17 2022] POST /identity/v3/users => generated 300 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:17.452463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025accd-5fd3-44af-ba66-11e88a44d01d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:17.463582 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025accd-5fd3-44af-ba66-11e88a44d01d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:17.470011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23069285-86ec-496d-a721-c3d0b770d17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:17.470901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23069285-86ec-496d-a721-c3d0b770d17c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:17.470901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23069285-86ec-496d-a721-c3d0b770d17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:17.471181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23069285-86ec-496d-a721-c3d0b770d17c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:17.471892 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23069285-86ec-496d-a721-c3d0b770d17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:17.473548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23069285-86ec-496d-a721-c3d0b770d17c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:17.485213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 981/1968] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:17.490780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23069285-86ec-496d-a721-c3d0b770d17c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:17.502319 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23069285-86ec-496d-a721-c3d0b770d17c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:17.509934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08947d-8f81-4546-af9e-4e85c25e83cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:17.510939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08947d-8f81-4546-af9e-4e85c25e83cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:17.510939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08947d-8f81-4546-af9e-4e85c25e83cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:17.511534 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08947d-8f81-4546-af9e-4e85c25e83cc admin admin] PATH_INFO: `/v3/projects/717683dae42b40c3a2bd0bcbefc6ddcd/users/6bab7b3e011e45c7998af6d89ad845e4/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:17.530408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f020112e50f498eaf8a66078030a3c1', 'request_id': 'req-de58ddb8-761d-472f-afb4-67970e25f6fc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:17.536559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f020112e50f498eaf8a66078030a3c1', 'request_id': 'req-de58ddb8-761d-472f-afb4-67970e25f6fc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:17.538565 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08947d-8f81-4546-af9e-4e85c25e83cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=717683dae42b40c3a2bd0bcbefc6ddcd, user_id=6bab7b3e011e45c7998af6d89ad845e4, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:17.542926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08947d-8f81-4546-af9e-4e85c25e83cc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:17.662948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f020112e50f498eaf8a66078030a3c1', 'request_id': 'req-de58ddb8-761d-472f-afb4-67970e25f6fc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:17.670220 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 982/1969] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:17 2022] PUT /identity/v3/projects/717683dae42b40c3a2bd0bcbefc6ddcd/users/6bab7b3e011e45c7998af6d89ad845e4/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:17.674134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08947d-8f81-4546-af9e-4e85c25e83cc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:17.674936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] The token cache is being invalidate because project 0f020112e50f498eaf8a66078030a3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:17.675261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:17.676551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:17.678575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 988/1970] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:17 2022] DELETE /identity/v3/projects/0f020112e50f498eaf8a66078030a3c1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:17.840568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08947d-8f81-4546-af9e-4e85c25e83cc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:17.840568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1515d4d-5a7a-479f-8f58-e290ce3d5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:17.841129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1515d4d-5a7a-479f-8f58-e290ce3d5a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:17.841276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1515d4d-5a7a-479f-8f58-e290ce3d5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:17.841842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1515d4d-5a7a-479f-8f58-e290ce3d5a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:17.843093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1515d4d-5a7a-479f-8f58-e290ce3d5a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:17.858521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1515d4d-5a7a-479f-8f58-e290ce3d5a3b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:17.864673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:17.867148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:17.878578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 983/1971] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:17.886221 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1515d4d-5a7a-479f-8f58-e290ce3d5a3b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:17.888419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b1515d4d-5a7a-479f-8f58-e290ce3d5a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:17.909721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1515d4d-5a7a-479f-8f58-e290ce3d5a3b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:17.917598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d1416-1471-4aae-bcb5-5c26d5e80a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:17.918993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1416-1471-4aae-bcb5-5c26d5e80a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:17.920243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1416-1471-4aae-bcb5-5c26d5e80a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:17.920595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d1416-1471-4aae-bcb5-5c26d5e80a6a admin admin] PATH_INFO: `/v3/projects/717683dae42b40c3a2bd0bcbefc6ddcd/users/6bab7b3e011e45c7998af6d89ad845e4/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:17.923134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d1416-1471-4aae-bcb5-5c26d5e80a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=717683dae42b40c3a2bd0bcbefc6ddcd, user_id=6bab7b3e011e45c7998af6d89ad845e4, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:17.926535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d1416-1471-4aae-bcb5-5c26d5e80a6a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:17.940726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 984/1972] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:17 2022] PUT /identity/v3/projects/717683dae42b40c3a2bd0bcbefc6ddcd/users/6bab7b3e011e45c7998af6d89ad845e4/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:17.957187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b349c-8e42-489b-832c-14150b308a3a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:17.958154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b349c-8e42-489b-832c-14150b308a3a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:17.958841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b349c-8e42-489b-832c-14150b308a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:17.976767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58ddb8-761d-472f-afb4-67970e25f6fc admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:18.008577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-757b349c-8e42-489b-832c-14150b308a3a None None] MFA Rules not processed for user `6bab7b3e011e45c7998af6d89ad845e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:18.010463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-757b349c-8e42-489b-832c-14150b308a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:18.041134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eea06e-0f70-49b3-8264-060944fa9771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:18.042303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eea06e-0f70-49b3-8264-060944fa9771 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:18.042539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eea06e-0f70-49b3-8264-060944fa9771 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:18.042957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eea06e-0f70-49b3-8264-060944fa9771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:18.048947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-60eea06e-0f70-49b3-8264-060944fa9771 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:18.123715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 985/1973] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:18.131678 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b349c-8e42-489b-832c-14150b308a3a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:18.134666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-757b349c-8e42-489b-832c-14150b308a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:18.148452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b349c-8e42-489b-832c-14150b308a3a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:18.152475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309d3e0-eaed-4f2b-95e8-b0ea58732d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:18.153187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309d3e0-eaed-4f2b-95e8-b0ea58732d1b service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:18.153551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309d3e0-eaed-4f2b-95e8-b0ea58732d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:18.153937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309d3e0-eaed-4f2b-95e8-b0ea58732d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:18.160773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eea06e-0f70-49b3-8264-060944fa9771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:18.163261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eea06e-0f70-49b3-8264-060944fa9771 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:18.170314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309d3e0-eaed-4f2b-95e8-b0ea58732d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:18.173414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309d3e0-eaed-4f2b-95e8-b0ea58732d1b service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:18.180748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 989/1974] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:18.217073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 986/1975] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:18.430320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eea06e-0f70-49b3-8264-060944fa9771 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:18.540940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eea06e-0f70-49b3-8264-060944fa9771 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:18.545733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:18.546448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:18.546729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:18.547002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] PATH_INFO: `/v3/users/8f7f65e8a2f24ab09c2bdcb14c480295` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:18.548137 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f7f65e8a2f24ab09c2bdcb14c480295)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:18.550110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:18.898862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f7f65e8a2f24ab09c2bdcb14c480295'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:18.906632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f7f65e8a2f24ab09c2bdcb14c480295'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:18.907437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f7f65e8a2f24ab09c2bdcb14c480295'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:19.017071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f7f65e8a2f24ab09c2bdcb14c480295'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:19.032812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f7f65e8a2f24ab09c2bdcb14c480295'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:19.043097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 990/1976] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:18 2022] DELETE /identity/v3/users/8f7f65e8a2f24ab09c2bdcb14c480295 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:19.044452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8a53f-3c49-441e-b8cd-9dd374fff0c5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:19.044900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8a53f-3c49-441e-b8cd-9dd374fff0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:19.045002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8a53f-3c49-441e-b8cd-9dd374fff0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:19.068726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ecf8a53f-3c49-441e-b8cd-9dd374fff0c5 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:19.069981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ecf8a53f-3c49-441e-b8cd-9dd374fff0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:19.155231 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 987/1977] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:19.166146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:19.167615 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:19.217091 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:19.246631 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b18ac-e76a-4cac-8f25-c5e0f03fbfa2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:19.250636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dee64-872a-4582-9f77-de01550d8190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:19.251250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dee64-872a-4582-9f77-de01550d8190 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:19.251530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dee64-872a-4582-9f77-de01550d8190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:19.251802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2dee64-872a-4582-9f77-de01550d8190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:19.261226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dee64-872a-4582-9f77-de01550d8190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:19.262708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2dee64-872a-4582-9f77-de01550d8190 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:19.280315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 991/1978] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:19.515103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:19.797075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8a53f-3c49-441e-b8cd-9dd374fff0c5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:19.799625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ecf8a53f-3c49-441e-b8cd-9dd374fff0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:19.812511 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8a53f-3c49-441e-b8cd-9dd374fff0c5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:19.817339 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:19.818027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:19.818304 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:19.818569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] PATH_INFO: `/v3/projects/97a9fd5d89324a7786aec38655c9374f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:19.820389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a9fd5d89324a7786aec38655c9374f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:19.822311 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:19.955628 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a9fd5d89324a7786aec38655c9374f', 'request_id': 'req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:19.962934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a9fd5d89324a7786aec38655c9374f', 'request_id': 'req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:19.968472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a9fd5d89324a7786aec38655c9374f', 'request_id': 'req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:20.050896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] The token cache is being invalidate because project 97a9fd5d89324a7786aec38655c9374f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:20.051624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:20.052018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:20.053714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 988/1979] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:19 2022] DELETE /identity/v3/projects/97a9fd5d89324a7786aec38655c9374f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:20.059178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dee64-872a-4582-9f77-de01550d8190 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:20.069937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2dee64-872a-4582-9f77-de01550d8190 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:20.139549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94efa56-9060-4639-91bd-82dd12a006e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:20.140204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94efa56-9060-4639-91bd-82dd12a006e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:20.140504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94efa56-9060-4639-91bd-82dd12a006e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:20.140902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94efa56-9060-4639-91bd-82dd12a006e0 admin admin] PATH_INFO: `/v3/users/6bab7b3e011e45c7998af6d89ad845e4` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:20.142103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94efa56-9060-4639-91bd-82dd12a006e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bab7b3e011e45c7998af6d89ad845e4)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:20.144209 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94efa56-9060-4639-91bd-82dd12a006e0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:20.381532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f94efa56-9060-4639-91bd-82dd12a006e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bab7b3e011e45c7998af6d89ad845e4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:20.388630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f94efa56-9060-4639-91bd-82dd12a006e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bab7b3e011e45c7998af6d89ad845e4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:20.389351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f94efa56-9060-4639-91bd-82dd12a006e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bab7b3e011e45c7998af6d89ad845e4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:20.583277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f94efa56-9060-4639-91bd-82dd12a006e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bab7b3e011e45c7998af6d89ad845e4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:20.596813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f94efa56-9060-4639-91bd-82dd12a006e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bab7b3e011e45c7998af6d89ad845e4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:20.604107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 992/1980] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:20 2022] DELETE /identity/v3/users/6bab7b3e011e45c7998af6d89ad845e4 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:21.230156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:21.239317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:21.246508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ef384-bf49-49a4-b6ed-8955b19d93a2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:21.315505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:21.316148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:21.316486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:21.316878 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] PATH_INFO: `/v3/projects/717683dae42b40c3a2bd0bcbefc6ddcd` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:21.318547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=717683dae42b40c3a2bd0bcbefc6ddcd)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:21.320486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:21.348872 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:21.498406 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717683dae42b40c3a2bd0bcbefc6ddcd', 'request_id': 'req-dacdd74c-1269-4634-b7bb-f4e1917f4528'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:21.507519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717683dae42b40c3a2bd0bcbefc6ddcd', 'request_id': 'req-dacdd74c-1269-4634-b7bb-f4e1917f4528'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:21.513298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717683dae42b40c3a2bd0bcbefc6ddcd', 'request_id': 'req-dacdd74c-1269-4634-b7bb-f4e1917f4528'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:21.695482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] The token cache is being invalidate because project 717683dae42b40c3a2bd0bcbefc6ddcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:21.695798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:21.696464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-dacdd74c-1269-4634-b7bb-f4e1917f4528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:21.697993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 989/1981] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:21 2022] DELETE /identity/v3/projects/717683dae42b40c3a2bd0bcbefc6ddcd => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:21.703528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085c1be-1c68-435b-971d-8d7861ef24f7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:21.704045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085c1be-1c68-435b-971d-8d7861ef24f7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:21.704213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085c1be-1c68-435b-971d-8d7861ef24f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:21.726245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d085c1be-1c68-435b-971d-8d7861ef24f7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:21.727442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d085c1be-1c68-435b-971d-8d7861ef24f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:21.794637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 993/1982] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:21.803171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de71ae0-b102-43ec-b53d-bf727e1373fd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:21.803457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de71ae0-b102-43ec-b53d-bf727e1373fd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:21.803832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de71ae0-b102-43ec-b53d-bf727e1373fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:21.806272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:21.826037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9de71ae0-b102-43ec-b53d-bf727e1373fd None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:21.827299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9de71ae0-b102-43ec-b53d-bf727e1373fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:21.836147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 990/1983] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:21.840549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085c1be-1c68-435b-971d-8d7861ef24f7 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:21.851544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085c1be-1c68-435b-971d-8d7861ef24f7 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:21.856205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1f676-4869-4962-98e2-a05e521dfeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:21.856816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f676-4869-4962-98e2-a05e521dfeec admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:21.857123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f676-4869-4962-98e2-a05e521dfeec admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:21.857587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1f676-4869-4962-98e2-a05e521dfeec admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:21.858066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1f676-4869-4962-98e2-a05e521dfeec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:21.858365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1f676-4869-4962-98e2-a05e521dfeec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:21.859962 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1f676-4869-4962-98e2-a05e521dfeec admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:21.872298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 994/1984] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:21.877160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de71ae0-b102-43ec-b53d-bf727e1373fd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:21.886910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de71ae0-b102-43ec-b53d-bf727e1373fd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:21.892518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fc010-32d0-4ea1-b555-155ccae007cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:21.893161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc010-32d0-4ea1-b555-155ccae007cd admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:21.893536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc010-32d0-4ea1-b555-155ccae007cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:21.893798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6fc010-32d0-4ea1-b555-155ccae007cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:21.895113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fc010-32d0-4ea1-b555-155ccae007cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:21.897427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6fc010-32d0-4ea1-b555-155ccae007cd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:22.036722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 991/1985] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:21 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:22.041837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1f676-4869-4962-98e2-a05e521dfeec admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:22.054310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1f676-4869-4962-98e2-a05e521dfeec admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:22.127044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe143f6-f261-4999-a0d7-799e9426da89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:22.127662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe143f6-f261-4999-a0d7-799e9426da89 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:22.127941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe143f6-f261-4999-a0d7-799e9426da89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:22.128214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe143f6-f261-4999-a0d7-799e9426da89 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:22.129418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe143f6-f261-4999-a0d7-799e9426da89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:22.131818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe143f6-f261-4999-a0d7-799e9426da89 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:22.287253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 995/1986] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:22 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:22.291878 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fc010-32d0-4ea1-b555-155ccae007cd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:22.304388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6fc010-32d0-4ea1-b555-155ccae007cd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:22.309689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bcdd8-93bc-4a4f-b9fe-926d668d3fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:22.310417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcdd8-93bc-4a4f-b9fe-926d668d3fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:22.310639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcdd8-93bc-4a4f-b9fe-926d668d3fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:22.310938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcdd8-93bc-4a4f-b9fe-926d668d3fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:22.311592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bcdd8-93bc-4a4f-b9fe-926d668d3fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:22.313181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bcdd8-93bc-4a4f-b9fe-926d668d3fd0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:22.325373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 992/1987] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:22.329804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe143f6-f261-4999-a0d7-799e9426da89 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:22.346077 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe143f6-f261-4999-a0d7-799e9426da89 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:22.352412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced93cbd-1a3a-4c0a-bcc4-3c84042a2b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:22.353045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced93cbd-1a3a-4c0a-bcc4-3c84042a2b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:22.353328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced93cbd-1a3a-4c0a-bcc4-3c84042a2b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:22.353597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced93cbd-1a3a-4c0a-bcc4-3c84042a2b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:22.354314 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced93cbd-1a3a-4c0a-bcc4-3c84042a2b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:22.355922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced93cbd-1a3a-4c0a-bcc4-3c84042a2b01 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:22.369243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 996/1988] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:22.373685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bcdd8-93bc-4a4f-b9fe-926d668d3fd0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:22.384506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bcdd8-93bc-4a4f-b9fe-926d668d3fd0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:22.389074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345039f-8f0e-4173-8342-2658fa900bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:22.389734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345039f-8f0e-4173-8342-2658fa900bea admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:22.390061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345039f-8f0e-4173-8342-2658fa900bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:22.390331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345039f-8f0e-4173-8342-2658fa900bea admin admin] PATH_INFO: `/v3/projects/e5b3496bb0c14c5891c81f5f530b6c30/users/162423fe530348cba9d6df3530fe1709/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:22.405817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345039f-8f0e-4173-8342-2658fa900bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b3496bb0c14c5891c81f5f530b6c30, user_id=162423fe530348cba9d6df3530fe1709, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:22.408579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345039f-8f0e-4173-8342-2658fa900bea admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:22.589509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 993/1989] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:22 2022] PUT /identity/v3/projects/e5b3496bb0c14c5891c81f5f530b6c30/users/162423fe530348cba9d6df3530fe1709/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:22.605198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab631b91-d8f1-4aef-824f-7dd4d85b6207 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:22.605481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab631b91-d8f1-4aef-824f-7dd4d85b6207 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:22.605790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab631b91-d8f1-4aef-824f-7dd4d85b6207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:22.637226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ab631b91-d8f1-4aef-824f-7dd4d85b6207 None None] MFA Rules not processed for user `162423fe530348cba9d6df3530fe1709`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:22.638758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ab631b91-d8f1-4aef-824f-7dd4d85b6207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:22.711027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 997/1990] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:22.717723 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345039f-8f0e-4173-8342-2658fa900bea admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:22.791127 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345039f-8f0e-4173-8342-2658fa900bea admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:22.796571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46788ef-ffe6-407c-8cd3-cb0dfd8c0ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:22.797206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46788ef-ffe6-407c-8cd3-cb0dfd8c0ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:22.797774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46788ef-ffe6-407c-8cd3-cb0dfd8c0ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:22.797998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46788ef-ffe6-407c-8cd3-cb0dfd8c0ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:22.798649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46788ef-ffe6-407c-8cd3-cb0dfd8c0ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:22.800589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46788ef-ffe6-407c-8cd3-cb0dfd8c0ec1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:22.916924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 994/1991] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:22 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:22.921182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab631b91-d8f1-4aef-824f-7dd4d85b6207 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:22.934566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab631b91-d8f1-4aef-824f-7dd4d85b6207 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:22.997206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5968270-62f7-4bee-a935-ae6235bb5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:22.997810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5968270-62f7-4bee-a935-ae6235bb5159 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:22.998119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5968270-62f7-4bee-a935-ae6235bb5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:22.998387 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5968270-62f7-4bee-a935-ae6235bb5159 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:22.999023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5968270-62f7-4bee-a935-ae6235bb5159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:23.001250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5968270-62f7-4bee-a935-ae6235bb5159 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:23.127947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 998/1992] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:22 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:23.134117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46788ef-ffe6-407c-8cd3-cb0dfd8c0ec1 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:23.148654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46788ef-ffe6-407c-8cd3-cb0dfd8c0ec1 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:23.155656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438899df-5663-45f1-87f0-286d4f554e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:23.156676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438899df-5663-45f1-87f0-286d4f554e72 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:23.157144 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438899df-5663-45f1-87f0-286d4f554e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:23.157606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438899df-5663-45f1-87f0-286d4f554e72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:23.158802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438899df-5663-45f1-87f0-286d4f554e72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:23.160438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438899df-5663-45f1-87f0-286d4f554e72 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:23.172259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 995/1993] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:23.178243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5968270-62f7-4bee-a935-ae6235bb5159 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:23.194600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5968270-62f7-4bee-a935-ae6235bb5159 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:23.196596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803cb062-4407-4b93-a3f0-e83a36dfe805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:23.197459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cb062-4407-4b93-a3f0-e83a36dfe805 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:23.198038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cb062-4407-4b93-a3f0-e83a36dfe805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:23.198558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803cb062-4407-4b93-a3f0-e83a36dfe805 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:23.202003 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cb062-4407-4b93-a3f0-e83a36dfe805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:23.203875 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803cb062-4407-4b93-a3f0-e83a36dfe805 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:23.216751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 999/1994] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:23.220740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438899df-5663-45f1-87f0-286d4f554e72 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:23.232089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438899df-5663-45f1-87f0-286d4f554e72 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:23.238148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ee302-0a02-4364-b508-3fe15908c1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:23.239153 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ee302-0a02-4364-b508-3fe15908c1da admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:23.239568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ee302-0a02-4364-b508-3fe15908c1da admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:23.239989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ee302-0a02-4364-b508-3fe15908c1da admin admin] PATH_INFO: `/v3/projects/3e6902026d57406ab13eb559450ff1a9/users/0f488c4d0d2a43f7b1d6de55541bd838/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:23.263152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ee302-0a02-4364-b508-3fe15908c1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e6902026d57406ab13eb559450ff1a9, user_id=0f488c4d0d2a43f7b1d6de55541bd838, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:23.266950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ee302-0a02-4364-b508-3fe15908c1da admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:23.366641 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 996/1995] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:23 2022] PUT /identity/v3/projects/3e6902026d57406ab13eb559450ff1a9/users/0f488c4d0d2a43f7b1d6de55541bd838/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:23.382553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c9b1d-db6a-46ae-8929-f51f5b1c6bab None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:23.383073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c9b1d-db6a-46ae-8929-f51f5b1c6bab None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:23.383292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c9b1d-db6a-46ae-8929-f51f5b1c6bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:23.426606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-af8c9b1d-db6a-46ae-8929-f51f5b1c6bab None None] MFA Rules not processed for user `0f488c4d0d2a43f7b1d6de55541bd838`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:23.428666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-af8c9b1d-db6a-46ae-8929-f51f5b1c6bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:23.507218 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1000/1996] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:23.511900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ee302-0a02-4364-b508-3fe15908c1da admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:23.593613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ee302-0a02-4364-b508-3fe15908c1da admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:23.603947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb77a26-e33a-485b-a41d-33f3a9fa1d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:23.604533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb77a26-e33a-485b-a41d-33f3a9fa1d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:23.604817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb77a26-e33a-485b-a41d-33f3a9fa1d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:23.605096 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb77a26-e33a-485b-a41d-33f3a9fa1d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:23.605814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb77a26-e33a-485b-a41d-33f3a9fa1d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:23.607846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb77a26-e33a-485b-a41d-33f3a9fa1d27 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:23.723184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 997/1997] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:23 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:23.727628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c9b1d-db6a-46ae-8929-f51f5b1c6bab None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:23.740563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c9b1d-db6a-46ae-8929-f51f5b1c6bab None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:23.826266 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccc528-546a-4345-821b-58d42b8809d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:23.827100 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccc528-546a-4345-821b-58d42b8809d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:23.827385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccc528-546a-4345-821b-58d42b8809d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:23.827657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccc528-546a-4345-821b-58d42b8809d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:23.828310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccc528-546a-4345-821b-58d42b8809d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:23.830454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ccc528-546a-4345-821b-58d42b8809d6 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:23.933579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1001/1998] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:23 2022] POST /identity/v3/users => generated 298 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:23.939623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb77a26-e33a-485b-a41d-33f3a9fa1d27 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:23.955536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb77a26-e33a-485b-a41d-33f3a9fa1d27 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:23.961724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e3132-5b53-41e9-a2c5-d62ecbca5314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:23.962388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3132-5b53-41e9-a2c5-d62ecbca5314 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:23.962660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3132-5b53-41e9-a2c5-d62ecbca5314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:23.962932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e3132-5b53-41e9-a2c5-d62ecbca5314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:23.963583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e3132-5b53-41e9-a2c5-d62ecbca5314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:23.965314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e3132-5b53-41e9-a2c5-d62ecbca5314 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:23.977328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 998/1999] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:23.985510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccc528-546a-4345-821b-58d42b8809d6 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:24.002878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccc528-546a-4345-821b-58d42b8809d6 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:24.011185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b131273-2fc3-43bc-ba3a-606d783ed4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:24.012000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131273-2fc3-43bc-ba3a-606d783ed4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:24.012308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131273-2fc3-43bc-ba3a-606d783ed4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:24.012645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b131273-2fc3-43bc-ba3a-606d783ed4c2 admin admin] PATH_INFO: `/v3/projects/8035397df52f47c2add47ec592ea98ac/users/45a0b5ce26804146b4947470c59d4ef0/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:24.029627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:24.031804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b131273-2fc3-43bc-ba3a-606d783ed4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8035397df52f47c2add47ec592ea98ac, user_id=45a0b5ce26804146b4947470c59d4ef0, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:24.035250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b131273-2fc3-43bc-ba3a-606d783ed4c2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:24.146465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1002/2000] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:23 2022] PUT /identity/v3/projects/8035397df52f47c2add47ec592ea98ac/users/45a0b5ce26804146b4947470c59d4ef0/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:24.149448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e3132-5b53-41e9-a2c5-d62ecbca5314 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:24.164221 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e3132-5b53-41e9-a2c5-d62ecbca5314 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:24.232710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d335e5d-21ee-46f5-8ae3-cc764dbd500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:24.233322 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d335e5d-21ee-46f5-8ae3-cc764dbd500e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:24.233603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d335e5d-21ee-46f5-8ae3-cc764dbd500e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:24.233920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d335e5d-21ee-46f5-8ae3-cc764dbd500e admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:24.234555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d335e5d-21ee-46f5-8ae3-cc764dbd500e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:24.236166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d335e5d-21ee-46f5-8ae3-cc764dbd500e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:24.247934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 999/2001] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:24.252514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b131273-2fc3-43bc-ba3a-606d783ed4c2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:24.264498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b131273-2fc3-43bc-ba3a-606d783ed4c2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:24.270214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e32312-bb67-4bb1-b8dc-9e090479ed4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:24.270921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32312-bb67-4bb1-b8dc-9e090479ed4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:24.271205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32312-bb67-4bb1-b8dc-9e090479ed4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:24.271498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e32312-bb67-4bb1-b8dc-9e090479ed4e admin admin] PATH_INFO: `/v3/projects/8035397df52f47c2add47ec592ea98ac/users/45a0b5ce26804146b4947470c59d4ef0/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:24.273530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e32312-bb67-4bb1-b8dc-9e090479ed4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8035397df52f47c2add47ec592ea98ac, user_id=45a0b5ce26804146b4947470c59d4ef0, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:24.276662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e32312-bb67-4bb1-b8dc-9e090479ed4e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:24.293553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1003/2002] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:24 2022] PUT /identity/v3/projects/8035397df52f47c2add47ec592ea98ac/users/45a0b5ce26804146b4947470c59d4ef0/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:24.305184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77393f07-c167-4b1a-bb56-6349ae53bcb0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:24.305476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77393f07-c167-4b1a-bb56-6349ae53bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:24.305757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77393f07-c167-4b1a-bb56-6349ae53bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:24.348451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-77393f07-c167-4b1a-bb56-6349ae53bcb0 None None] MFA Rules not processed for user `45a0b5ce26804146b4947470c59d4ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:24.350600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-77393f07-c167-4b1a-bb56-6349ae53bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:24.477690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1000/2003] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:24.491932 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e32312-bb67-4bb1-b8dc-9e090479ed4e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:24.493721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-56e32312-bb67-4bb1-b8dc-9e090479ed4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:24.539434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:24.575451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e32312-bb67-4bb1-b8dc-9e090479ed4e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:24.579372 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbdef2-f8ac-4b04-8a00-50c76df88a92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:24.583535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbdef2-f8ac-4b04-8a00-50c76df88a92 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:24.583535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbdef2-f8ac-4b04-8a00-50c76df88a92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:24.583535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbdef2-f8ac-4b04-8a00-50c76df88a92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:24.652248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbdef2-f8ac-4b04-8a00-50c76df88a92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:24.655067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbdef2-f8ac-4b04-8a00-50c76df88a92 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:24.673179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1004/2004] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:27.149270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77393f07-c167-4b1a-bb56-6349ae53bcb0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:27.152852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-77393f07-c167-4b1a-bb56-6349ae53bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:27.172661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77393f07-c167-4b1a-bb56-6349ae53bcb0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:27.178522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3461b99-2c4e-4d68-8ef8-7f2b540676a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:27.179359 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3461b99-2c4e-4d68-8ef8-7f2b540676a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:27.179636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3461b99-2c4e-4d68-8ef8-7f2b540676a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:27.179936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3461b99-2c4e-4d68-8ef8-7f2b540676a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:27.254321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3461b99-2c4e-4d68-8ef8-7f2b540676a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:27.256398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3461b99-2c4e-4d68-8ef8-7f2b540676a4 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:27.267101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1001/2005] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:27.427711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:28.103102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:29.345854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbdef2-f8ac-4b04-8a00-50c76df88a92 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:29.355243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbdef2-f8ac-4b04-8a00-50c76df88a92 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:29.359128 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021aa82b-b2ba-4df1-a4f5-37b9ba12b97b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:29.359737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa82b-b2ba-4df1-a4f5-37b9ba12b97b service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:29.360015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa82b-b2ba-4df1-a4f5-37b9ba12b97b service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:29.360284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021aa82b-b2ba-4df1-a4f5-37b9ba12b97b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:29.372463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aa82b-b2ba-4df1-a4f5-37b9ba12b97b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:29.373945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021aa82b-b2ba-4df1-a4f5-37b9ba12b97b service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:29.383427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:29.388553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1005/2006] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:29.771340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:30.370960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:32.373473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:32.655191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:33.856745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:34.234116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:34.866163 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3461b99-2c4e-4d68-8ef8-7f2b540676a4 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:34.946020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f37fb-c4ea-4183-aed7-de7584fae599 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:34.946407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f37fb-c4ea-4183-aed7-de7584fae599 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:34.946883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f37fb-c4ea-4183-aed7-de7584fae599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:34.967319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-817f37fb-c4ea-4183-aed7-de7584fae599 None None] MFA Rules not processed for user `cc98fc52cf0f4e83ab8369221a6ba551`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:34.968635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-817f37fb-c4ea-4183-aed7-de7584fae599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:34.970897 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3461b99-2c4e-4d68-8ef8-7f2b540676a4 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:34.982676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:34.982676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:34.982676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:34.982676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] PATH_INFO: `/v3/users/162423fe530348cba9d6df3530fe1709` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:34.983305 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=162423fe530348cba9d6df3530fe1709)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:34.984588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:35.043287 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1006/2007] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:35.489441 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '162423fe530348cba9d6df3530fe1709'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:35.498823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '162423fe530348cba9d6df3530fe1709'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:35.499980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '162423fe530348cba9d6df3530fe1709'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:35.691945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '162423fe530348cba9d6df3530fe1709'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:35.693267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '162423fe530348cba9d6df3530fe1709'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:35.714400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1002/2008] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:34 2022] DELETE /identity/v3/users/162423fe530348cba9d6df3530fe1709 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:35.719124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a23d-0df3-4e73-880a-9655dd216586 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:35.719698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a23d-0df3-4e73-880a-9655dd216586 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:35.719698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a23d-0df3-4e73-880a-9655dd216586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:35.739450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6911a23d-0df3-4e73-880a-9655dd216586 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:35.743468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6911a23d-0df3-4e73-880a-9655dd216586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:35.813645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1007/2009] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:35.824515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:35.827886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:35.923291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78b2fa-fa33-4fc6-96e7-d42a994e2f4c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:35.927606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bb3fa-a326-42b7-bb2e-bdcad44e058d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:35.928286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bb3fa-a326-42b7-bb2e-bdcad44e058d service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:35.928576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bb3fa-a326-42b7-bb2e-bdcad44e058d service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:35.928849 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bb3fa-a326-42b7-bb2e-bdcad44e058d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:35.939745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bb3fa-a326-42b7-bb2e-bdcad44e058d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:35.941751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bb3fa-a326-42b7-bb2e-bdcad44e058d service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:35.948449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:35.953065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1003/2010] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:36.235270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:36.541091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911a23d-0df3-4e73-880a-9655dd216586 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:36.542707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6911a23d-0df3-4e73-880a-9655dd216586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:36.562300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911a23d-0df3-4e73-880a-9655dd216586 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:36.575225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:36.575225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:36.575225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:36.575225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] PATH_INFO: `/v3/projects/e5b3496bb0c14c5891c81f5f530b6c30` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:36.576294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b3496bb0c14c5891c81f5f530b6c30)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:36.579353 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:36.842978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b3496bb0c14c5891c81f5f530b6c30', 'request_id': 'req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:36.851048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b3496bb0c14c5891c81f5f530b6c30', 'request_id': 'req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:36.948952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b3496bb0c14c5891c81f5f530b6c30', 'request_id': 'req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:36.963918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] The token cache is being invalidate because project e5b3496bb0c14c5891c81f5f530b6c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:36.964214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:36.964898 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:36.966746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1008/2011] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:36 2022] DELETE /identity/v3/projects/e5b3496bb0c14c5891c81f5f530b6c30 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:36.970784 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bb3fa-a326-42b7-bb2e-bdcad44e058d service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:36.984282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bb3fa-a326-42b7-bb2e-bdcad44e058d service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:37.046682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c802721-d391-4d28-996e-94fc8a73eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:37.047323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c802721-d391-4d28-996e-94fc8a73eec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:37.047609 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c802721-d391-4d28-996e-94fc8a73eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:37.047885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c802721-d391-4d28-996e-94fc8a73eec9 admin admin] PATH_INFO: `/v3/users/0f488c4d0d2a43f7b1d6de55541bd838` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:37.049028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c802721-d391-4d28-996e-94fc8a73eec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f488c4d0d2a43f7b1d6de55541bd838)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:37.051200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c802721-d391-4d28-996e-94fc8a73eec9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:37.341068 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7c802721-d391-4d28-996e-94fc8a73eec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f488c4d0d2a43f7b1d6de55541bd838'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:37.348288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7c802721-d391-4d28-996e-94fc8a73eec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f488c4d0d2a43f7b1d6de55541bd838'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:37.349031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7c802721-d391-4d28-996e-94fc8a73eec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f488c4d0d2a43f7b1d6de55541bd838'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:37.377056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:37.378530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:37.392269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb881e-b5ba-4876-b2d6-2dfd1a79b15c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:37.397727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:37.398409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:37.398686 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:37.398957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] PATH_INFO: `/v3/users/26cd5ab96976405b9c81c25857a28a95` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:37.400085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26cd5ab96976405b9c81c25857a28a95)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:37.402047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:37.496736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7c802721-d391-4d28-996e-94fc8a73eec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f488c4d0d2a43f7b1d6de55541bd838'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:37.497708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7c802721-d391-4d28-996e-94fc8a73eec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f488c4d0d2a43f7b1d6de55541bd838'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:37.520490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1004/2012] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:36 2022] DELETE /identity/v3/users/0f488c4d0d2a43f7b1d6de55541bd838 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:37.819921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26cd5ab96976405b9c81c25857a28a95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:37.827002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26cd5ab96976405b9c81c25857a28a95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:37.827687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26cd5ab96976405b9c81c25857a28a95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:37.953373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26cd5ab96976405b9c81c25857a28a95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:37.970605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26cd5ab96976405b9c81c25857a28a95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:37.978333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1009/2013] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:37 2022] DELETE /identity/v3/users/26cd5ab96976405b9c81c25857a28a95 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:37.982970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe1dde-d063-48f0-9c18-1edf24bb9817 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:37.983713 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe1dde-d063-48f0-9c18-1edf24bb9817 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:37.983713 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe1dde-d063-48f0-9c18-1edf24bb9817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:38.005409 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-edbe1dde-d063-48f0-9c18-1edf24bb9817 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:38.006677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-edbe1dde-d063-48f0-9c18-1edf24bb9817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:38.120390 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1005/2014] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:38.133213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:38.134773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:38.201308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe1dde-d063-48f0-9c18-1edf24bb9817 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:38.203176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-edbe1dde-d063-48f0-9c18-1edf24bb9817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:38.233731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9c2fb-adb0-41c5-ac0d-bb54d77de015 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:38.233930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe1dde-d063-48f0-9c18-1edf24bb9817 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:38.248016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065ca54-b279-4370-984f-299d4b3a52c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:38.249568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065ca54-b279-4370-984f-299d4b3a52c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:38.250457 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065ca54-b279-4370-984f-299d4b3a52c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:38.250713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065ca54-b279-4370-984f-299d4b3a52c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:38.251572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:38.252401 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:38.252788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:38.253206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] PATH_INFO: `/v3/projects/3e6902026d57406ab13eb559450ff1a9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:38.256402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e6902026d57406ab13eb559450ff1a9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:38.258875 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:38.288020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065ca54-b279-4370-984f-299d4b3a52c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:38.290831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d065ca54-b279-4370-984f-299d4b3a52c7 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:38.309326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1010/2015] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:38.354864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:38.412328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e6902026d57406ab13eb559450ff1a9', 'request_id': 'req-cd1eb745-6f61-4dae-a482-1af5aff46913'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.421187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e6902026d57406ab13eb559450ff1a9', 'request_id': 'req-cd1eb745-6f61-4dae-a482-1af5aff46913'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.428276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e6902026d57406ab13eb559450ff1a9', 'request_id': 'req-cd1eb745-6f61-4dae-a482-1af5aff46913'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.543858 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:38.594229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] The token cache is being invalidate because project 3e6902026d57406ab13eb559450ff1a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:38.594617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.595518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.598245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1006/2016] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:38 2022] DELETE /identity/v3/projects/3e6902026d57406ab13eb559450ff1a9 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:38.602167 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065ca54-b279-4370-984f-299d4b3a52c7 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:38.615687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065ca54-b279-4370-984f-299d4b3a52c7 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:38.711857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:38.713171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:38.714133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:38.714133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] PATH_INFO: `/v3/users/45a0b5ce26804146b4947470c59d4ef0` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:38.716350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45a0b5ce26804146b4947470c59d4ef0)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:38.718798 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:38.981528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45a0b5ce26804146b4947470c59d4ef0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.994580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45a0b5ce26804146b4947470c59d4ef0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:38.996104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45a0b5ce26804146b4947470c59d4ef0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:39.010448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:39.012385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:39.028404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1eb745-6f61-4dae-a482-1af5aff46913 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:39.033974 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:39.041113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:39.041113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:39.041113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] PATH_INFO: `/v3/projects/dba6bdfa40cc43ff9a8a4f0b622ae41a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:39.041113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba6bdfa40cc43ff9a8a4f0b622ae41a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:39.041113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:39.080724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45a0b5ce26804146b4947470c59d4ef0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:39.113746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45a0b5ce26804146b4947470c59d4ef0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:39.121653 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1011/2017] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:38 2022] DELETE /identity/v3/users/45a0b5ce26804146b4947470c59d4ef0 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:39.186720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba6bdfa40cc43ff9a8a4f0b622ae41a', 'request_id': 'req-37aca2a5-3d21-4ce7-bc30-3138255e0f52'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:39.196121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba6bdfa40cc43ff9a8a4f0b622ae41a', 'request_id': 'req-37aca2a5-3d21-4ce7-bc30-3138255e0f52'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:39.205952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba6bdfa40cc43ff9a8a4f0b622ae41a', 'request_id': 'req-37aca2a5-3d21-4ce7-bc30-3138255e0f52'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:39.334372 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] The token cache is being invalidate because project dba6bdfa40cc43ff9a8a4f0b622ae41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:39.334372 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:39.335859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:39.342078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1007/2018] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:39 2022] DELETE /identity/v3/projects/dba6bdfa40cc43ff9a8a4f0b622ae41a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:39.343540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:39.345165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:39.475690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadcbd1-c63a-40d1-ba88-ec41e8406996 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:39.562915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:39.662573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148fb9a-554f-4da6-995b-61edeb0ad43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:39.664252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148fb9a-554f-4da6-995b-61edeb0ad43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:39.664998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148fb9a-554f-4da6-995b-61edeb0ad43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:39.666345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148fb9a-554f-4da6-995b-61edeb0ad43e admin admin] PATH_INFO: `/v3/users/c0dca2249b764657b3eb5972e25d1962` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:39.670805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148fb9a-554f-4da6-995b-61edeb0ad43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0dca2249b764657b3eb5972e25d1962)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:39.677187 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148fb9a-554f-4da6-995b-61edeb0ad43e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:39.797059 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:40.040510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:40.042479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:40.068273 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d148fb9a-554f-4da6-995b-61edeb0ad43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0dca2249b764657b3eb5972e25d1962'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.079390 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca2a5-3d21-4ce7-bc30-3138255e0f52 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:40.093533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d148fb9a-554f-4da6-995b-61edeb0ad43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0dca2249b764657b3eb5972e25d1962'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.095270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d148fb9a-554f-4da6-995b-61edeb0ad43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0dca2249b764657b3eb5972e25d1962'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.111924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:40.113307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:40.114001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:40.114558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] PATH_INFO: `/v3/projects/8035397df52f47c2add47ec592ea98ac` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:40.118078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8035397df52f47c2add47ec592ea98ac)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:40.123566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:40.176960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d148fb9a-554f-4da6-995b-61edeb0ad43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0dca2249b764657b3eb5972e25d1962'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.200840 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d148fb9a-554f-4da6-995b-61edeb0ad43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0dca2249b764657b3eb5972e25d1962'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.220310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1012/2019] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:39 2022] DELETE /identity/v3/users/c0dca2249b764657b3eb5972e25d1962 => generated 0 bytes in 877 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:40.309764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8035397df52f47c2add47ec592ea98ac', 'request_id': 'req-d297aed1-2144-4ce0-b6b4-c170d04ca702'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.321686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8035397df52f47c2add47ec592ea98ac', 'request_id': 'req-d297aed1-2144-4ce0-b6b4-c170d04ca702'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.333640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8035397df52f47c2add47ec592ea98ac', 'request_id': 'req-d297aed1-2144-4ce0-b6b4-c170d04ca702'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.424738 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:40.431988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] The token cache is being invalidate because project 8035397df52f47c2add47ec592ea98ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:40.432625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.434035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d297aed1-2144-4ce0-b6b4-c170d04ca702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:40.437216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1008/2020] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:40 2022] DELETE /identity/v3/projects/8035397df52f47c2add47ec592ea98ac => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:40.443342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1c651-7081-442c-900a-bd374c11b0f3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:40.443919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1c651-7081-442c-900a-bd374c11b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:40.444363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1c651-7081-442c-900a-bd374c11b0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:40.475759 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a5d1c651-7081-442c-900a-bd374c11b0f3 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:40.477324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a5d1c651-7081-442c-900a-bd374c11b0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:40.597213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1013/2021] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:40.607792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454d46-03c7-44cb-8288-42e2771c8c06 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:40.608373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454d46-03c7-44cb-8288-42e2771c8c06 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:40.608863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454d46-03c7-44cb-8288-42e2771c8c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:40.665403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-26454d46-03c7-44cb-8288-42e2771c8c06 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:40.669602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-26454d46-03c7-44cb-8288-42e2771c8c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:40.692585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1009/2022] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:40.697577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1c651-7081-442c-900a-bd374c11b0f3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:40.709233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1c651-7081-442c-900a-bd374c11b0f3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:40.716157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830702c2-61e0-42af-8195-12f86671a1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:40.717066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830702c2-61e0-42af-8195-12f86671a1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:40.717526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830702c2-61e0-42af-8195-12f86671a1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:40.717964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830702c2-61e0-42af-8195-12f86671a1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:40.718824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830702c2-61e0-42af-8195-12f86671a1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:40.719266 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830702c2-61e0-42af-8195-12f86671a1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:40.721224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830702c2-61e0-42af-8195-12f86671a1b8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:40.735674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1014/2023] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:37:40.744348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26454d46-03c7-44cb-8288-42e2771c8c06 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:40.783676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26454d46-03c7-44cb-8288-42e2771c8c06 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:40.799350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece758fc-e7f8-4bff-871c-e72006fc5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:40.808710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:40.809711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece758fc-e7f8-4bff-871c-e72006fc5e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:40.810592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece758fc-e7f8-4bff-871c-e72006fc5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:40.811323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece758fc-e7f8-4bff-871c-e72006fc5e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:40.814591 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece758fc-e7f8-4bff-871c-e72006fc5e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:40.831017 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece758fc-e7f8-4bff-871c-e72006fc5e98 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:40.952524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1010/2024] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:40 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:40.959336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830702c2-61e0-42af-8195-12f86671a1b8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:40.984387 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830702c2-61e0-42af-8195-12f86671a1b8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:41.025848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece758fc-e7f8-4bff-871c-e72006fc5e98 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:41.036654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ece758fc-e7f8-4bff-871c-e72006fc5e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:41.127528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9c615-f4c3-4afd-b296-082813e0be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:41.128521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c615-f4c3-4afd-b296-082813e0be7c admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.129157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c615-f4c3-4afd-b296-082813e0be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.129608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c615-f4c3-4afd-b296-082813e0be7c admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.132826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9c615-f4c3-4afd-b296-082813e0be7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:41.136445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9c615-f4c3-4afd-b296-082813e0be7c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:41.204494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece758fc-e7f8-4bff-871c-e72006fc5e98 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:41.214180 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:41.215461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.215942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.216421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] PATH_INFO: `/v3/projects/615a361ef8bb4121a16d7cba476d0c44` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.218727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=615a361ef8bb4121a16d7cba476d0c44)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:41.222249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:41.279082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1015/2025] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:40 2022] POST /identity/v3/users => generated 292 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:41.286897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9c615-f4c3-4afd-b296-082813e0be7c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:41.317591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9c615-f4c3-4afd-b296-082813e0be7c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:41.326174 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92b84b-10f1-4e5c-b8bb-9258aa80035c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:41.327876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b84b-10f1-4e5c-b8bb-9258aa80035c admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.328758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b84b-10f1-4e5c-b8bb-9258aa80035c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.329417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92b84b-10f1-4e5c-b8bb-9258aa80035c admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.330640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92b84b-10f1-4e5c-b8bb-9258aa80035c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:41.335336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92b84b-10f1-4e5c-b8bb-9258aa80035c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:41.357004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1016/2026] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:41.361335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92b84b-10f1-4e5c-b8bb-9258aa80035c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:41.382777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92b84b-10f1-4e5c-b8bb-9258aa80035c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:41.388064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebabc45-31a7-48b1-890f-a48fa99e3049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:41.388815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebabc45-31a7-48b1-890f-a48fa99e3049 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.389163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebabc45-31a7-48b1-890f-a48fa99e3049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.389505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebabc45-31a7-48b1-890f-a48fa99e3049 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.390256 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebabc45-31a7-48b1-890f-a48fa99e3049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:41.392218 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebabc45-31a7-48b1-890f-a48fa99e3049 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:41.418020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1017/2027] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:41.420255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebabc45-31a7-48b1-890f-a48fa99e3049 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:41.437387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '615a361ef8bb4121a16d7cba476d0c44', 'request_id': 'req-b85227c2-8395-464c-a5a8-5e2b264ffd4e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:41.442153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebabc45-31a7-48b1-890f-a48fa99e3049 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:41.446088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '615a361ef8bb4121a16d7cba476d0c44', 'request_id': 'req-b85227c2-8395-464c-a5a8-5e2b264ffd4e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:41.453743 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '615a361ef8bb4121a16d7cba476d0c44', 'request_id': 'req-b85227c2-8395-464c-a5a8-5e2b264ffd4e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:41.524202 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ecb57-c7b3-430e-ad62-f0a177df6288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:41.524868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ecb57-c7b3-430e-ad62-f0a177df6288 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.525145 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ecb57-c7b3-430e-ad62-f0a177df6288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.525412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ecb57-c7b3-430e-ad62-f0a177df6288 admin admin] PATH_INFO: `/v3/projects/5c3f893f1523421b9541fa72bd9a7863/users/aab3db3757f24ffd9f2e0ab397bbf20d/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.542339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ecb57-c7b3-430e-ad62-f0a177df6288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3f893f1523421b9541fa72bd9a7863, user_id=aab3db3757f24ffd9f2e0ab397bbf20d, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:41.546637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ecb57-c7b3-430e-ad62-f0a177df6288 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:41.569915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] The token cache is being invalidate because project 615a361ef8bb4121a16d7cba476d0c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:41.570684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:41.572325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b85227c2-8395-464c-a5a8-5e2b264ffd4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:41.580253 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1011/2028] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:41 2022] DELETE /identity/v3/projects/615a361ef8bb4121a16d7cba476d0c44 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:41.589167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e780-14f7-4012-985e-3d7e0040ac96 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.590084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e780-14f7-4012-985e-3d7e0040ac96 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.590890 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684e780-14f7-4012-985e-3d7e0040ac96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.627229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6684e780-14f7-4012-985e-3d7e0040ac96 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:41.629274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6684e780-14f7-4012-985e-3d7e0040ac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:41.642621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1012/2029] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:41.652865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354db959-9c33-4d39-8454-11d92a67de1e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.653150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354db959-9c33-4d39-8454-11d92a67de1e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.653428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354db959-9c33-4d39-8454-11d92a67de1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.684196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-354db959-9c33-4d39-8454-11d92a67de1e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:41.685671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-354db959-9c33-4d39-8454-11d92a67de1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:41.687350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1018/2030] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:41 2022] PUT /identity/v3/projects/5c3f893f1523421b9541fa72bd9a7863/users/aab3db3757f24ffd9f2e0ab397bbf20d/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:41.693782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62b3b7-0b9a-4ebd-9f40-012f901da3a9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.694259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62b3b7-0b9a-4ebd-9f40-012f901da3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.694747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62b3b7-0b9a-4ebd-9f40-012f901da3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.722643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2a62b3b7-0b9a-4ebd-9f40-012f901da3a9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:41.724914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2a62b3b7-0b9a-4ebd-9f40-012f901da3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:41.811069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1019/2031] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:41.812291 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62b3b7-0b9a-4ebd-9f40-012f901da3a9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:41.813943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2a62b3b7-0b9a-4ebd-9f40-012f901da3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:41.834111 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1013/2032] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:41.835761 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354db959-9c33-4d39-8454-11d92a67de1e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:41.851167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354db959-9c33-4d39-8454-11d92a67de1e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:41.860614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fa56-5929-4e9b-b14b-dcf1bc91d3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:41.860978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fa56-5929-4e9b-b14b-dcf1bc91d3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.861439 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fa56-5929-4e9b-b14b-dcf1bc91d3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.861870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fa56-5929-4e9b-b14b-dcf1bc91d3c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.863048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94fa56-5929-4e9b-b14b-dcf1bc91d3c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:41.863600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94fa56-5929-4e9b-b14b-dcf1bc91d3c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:41.866385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94fa56-5929-4e9b-b14b-dcf1bc91d3c0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:41.890690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1014/2033] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:41.892301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fa56-5929-4e9b-b14b-dcf1bc91d3c0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:41.905849 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fa56-5929-4e9b-b14b-dcf1bc91d3c0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:41.912328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93442d5-2350-4b56-8445-7ea39a982ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:41.913103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93442d5-2350-4b56-8445-7ea39a982ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.913486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93442d5-2350-4b56-8445-7ea39a982ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.913891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93442d5-2350-4b56-8445-7ea39a982ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.915189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93442d5-2350-4b56-8445-7ea39a982ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:41.917376 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93442d5-2350-4b56-8445-7ea39a982ee1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:41.920077 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62b3b7-0b9a-4ebd-9f40-012f901da3a9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:41.923973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7653cf-2a20-4be3-9920-89d8a8d09bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:41.924996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7653cf-2a20-4be3-9920-89d8a8d09bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:41.925435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7653cf-2a20-4be3-9920-89d8a8d09bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:41.925784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7653cf-2a20-4be3-9920-89d8a8d09bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:41.937190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7653cf-2a20-4be3-9920-89d8a8d09bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:41.939199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7653cf-2a20-4be3-9920-89d8a8d09bc8 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:41.950731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1020/2034] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:42.071866 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1015/2035] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:41 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:42.073713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7653cf-2a20-4be3-9920-89d8a8d09bc8 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:42.087009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7653cf-2a20-4be3-9920-89d8a8d09bc8 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:42.159944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c4253-3c40-484c-916c-ed8264fb5bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:42.161027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c4253-3c40-484c-916c-ed8264fb5bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.161027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c4253-3c40-484c-916c-ed8264fb5bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.161310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c4253-3c40-484c-916c-ed8264fb5bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.162151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c4253-3c40-484c-916c-ed8264fb5bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:42.163935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c4253-3c40-484c-916c-ed8264fb5bf8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:42.183762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:42.295526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1021/2036] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:42 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:42.301147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93442d5-2350-4b56-8445-7ea39a982ee1 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:42.320724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93442d5-2350-4b56-8445-7ea39a982ee1 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:42.327079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848b96a-7326-43c7-b923-be136c184ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:42.328171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848b96a-7326-43c7-b923-be136c184ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.328574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848b96a-7326-43c7-b923-be136c184ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.328983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0848b96a-7326-43c7-b923-be136c184ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.330071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848b96a-7326-43c7-b923-be136c184ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:42.332571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0848b96a-7326-43c7-b923-be136c184ce8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:42.346549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1016/2037] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:42.376298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c4253-3c40-484c-916c-ed8264fb5bf8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:42.387446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c4253-3c40-484c-916c-ed8264fb5bf8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:42.402782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd2919-49ee-4200-952e-a099af989e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:42.403422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2919-49ee-4200-952e-a099af989e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.403866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2919-49ee-4200-952e-a099af989e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.404147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd2919-49ee-4200-952e-a099af989e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.404797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd2919-49ee-4200-952e-a099af989e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:42.406561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd2919-49ee-4200-952e-a099af989e7f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:42.419689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1022/2038] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:42.423749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848b96a-7326-43c7-b923-be136c184ce8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:42.440682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0848b96a-7326-43c7-b923-be136c184ce8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:42.474859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709a21-f8bb-46ac-9176-ca887d3c1539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:42.474859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709a21-f8bb-46ac-9176-ca887d3c1539 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.474859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709a21-f8bb-46ac-9176-ca887d3c1539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.474859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac709a21-f8bb-46ac-9176-ca887d3c1539 admin admin] PATH_INFO: `/v3/projects/a516263eade046b5b572403dafc993fc/users/7370d45b4cdf43cc907b555434b93cc9/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.487498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac709a21-f8bb-46ac-9176-ca887d3c1539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a516263eade046b5b572403dafc993fc, user_id=7370d45b4cdf43cc907b555434b93cc9, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:42.490908 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac709a21-f8bb-46ac-9176-ca887d3c1539 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:42.603555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1017/2039] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:42 2022] PUT /identity/v3/projects/a516263eade046b5b572403dafc993fc/users/7370d45b4cdf43cc907b555434b93cc9/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:42.616705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92146f2-0e4c-414c-85f5-7cabee1b0870 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.616998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92146f2-0e4c-414c-85f5-7cabee1b0870 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.617273 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92146f2-0e4c-414c-85f5-7cabee1b0870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.688171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-d92146f2-0e4c-414c-85f5-7cabee1b0870 None None] MFA Rules not processed for user `7370d45b4cdf43cc907b555434b93cc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:42.690283 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d92146f2-0e4c-414c-85f5-7cabee1b0870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:42.780471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:42.806799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1023/2040] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:42.811335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709a21-f8bb-46ac-9176-ca887d3c1539 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:42.933817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac709a21-f8bb-46ac-9176-ca887d3c1539 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:42.942334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0a80e-195d-4115-9cef-3577baad1dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:42.943386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0a80e-195d-4115-9cef-3577baad1dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:42.943877 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0a80e-195d-4115-9cef-3577baad1dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:42.944364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0a80e-195d-4115-9cef-3577baad1dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:42.945551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0a80e-195d-4115-9cef-3577baad1dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:42.949049 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0a80e-195d-4115-9cef-3577baad1dcf admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:43.089251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1018/2041] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:42 2022] POST /identity/v3/projects => generated 381 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:43.093784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92146f2-0e4c-414c-85f5-7cabee1b0870 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:43.109543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92146f2-0e4c-414c-85f5-7cabee1b0870 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:43.234818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09c04b-d8e4-43d9-a8e2-30b402c6301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:43.235944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c04b-d8e4-43d9-a8e2-30b402c6301e admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:43.236483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c04b-d8e4-43d9-a8e2-30b402c6301e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:43.237005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c04b-d8e4-43d9-a8e2-30b402c6301e admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:43.238308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09c04b-d8e4-43d9-a8e2-30b402c6301e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:43.242220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09c04b-d8e4-43d9-a8e2-30b402c6301e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:43.379569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1024/2042] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:43 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:43.380832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0a80e-195d-4115-9cef-3577baad1dcf admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:43.400980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0a80e-195d-4115-9cef-3577baad1dcf admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:43.411552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a726af-63a4-4aff-a7cd-52f18600ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:43.412724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a726af-63a4-4aff-a7cd-52f18600ee2c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:43.413265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a726af-63a4-4aff-a7cd-52f18600ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:43.413747 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a726af-63a4-4aff-a7cd-52f18600ee2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:43.415137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a726af-63a4-4aff-a7cd-52f18600ee2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:43.418255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a726af-63a4-4aff-a7cd-52f18600ee2c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:43.460751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1019/2043] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:43.466188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09c04b-d8e4-43d9-a8e2-30b402c6301e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:43.486562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09c04b-d8e4-43d9-a8e2-30b402c6301e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:43.496418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970dcd-a593-461b-8aca-b18a160f8283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:43.497532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970dcd-a593-461b-8aca-b18a160f8283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:43.498022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970dcd-a593-461b-8aca-b18a160f8283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:43.498591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46970dcd-a593-461b-8aca-b18a160f8283 admin admin] PATH_INFO: `/v3/projects/8a7e845e76a14fa18fd5ac8b386d6416/users/9e5088e4f5e84484bbc1caa879a2cf81/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:43.528827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46970dcd-a593-461b-8aca-b18a160f8283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7e845e76a14fa18fd5ac8b386d6416, user_id=9e5088e4f5e84484bbc1caa879a2cf81, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:43.532006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46970dcd-a593-461b-8aca-b18a160f8283 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:43.622880 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1025/2044] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:43 2022] PUT /identity/v3/projects/8a7e845e76a14fa18fd5ac8b386d6416/users/9e5088e4f5e84484bbc1caa879a2cf81/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:43.635036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a726af-63a4-4aff-a7cd-52f18600ee2c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:43.651882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a726af-63a4-4aff-a7cd-52f18600ee2c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:43.789002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054893df-ecc9-406a-a03a-1bdd18306ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:43.796023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054893df-ecc9-406a-a03a-1bdd18306ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:43.796023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054893df-ecc9-406a-a03a-1bdd18306ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:43.796023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054893df-ecc9-406a-a03a-1bdd18306ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:43.796023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054893df-ecc9-406a-a03a-1bdd18306ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:43.796023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054893df-ecc9-406a-a03a-1bdd18306ae1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:43.810846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1020/2045] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:43.818328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970dcd-a593-461b-8aca-b18a160f8283 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:43.830307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46970dcd-a593-461b-8aca-b18a160f8283 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:43.862050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d33e2-ec23-4d4b-8e0b-23363c1b9e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:43.863030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d33e2-ec23-4d4b-8e0b-23363c1b9e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:43.864043 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d33e2-ec23-4d4b-8e0b-23363c1b9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:43.864441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d33e2-ec23-4d4b-8e0b-23363c1b9e46 admin admin] PATH_INFO: `/v3/projects/8a7e845e76a14fa18fd5ac8b386d6416/users/9e5088e4f5e84484bbc1caa879a2cf81/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:43.869524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d33e2-ec23-4d4b-8e0b-23363c1b9e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7e845e76a14fa18fd5ac8b386d6416, user_id=9e5088e4f5e84484bbc1caa879a2cf81, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:43.879271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d33e2-ec23-4d4b-8e0b-23363c1b9e46 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:43.896326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1026/2046] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:43 2022] PUT /identity/v3/projects/8a7e845e76a14fa18fd5ac8b386d6416/users/9e5088e4f5e84484bbc1caa879a2cf81/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:37:43.908245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45e0a2-458c-464e-8ff2-3185f01b8721 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:43.917293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45e0a2-458c-464e-8ff2-3185f01b8721 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:43.917293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45e0a2-458c-464e-8ff2-3185f01b8721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:43.986963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ae45e0a2-458c-464e-8ff2-3185f01b8721 None None] MFA Rules not processed for user `9e5088e4f5e84484bbc1caa879a2cf81`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:43.989539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ae45e0a2-458c-464e-8ff2-3185f01b8721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:44.092777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a237a-9807-451c-a074-caa52ed5827f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:44.092777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a237a-9807-451c-a074-caa52ed5827f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:44.092777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a237a-9807-451c-a074-caa52ed5827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:44.134720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-390a237a-9807-451c-a074-caa52ed5827f None None] MFA Rules not processed for user `aab3db3757f24ffd9f2e0ab397bbf20d`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:44.136002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-390a237a-9807-451c-a074-caa52ed5827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:44.141774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1021/2047] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:44.154764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45e0a2-458c-464e-8ff2-3185f01b8721 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:44.156472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ae45e0a2-458c-464e-8ff2-3185f01b8721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:44.231444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45e0a2-458c-464e-8ff2-3185f01b8721 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:44.236637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9c2da-ac22-4ef4-86e7-8a9f4cbc0af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:44.237418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c2da-ac22-4ef4-86e7-8a9f4cbc0af7 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:44.238042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c2da-ac22-4ef4-86e7-8a9f4cbc0af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:44.241566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9c2da-ac22-4ef4-86e7-8a9f4cbc0af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:44.241753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1027/2048] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:44.251891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9c2da-ac22-4ef4-86e7-8a9f4cbc0af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:44.253378 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9c2da-ac22-4ef4-86e7-8a9f4cbc0af7 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:44.257299 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a237a-9807-451c-a074-caa52ed5827f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:44.259180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-390a237a-9807-451c-a074-caa52ed5827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:44.264695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1022/2049] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:44.291785 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a237a-9807-451c-a074-caa52ed5827f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:44.299073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358cc2b-ba67-4031-945d-de8d68532743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:44.300049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358cc2b-ba67-4031-945d-de8d68532743 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:44.300815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358cc2b-ba67-4031-945d-de8d68532743 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:44.301188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358cc2b-ba67-4031-945d-de8d68532743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:44.316755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358cc2b-ba67-4031-945d-de8d68532743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:44.319647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358cc2b-ba67-4031-945d-de8d68532743 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:44.336825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1028/2050] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:44.349338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:44.663946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:45.457586 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:45.891685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9c2da-ac22-4ef4-86e7-8a9f4cbc0af7 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:45.906563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9c2da-ac22-4ef4-86e7-8a9f4cbc0af7 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:45.912182 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec98d01-5907-4150-9321-c5ab2a3292ac tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5088e4f5e84484bbc1caa879a2cf81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a7e845e76a14fa18fd5ac8b386d6416', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:45.913097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec98d01-5907-4150-9321-c5ab2a3292ac tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:45.913387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec98d01-5907-4150-9321-c5ab2a3292ac tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:45.913662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec98d01-5907-4150-9321-c5ab2a3292ac tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:45.914372 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec98d01-5907-4150-9321-c5ab2a3292ac tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:45.914683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec98d01-5907-4150-9321-c5ab2a3292ac tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:45.916488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec98d01-5907-4150-9321-c5ab2a3292ac tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:45.930523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1023/2051] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:45.935687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358cc2b-ba67-4031-945d-de8d68532743 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:45.951534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358cc2b-ba67-4031-945d-de8d68532743 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:45.959740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c029162-adf6-4cab-8a58-043191becbb3 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5088e4f5e84484bbc1caa879a2cf81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a7e845e76a14fa18fd5ac8b386d6416', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:45.960646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c029162-adf6-4cab-8a58-043191becbb3 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:45.961129 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c029162-adf6-4cab-8a58-043191becbb3 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:45.961815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c029162-adf6-4cab-8a58-043191becbb3 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:45.963024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c029162-adf6-4cab-8a58-043191becbb3 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:45.968021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c029162-adf6-4cab-8a58-043191becbb3 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:46.162735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1029/2052] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:45 2022] POST /identity/v3/projects => generated 352 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:46.167288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec98d01-5907-4150-9321-c5ab2a3292ac tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:46.180823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec98d01-5907-4150-9321-c5ab2a3292ac tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:46.255617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c543bd7-04ff-43b7-b507-783958b626ab tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5088e4f5e84484bbc1caa879a2cf81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a7e845e76a14fa18fd5ac8b386d6416', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:46.256389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c543bd7-04ff-43b7-b507-783958b626ab tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:46.256774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c543bd7-04ff-43b7-b507-783958b626ab tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:46.257579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c543bd7-04ff-43b7-b507-783958b626ab tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:46.258074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c543bd7-04ff-43b7-b507-783958b626ab tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:46.258495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c543bd7-04ff-43b7-b507-783958b626ab tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:46.260812 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c543bd7-04ff-43b7-b507-783958b626ab tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:46.276358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1024/2053] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:46.285354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:46.321750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c029162-adf6-4cab-8a58-043191becbb3 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:46.333384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c029162-adf6-4cab-8a58-043191becbb3 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:46.338309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e5088e4f5e84484bbc1caa879a2cf81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a7e845e76a14fa18fd5ac8b386d6416', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:46.338964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:46.339248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:46.339525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] PATH_INFO: `/v3/projects/398941a922224669a8bb033908788e19` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:46.340792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: Authorizing `identity:delete_project(project_id=398941a922224669a8bb033908788e19)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:46.342790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:46.529578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398941a922224669a8bb033908788e19', 'request_id': 'req-661d7b67-e457-4b69-bba4-ce6412632ca1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:46.537460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398941a922224669a8bb033908788e19', 'request_id': 'req-661d7b67-e457-4b69-bba4-ce6412632ca1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:46.563045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527e19b-b0ef-401b-bee4-b555a0f1d7e2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:46.563726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527e19b-b0ef-401b-bee4-b555a0f1d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:46.563726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527e19b-b0ef-401b-bee4-b555a0f1d7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:46.586500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0527e19b-b0ef-401b-bee4-b555a0f1d7e2 None None] MFA Rules not processed for user `aab3db3757f24ffd9f2e0ab397bbf20d`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:46.587709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0527e19b-b0ef-401b-bee4-b555a0f1d7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:46.661595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1025/2054] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:46.682439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398941a922224669a8bb033908788e19', 'request_id': 'req-661d7b67-e457-4b69-bba4-ce6412632ca1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:46.701839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] The token cache is being invalidate because project 398941a922224669a8bb033908788e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:46.714232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:46.714232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-661d7b67-e457-4b69-bba4-ce6412632ca1 tempest-VolumeQuotaClassesTest-1524713379 tempest-VolumeQuotaClassesTest-1524713379-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:46.714232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1030/2055] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:46 2022] DELETE /identity/v3/projects/398941a922224669a8bb033908788e19 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:47.559018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:47.571148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527e19b-b0ef-401b-bee4-b555a0f1d7e2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:47.741136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527e19b-b0ef-401b-bee4-b555a0f1d7e2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:47.747526 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:47.748712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:47.749162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:47.749603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] PATH_INFO: `/v3/users/7370d45b4cdf43cc907b555434b93cc9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:47.752745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7370d45b4cdf43cc907b555434b93cc9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:47.757263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:48.006766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7370d45b4cdf43cc907b555434b93cc9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:48.025379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7370d45b4cdf43cc907b555434b93cc9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:48.026689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7370d45b4cdf43cc907b555434b93cc9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:48.130289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7370d45b4cdf43cc907b555434b93cc9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:48.132342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7370d45b4cdf43cc907b555434b93cc9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:48.171740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1026/2056] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:47 2022] DELETE /identity/v3/users/7370d45b4cdf43cc907b555434b93cc9 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:48.178452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6712f-3287-4ec8-a634-bc261260e1fa None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:48.179142 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6712f-3287-4ec8-a634-bc261260e1fa None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:48.179142 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6712f-3287-4ec8-a634-bc261260e1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:48.203174 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-83f6712f-3287-4ec8-a634-bc261260e1fa None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:48.204508 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-83f6712f-3287-4ec8-a634-bc261260e1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:48.270012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1031/2057] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:48.281183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:48.282831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:48.380175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ffeb6-b690-45be-aa9f-f2d13d37c8e8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:48.385403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc0a5-7d15-4c68-aa7b-fd9b4dad49a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:48.386170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc0a5-7d15-4c68-aa7b-fd9b4dad49a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:48.386511 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc0a5-7d15-4c68-aa7b-fd9b4dad49a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:48.386904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fc0a5-7d15-4c68-aa7b-fd9b4dad49a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:48.399536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fc0a5-7d15-4c68-aa7b-fd9b4dad49a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:48.401066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fc0a5-7d15-4c68-aa7b-fd9b4dad49a8 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:48.413612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1027/2058] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:37:49.234443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6712f-3287-4ec8-a634-bc261260e1fa None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:49.236697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-83f6712f-3287-4ec8-a634-bc261260e1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:49.253181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6712f-3287-4ec8-a634-bc261260e1fa None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:49.279820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:49.282435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:49.283269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:49.284148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] PATH_INFO: `/v3/projects/a516263eade046b5b572403dafc993fc` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:49.288028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a516263eade046b5b572403dafc993fc)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:49.293565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:49.440818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a516263eade046b5b572403dafc993fc', 'request_id': 'req-9f3eec59-f605-42ff-936a-9db50d8b6a35'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:49.449370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a516263eade046b5b572403dafc993fc', 'request_id': 'req-9f3eec59-f605-42ff-936a-9db50d8b6a35'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:49.548958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a516263eade046b5b572403dafc993fc', 'request_id': 'req-9f3eec59-f605-42ff-936a-9db50d8b6a35'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:49.562678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] The token cache is being invalidate because project a516263eade046b5b572403dafc993fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:49.562981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:49.563632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9f3eec59-f605-42ff-936a-9db50d8b6a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:49.565170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1032/2059] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:49 2022] DELETE /identity/v3/projects/a516263eade046b5b572403dafc993fc => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:49.569731 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc0a5-7d15-4c68-aa7b-fd9b4dad49a8 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:49.583908 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fc0a5-7d15-4c68-aa7b-fd9b4dad49a8 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:49.680560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954c0f0-4422-46c3-9df6-0b64ccfef9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:49.682161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954c0f0-4422-46c3-9df6-0b64ccfef9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:49.682921 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954c0f0-4422-46c3-9df6-0b64ccfef9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:49.683692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954c0f0-4422-46c3-9df6-0b64ccfef9df admin admin] PATH_INFO: `/v3/users/9e5088e4f5e84484bbc1caa879a2cf81` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:49.685865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954c0f0-4422-46c3-9df6-0b64ccfef9df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5088e4f5e84484bbc1caa879a2cf81)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:49.689343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954c0f0-4422-46c3-9df6-0b64ccfef9df admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:49.921021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b4794-8333-40ad-ae5f-18f8996a1dfc None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:49.921319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b4794-8333-40ad-ae5f-18f8996a1dfc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:49.921571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b4794-8333-40ad-ae5f-18f8996a1dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:49.950190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-fd4b4794-8333-40ad-ae5f-18f8996a1dfc None None] MFA Rules not processed for user `b1628c4903b34a219d19e01bf73e0b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:49.950190 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fd4b4794-8333-40ad-ae5f-18f8996a1dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:50.032483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1033/2060] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:50.039030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7954c0f0-4422-46c3-9df6-0b64ccfef9df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5088e4f5e84484bbc1caa879a2cf81'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:50.048053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7954c0f0-4422-46c3-9df6-0b64ccfef9df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5088e4f5e84484bbc1caa879a2cf81'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:50.048053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7954c0f0-4422-46c3-9df6-0b64ccfef9df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5088e4f5e84484bbc1caa879a2cf81'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:50.165016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7954c0f0-4422-46c3-9df6-0b64ccfef9df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5088e4f5e84484bbc1caa879a2cf81'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:50.165771 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7954c0f0-4422-46c3-9df6-0b64ccfef9df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5088e4f5e84484bbc1caa879a2cf81'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:50.200900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1028/2061] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:37:49 2022] DELETE /identity/v3/users/9e5088e4f5e84484bbc1caa879a2cf81 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:50.316148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:50.906677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b4794-8333-40ad-ae5f-18f8996a1dfc None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:50.908973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fd4b4794-8333-40ad-ae5f-18f8996a1dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:50.953741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b4794-8333-40ad-ae5f-18f8996a1dfc None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:51.123219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:51.123619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:51.123953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:51.128313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] PATH_INFO: `/v3/projects/8a7e845e76a14fa18fd5ac8b386d6416` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:51.131183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a7e845e76a14fa18fd5ac8b386d6416)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:51.137011 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:51.318211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a7e845e76a14fa18fd5ac8b386d6416', 'request_id': 'req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:51.327556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a7e845e76a14fa18fd5ac8b386d6416', 'request_id': 'req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:51.436829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a7e845e76a14fa18fd5ac8b386d6416', 'request_id': 'req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:51.494819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] The token cache is being invalidate because project 8a7e845e76a14fa18fd5ac8b386d6416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:37:51.495354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:51.496976 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a6f748c6-5d9f-4b80-a993-9c3ed4c33cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:37:51.507684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1034/2062] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:37:50 2022] DELETE /identity/v3/projects/8a7e845e76a14fa18fd5ac8b386d6416 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:51.511166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da972-1409-4b0f-b53b-34af31f97cbb None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:51.511987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da972-1409-4b0f-b53b-34af31f97cbb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:51.512404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4da972-1409-4b0f-b53b-34af31f97cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:51.557661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0d4da972-1409-4b0f-b53b-34af31f97cbb None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:51.557661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0d4da972-1409-4b0f-b53b-34af31f97cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:51.628220 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:51.662610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1029/2063] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:37:51.670138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62430484-0cdd-49ec-9700-a79719088e95 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:51.670430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62430484-0cdd-49ec-9700-a79719088e95 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:51.670695 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62430484-0cdd-49ec-9700-a79719088e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:51.700359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-62430484-0cdd-49ec-9700-a79719088e95 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:51.702478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-62430484-0cdd-49ec-9700-a79719088e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:51.715651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1035/2064] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:51.721288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4da972-1409-4b0f-b53b-34af31f97cbb None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:51.739730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4da972-1409-4b0f-b53b-34af31f97cbb None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:51.758250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d0d6f-f6f7-4f67-93ff-42e6c52e8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:51.759630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d0d6f-f6f7-4f67-93ff-42e6c52e8198 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:51.760418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d0d6f-f6f7-4f67-93ff-42e6c52e8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:51.761062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d0d6f-f6f7-4f67-93ff-42e6c52e8198 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:51.768445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d0d6f-f6f7-4f67-93ff-42e6c52e8198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:37:51.768926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d0d6f-f6f7-4f67-93ff-42e6c52e8198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:51.772029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d0d6f-f6f7-4f67-93ff-42e6c52e8198 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:51.790130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1030/2065] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:37:51.797632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62430484-0cdd-49ec-9700-a79719088e95 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:51.815226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62430484-0cdd-49ec-9700-a79719088e95 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:51.822878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25c12f-0f2a-4a3e-9fa5-4622c656b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:51.823658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25c12f-0f2a-4a3e-9fa5-4622c656b740 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:51.824184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25c12f-0f2a-4a3e-9fa5-4622c656b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:51.824583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25c12f-0f2a-4a3e-9fa5-4622c656b740 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:51.826064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25c12f-0f2a-4a3e-9fa5-4622c656b740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:51.829945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25c12f-0f2a-4a3e-9fa5-4622c656b740 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:52.018861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1036/2066] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:51 2022] POST /identity/v3/projects => generated 369 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:52.024847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d0d6f-f6f7-4f67-93ff-42e6c52e8198 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:52.038300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d0d6f-f6f7-4f67-93ff-42e6c52e8198 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:52.121130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d87472-b037-45ae-8051-9b3a766c057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:52.122175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d87472-b037-45ae-8051-9b3a766c057b admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:52.122460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d87472-b037-45ae-8051-9b3a766c057b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:52.124451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d87472-b037-45ae-8051-9b3a766c057b admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:52.124451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d87472-b037-45ae-8051-9b3a766c057b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:52.126767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d87472-b037-45ae-8051-9b3a766c057b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:52.252855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1031/2067] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:52 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:52.255282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25c12f-0f2a-4a3e-9fa5-4622c656b740 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:52.299516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25c12f-0f2a-4a3e-9fa5-4622c656b740 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:52.310318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa6c0a-15a0-47ed-a634-db0fcc943a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:52.311352 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa6c0a-15a0-47ed-a634-db0fcc943a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:52.311797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa6c0a-15a0-47ed-a634-db0fcc943a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:52.312298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa6c0a-15a0-47ed-a634-db0fcc943a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:52.313414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa6c0a-15a0-47ed-a634-db0fcc943a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:52.316224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa6c0a-15a0-47ed-a634-db0fcc943a4e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:52.350127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1037/2068] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:52.351128 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d87472-b037-45ae-8051-9b3a766c057b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:52.372941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d87472-b037-45ae-8051-9b3a766c057b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:52.380125 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5a001-6115-4f43-9623-1285302251e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:52.380903 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5a001-6115-4f43-9623-1285302251e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:52.381198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5a001-6115-4f43-9623-1285302251e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:52.381468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5a001-6115-4f43-9623-1285302251e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:52.382197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5a001-6115-4f43-9623-1285302251e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:52.383969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5a001-6115-4f43-9623-1285302251e4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:52.396771 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1032/2069] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:52.402084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa6c0a-15a0-47ed-a634-db0fcc943a4e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:52.416027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa6c0a-15a0-47ed-a634-db0fcc943a4e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:52.422310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777e605-4e68-46b3-9e7c-9aadfd4a754a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:52.423014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777e605-4e68-46b3-9e7c-9aadfd4a754a admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:52.423276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777e605-4e68-46b3-9e7c-9aadfd4a754a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:52.423546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777e605-4e68-46b3-9e7c-9aadfd4a754a admin admin] PATH_INFO: `/v3/projects/084d3b343b1a435e9449c8a91eaf605c/users/2771cecf4f3342759999dbf1b66d77d6/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:52.459850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777e605-4e68-46b3-9e7c-9aadfd4a754a admin admin] RBAC: Authorizing `identity:create_grant(project_id=084d3b343b1a435e9449c8a91eaf605c, user_id=2771cecf4f3342759999dbf1b66d77d6, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:52.465559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777e605-4e68-46b3-9e7c-9aadfd4a754a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:52.573056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1038/2070] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:52 2022] PUT /identity/v3/projects/084d3b343b1a435e9449c8a91eaf605c/users/2771cecf4f3342759999dbf1b66d77d6/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:52.581361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42eb56-d641-4d44-a459-1c0a4d435bff None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:52.584192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42eb56-d641-4d44-a459-1c0a4d435bff None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:52.584871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42eb56-d641-4d44-a459-1c0a4d435bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:52.636140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6d42eb56-d641-4d44-a459-1c0a4d435bff None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:52.641307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6d42eb56-d641-4d44-a459-1c0a4d435bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:52.785306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1033/2071] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:52.795268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777e605-4e68-46b3-9e7c-9aadfd4a754a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:52.797033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5777e605-4e68-46b3-9e7c-9aadfd4a754a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:52.914490 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777e605-4e68-46b3-9e7c-9aadfd4a754a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:52.919955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701597ac-3302-4b69-86fb-3dcbfa5cb799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:52.920955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701597ac-3302-4b69-86fb-3dcbfa5cb799 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:52.921381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701597ac-3302-4b69-86fb-3dcbfa5cb799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:52.922277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701597ac-3302-4b69-86fb-3dcbfa5cb799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:52.937637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701597ac-3302-4b69-86fb-3dcbfa5cb799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:52.939410 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701597ac-3302-4b69-86fb-3dcbfa5cb799 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:52.951639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1039/2072] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:53.412651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:54.814788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:55.226543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d900-34cb-411b-8143-cda0f80bab02 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:55.227129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d900-34cb-411b-8143-cda0f80bab02 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:55.227578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18d900-34cb-411b-8143-cda0f80bab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:55.299066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-8a18d900-34cb-411b-8143-cda0f80bab02 None None] MFA Rules not processed for user `2771cecf4f3342759999dbf1b66d77d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:55.301338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8a18d900-34cb-411b-8143-cda0f80bab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:55.511318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1034/2073] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:55.518361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701597ac-3302-4b69-86fb-3dcbfa5cb799 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:55.530890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701597ac-3302-4b69-86fb-3dcbfa5cb799 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:55.538722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2c658-8252-453a-bfef-fa9d80e76095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:55.539440 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2c658-8252-453a-bfef-fa9d80e76095 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:55.539838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2c658-8252-453a-bfef-fa9d80e76095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:55.540261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2c658-8252-453a-bfef-fa9d80e76095 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:55.540945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2c658-8252-453a-bfef-fa9d80e76095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:55.543158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2c658-8252-453a-bfef-fa9d80e76095 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:55.828450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1040/2074] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:37:55 2022] POST /identity/v3/projects => generated 373 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:37:55.833868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18d900-34cb-411b-8143-cda0f80bab02 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:55.849958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18d900-34cb-411b-8143-cda0f80bab02 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:55.947773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418859fa-f342-40b3-8ff3-777916839103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:55.948839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418859fa-f342-40b3-8ff3-777916839103 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:55.949275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418859fa-f342-40b3-8ff3-777916839103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:55.949698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418859fa-f342-40b3-8ff3-777916839103 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:55.950807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418859fa-f342-40b3-8ff3-777916839103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:55.955720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418859fa-f342-40b3-8ff3-777916839103 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:56.117921 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1035/2075] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:37:55 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:37:56.118979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2c658-8252-453a-bfef-fa9d80e76095 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:56.138872 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2c658-8252-453a-bfef-fa9d80e76095 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:56.162715 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103302d-a63f-4d97-aadd-3412011ae0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:56.165972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103302d-a63f-4d97-aadd-3412011ae0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:56.165972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103302d-a63f-4d97-aadd-3412011ae0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:56.165972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103302d-a63f-4d97-aadd-3412011ae0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:56.165972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103302d-a63f-4d97-aadd-3412011ae0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:56.166725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103302d-a63f-4d97-aadd-3412011ae0c0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:56.193118 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1041/2076] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:37:56.198573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418859fa-f342-40b3-8ff3-777916839103 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:56.212093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418859fa-f342-40b3-8ff3-777916839103 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:56.228606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ec002-b484-4c96-a8c3-6496c6f4cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:56.230999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ec002-b484-4c96-a8c3-6496c6f4cc79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:56.230999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ec002-b484-4c96-a8c3-6496c6f4cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:56.230999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ec002-b484-4c96-a8c3-6496c6f4cc79 admin admin] PATH_INFO: `/v3/projects/4f059cac958a40f7b6341db66b5833d5/users/c376ca7cc8a0417b858687feff53329a/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:56.248805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ec002-b484-4c96-a8c3-6496c6f4cc79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f059cac958a40f7b6341db66b5833d5, user_id=c376ca7cc8a0417b858687feff53329a, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:56.253440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ec002-b484-4c96-a8c3-6496c6f4cc79 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:56.380316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1036/2077] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:56 2022] PUT /identity/v3/projects/4f059cac958a40f7b6341db66b5833d5/users/c376ca7cc8a0417b858687feff53329a/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:56.384017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103302d-a63f-4d97-aadd-3412011ae0c0 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:56.403838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103302d-a63f-4d97-aadd-3412011ae0c0 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:56.492280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fd619-f7c4-4115-a2d8-a31433851544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:56.492541 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fd619-f7c4-4115-a2d8-a31433851544 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:56.492996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fd619-f7c4-4115-a2d8-a31433851544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:56.493339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fd619-f7c4-4115-a2d8-a31433851544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:56.494090 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fd619-f7c4-4115-a2d8-a31433851544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:56.495822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fd619-f7c4-4115-a2d8-a31433851544 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:56.518328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1042/2078] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:37:56.522970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ec002-b484-4c96-a8c3-6496c6f4cc79 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:56.537854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ec002-b484-4c96-a8c3-6496c6f4cc79 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:56.547695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa037cf9-2228-46a7-9064-46dbdb7b6351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:56.556433 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa037cf9-2228-46a7-9064-46dbdb7b6351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:56.556433 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa037cf9-2228-46a7-9064-46dbdb7b6351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:56.556433 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa037cf9-2228-46a7-9064-46dbdb7b6351 admin admin] PATH_INFO: `/v3/projects/4f059cac958a40f7b6341db66b5833d5/users/c376ca7cc8a0417b858687feff53329a/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:56.556433 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa037cf9-2228-46a7-9064-46dbdb7b6351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f059cac958a40f7b6341db66b5833d5, user_id=c376ca7cc8a0417b858687feff53329a, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:56.558741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa037cf9-2228-46a7-9064-46dbdb7b6351 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:56.583925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1037/2079] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:37:56 2022] PUT /identity/v3/projects/4f059cac958a40f7b6341db66b5833d5/users/c376ca7cc8a0417b858687feff53329a/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:37:57.034721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:57.342480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:58.452233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f286182-4544-4e14-b918-f5b55671ee13 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:58.452233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f286182-4544-4e14-b918-f5b55671ee13 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:58.452233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f286182-4544-4e14-b918-f5b55671ee13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:58.496718 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6f286182-4544-4e14-b918-f5b55671ee13 None None] MFA Rules not processed for user `c376ca7cc8a0417b858687feff53329a`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:58.498912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6f286182-4544-4e14-b918-f5b55671ee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:58.590750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1043/2080] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:58.605947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f1c5f-036f-4aca-90b3-49c025479801 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:58.606601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f1c5f-036f-4aca-90b3-49c025479801 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:58.607038 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f1c5f-036f-4aca-90b3-49c025479801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:58.634067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-262f1c5f-036f-4aca-90b3-49c025479801 None None] MFA Rules not processed for user `2771cecf4f3342759999dbf1b66d77d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:37:58.635675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-262f1c5f-036f-4aca-90b3-49c025479801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:58.718792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1038/2081] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:37:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:37:58.730320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f286182-4544-4e14-b918-f5b55671ee13 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:37:58.731795 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6f286182-4544-4e14-b918-f5b55671ee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:37:58.826975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f286182-4544-4e14-b918-f5b55671ee13 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:37:58.834158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99e11c-0dff-44ef-acc0-96bddf69334c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:37:58.834785 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e11c-0dff-44ef-acc0-96bddf69334c service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:37:58.835069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e11c-0dff-44ef-acc0-96bddf69334c service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:37:58.835338 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99e11c-0dff-44ef-acc0-96bddf69334c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:37:58.849151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99e11c-0dff-44ef-acc0-96bddf69334c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:37:58.851056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99e11c-0dff-44ef-acc0-96bddf69334c service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:37:58.856494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:58.862739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1044/2082] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:37:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:37:58.987171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:01.313491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:02.020054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:04.534230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d0a9a-e9c5-4fbb-b5ef-c67a57360800 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:04.535646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d0a9a-e9c5-4fbb-b5ef-c67a57360800 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:04.535646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d0a9a-e9c5-4fbb-b5ef-c67a57360800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:04.565776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3b2d0a9a-e9c5-4fbb-b5ef-c67a57360800 None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:04.567528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3b2d0a9a-e9c5-4fbb-b5ef-c67a57360800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:04.639927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1039/2083] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:38:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:04.699863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99e11c-0dff-44ef-acc0-96bddf69334c service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:04.702060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2a99e11c-0dff-44ef-acc0-96bddf69334c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:04.798964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99e11c-0dff-44ef-acc0-96bddf69334c service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:04.805636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8911f7a-4709-4bd6-a3dd-1f4bc3d1ac8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:04.806298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8911f7a-4709-4bd6-a3dd-1f4bc3d1ac8a service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:04.806581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8911f7a-4709-4bd6-a3dd-1f4bc3d1ac8a service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:04.806843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8911f7a-4709-4bd6-a3dd-1f4bc3d1ac8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:04.828451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8911f7a-4709-4bd6-a3dd-1f4bc3d1ac8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:04.831264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8911f7a-4709-4bd6-a3dd-1f4bc3d1ac8a service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:04.844124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1045/2084] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:38:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:38:07.794213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:08.085838 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:09.302379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1d2a3-990d-4e5f-befc-3ef402fb6210 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:09.303063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1d2a3-990d-4e5f-befc-3ef402fb6210 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:09.303063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1d2a3-990d-4e5f-befc-3ef402fb6210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:09.341747 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b3d1d2a3-990d-4e5f-befc-3ef402fb6210 None None] MFA Rules not processed for user `67ceab80e8744b478ec9cb93e1b56f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:09.343935 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b3d1d2a3-990d-4e5f-befc-3ef402fb6210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:09.439534 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1040/2085] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:38:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:10.091901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4792f7-0bc1-480b-bc75-7c7756bfa53b None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:10.092881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4792f7-0bc1-480b-bc75-7c7756bfa53b None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:10.093337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4792f7-0bc1-480b-bc75-7c7756bfa53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:10.155026 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9b4792f7-0bc1-480b-bc75-7c7756bfa53b None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:10.156575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9b4792f7-0bc1-480b-bc75-7c7756bfa53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:10.183940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1046/2086] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:38:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:10.220405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1d2a3-990d-4e5f-befc-3ef402fb6210 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:10.241236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1d2a3-990d-4e5f-befc-3ef402fb6210 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:10.261711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811f3bf-6b2f-4e0a-a5d9-8357e6b194cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:10.264198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811f3bf-6b2f-4e0a-a5d9-8357e6b194cf service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:10.265157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811f3bf-6b2f-4e0a-a5d9-8357e6b194cf service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:10.265394 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811f3bf-6b2f-4e0a-a5d9-8357e6b194cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:10.279616 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811f3bf-6b2f-4e0a-a5d9-8357e6b194cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:10.281230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811f3bf-6b2f-4e0a-a5d9-8357e6b194cf service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:10.297240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1041/2087] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:38:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:38:13.595041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:16.988867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:17.686050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:20.080047 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:21.959766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:23.627623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:25.915769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:26.479584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:27.216969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4792f7-0bc1-480b-bc75-7c7756bfa53b None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:27.218420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9b4792f7-0bc1-480b-bc75-7c7756bfa53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:27.304143 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4792f7-0bc1-480b-bc75-7c7756bfa53b None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:27.308943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f31d4b-f7be-4a12-8ea2-b83613bdbb70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:27.309626 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31d4b-f7be-4a12-8ea2-b83613bdbb70 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:27.310049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31d4b-f7be-4a12-8ea2-b83613bdbb70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:27.310510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31d4b-f7be-4a12-8ea2-b83613bdbb70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:27.314385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:27.327864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f31d4b-f7be-4a12-8ea2-b83613bdbb70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:27.327864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f31d4b-f7be-4a12-8ea2-b83613bdbb70 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:27.341073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1047/2088] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:27.348633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:27.770326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:28.490332 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:28.816714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:29.541287 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:30.111653 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:30.730264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:31.931688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:35.785279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71951-5e10-4095-8e02-927f3a93f226 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:35.785868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71951-5e10-4095-8e02-927f3a93f226 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:35.786174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b71951-5e10-4095-8e02-927f3a93f226 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:35.788033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1042/2089] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 1 16:38:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:35.802532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602df31-31a1-484c-92e1-7d6189880c33 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:35.803483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602df31-31a1-484c-92e1-7d6189880c33 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:35.803922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602df31-31a1-484c-92e1-7d6189880c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:35.827750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2602df31-31a1-484c-92e1-7d6189880c33 None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:35.829283 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2602df31-31a1-484c-92e1-7d6189880c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:35.841601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1048/2090] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 1 16:38:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:39.388348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=73 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:39.920282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b71951-5e10-4095-8e02-927f3a93f226 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:39.922303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-43b71951-5e10-4095-8e02-927f3a93f226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:40.025615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b71951-5e10-4095-8e02-927f3a93f226 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:40.029413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bdeef-7579-4879-86c1-598c435eebd3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a16e6246fb4693b044bf939bce8244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:40.030106 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bdeef-7579-4879-86c1-598c435eebd3 service glance] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:40.030386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bdeef-7579-4879-86c1-598c435eebd3 service glance] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:40.030656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bdeef-7579-4879-86c1-598c435eebd3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:40.041518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bdeef-7579-4879-86c1-598c435eebd3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:40.043126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bdeef-7579-4879-86c1-598c435eebd3 service glance] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:40.062207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1043/2091] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:40.480799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db4d25-469b-40c4-955c-9b05df5950d4 None None] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:40.481368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db4d25-469b-40c4-955c-9b05df5950d4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:40.481368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db4d25-469b-40c4-955c-9b05df5950d4 None None] PATH_INFO: `/` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:40.482657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1049/2092] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 1 16:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:40.488697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6257af-fb19-4bbe-89c2-bc500f475648 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:40.489204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6257af-fb19-4bbe-89c2-bc500f475648 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:40.489398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6257af-fb19-4bbe-89c2-bc500f475648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:40.512191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fe6257af-fb19-4bbe-89c2-bc500f475648 None None] MFA Rules not processed for user `02432d1312a34273813856362cada1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:40.516556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fe6257af-fb19-4bbe-89c2-bc500f475648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:40.577961 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1044/2093] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 1 16:38:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:40.590532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db4d25-469b-40c4-955c-9b05df5950d4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:40.592385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-75db4d25-469b-40c4-955c-9b05df5950d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:40.607466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db4d25-469b-40c4-955c-9b05df5950d4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:40.611301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03754237-8308-4d9f-a83b-c03430882848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:40.612499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03754237-8308-4d9f-a83b-c03430882848 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:40.613213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03754237-8308-4d9f-a83b-c03430882848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:40.613213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03754237-8308-4d9f-a83b-c03430882848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:40.621565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03754237-8308-4d9f-a83b-c03430882848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:40.623056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03754237-8308-4d9f-a83b-c03430882848 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:40.634676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1050/2094] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:40.735832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37109c-97cb-4902-9e61-cb8b4168b5c8 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:40.736041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37109c-97cb-4902-9e61-cb8b4168b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:40.736352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37109c-97cb-4902-9e61-cb8b4168b5c8 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:40.738699 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1045/2095] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 1 16:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:40.746001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd063b2-7309-4ebe-b86b-df73b208ac8f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:40.746441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd063b2-7309-4ebe-b86b-df73b208ac8f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:40.746899 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd063b2-7309-4ebe-b86b-df73b208ac8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:40.775667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-0fd063b2-7309-4ebe-b86b-df73b208ac8f None None] MFA Rules not processed for user `060b6347b13b4f67bf47169f5668b205`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:40.777036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0fd063b2-7309-4ebe-b86b-df73b208ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:40.788125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1051/2096] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 1 16:38:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:40.803485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37109c-97cb-4902-9e61-cb8b4168b5c8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:40.817814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37109c-97cb-4902-9e61-cb8b4168b5c8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:40.822112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4151f-3907-44de-8927-403c6113449b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:40.824721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4151f-3907-44de-8927-403c6113449b service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:40.824721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4151f-3907-44de-8927-403c6113449b service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:40.824721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4151f-3907-44de-8927-403c6113449b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:40.835805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4151f-3907-44de-8927-403c6113449b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:40.838688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4151f-3907-44de-8927-403c6113449b service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:40.855248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1046/2097] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:41.009119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd063b2-7309-4ebe-b86b-df73b208ac8f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:41.012097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0fd063b2-7309-4ebe-b86b-df73b208ac8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:41.098581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd063b2-7309-4ebe-b86b-df73b208ac8f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:41.106383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bf8a8-fcec-461d-94b9-58d1bbf1a572 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d15478ca864f49aae2301e2328fe23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:41.107008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bf8a8-fcec-461d-94b9-58d1bbf1a572 service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:41.107471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bf8a8-fcec-461d-94b9-58d1bbf1a572 service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:41.108205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bf8a8-fcec-461d-94b9-58d1bbf1a572 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:41.111608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-821bf8a8-fcec-461d-94b9-58d1bbf1a572 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:41.120190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08860d94-5bb6-483e-9681-d738b689c1d5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:41.120190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08860d94-5bb6-483e-9681-d738b689c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:41.120190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08860d94-5bb6-483e-9681-d738b689c1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:41.130149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bf8a8-fcec-461d-94b9-58d1bbf1a572 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:41.134646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bf8a8-fcec-461d-94b9-58d1bbf1a572 service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:41.141338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-08860d94-5bb6-483e-9681-d738b689c1d5 None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:41.142586 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-08860d94-5bb6-483e-9681-d738b689c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:41.147373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1052/2098] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:41.151367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1047/2099] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 1 16:38:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:38:41.174620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bf8a8-fcec-461d-94b9-58d1bbf1a572 service placement] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:41.178281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bf8a8-fcec-461d-94b9-58d1bbf1a572 service placement] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:41.183605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825ed47-b486-4577-b975-2e732f85af5b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:41.184509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ed47-b486-4577-b975-2e732f85af5b service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:41.184885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ed47-b486-4577-b975-2e732f85af5b service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:41.185260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825ed47-b486-4577-b975-2e732f85af5b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:41.194924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825ed47-b486-4577-b975-2e732f85af5b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:41.196588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825ed47-b486-4577-b975-2e732f85af5b service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:41.206409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1053/2100] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:38:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:38:46.085117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83820e-bdef-4485-9d48-578810d2186c None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:46.085641 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83820e-bdef-4485-9d48-578810d2186c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:46.085841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83820e-bdef-4485-9d48-578810d2186c None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:46.087239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1048/2101] 10.222.0.15 () {54 vars in 921 bytes} [Thu Sep 1 16:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:46.099489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975e3c8-02b6-4c40-aef7-e07ad88c6f13 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:46.100108 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975e3c8-02b6-4c40-aef7-e07ad88c6f13 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:46.100202 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975e3c8-02b6-4c40-aef7-e07ad88c6f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:46.123222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b975e3c8-02b6-4c40-aef7-e07ad88c6f13 None None] MFA Rules not processed for user `61d15478ca864f49aae2301e2328fe23`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:46.124429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b975e3c8-02b6-4c40-aef7-e07ad88c6f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:46.133780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1054/2102] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Sep 1 16:38:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:46.150414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deef0a-ea91-4a91-ac2a-68439db57639 None None] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:46.150648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deef0a-ea91-4a91-ac2a-68439db57639 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:46.150847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deef0a-ea91-4a91-ac2a-68439db57639 None None] PATH_INFO: `/` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:46.152168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1049/2103] 10.222.0.15 () {54 vars in 961 bytes} [Thu Sep 1 16:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 16:38:46.158396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c36b2a-f4fe-4992-a836-22c3baf15535 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:46.159557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c36b2a-f4fe-4992-a836-22c3baf15535 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:46.159996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c36b2a-f4fe-4992-a836-22c3baf15535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:46.192625 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-24c36b2a-f4fe-4992-a836-22c3baf15535 None None] MFA Rules not processed for user `61d15478ca864f49aae2301e2328fe23`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:46.194634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-24c36b2a-f4fe-4992-a836-22c3baf15535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:46.204556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1055/2104] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Sep 1 16:38:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:46.212800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deef0a-ea91-4a91-ac2a-68439db57639 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:46.227189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deef0a-ea91-4a91-ac2a-68439db57639 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:46.232538 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69cad1-74b2-4e76-9355-b6c5e8447a45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d15478ca864f49aae2301e2328fe23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:46.233139 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69cad1-74b2-4e76-9355-b6c5e8447a45 service placement] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:46.233419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69cad1-74b2-4e76-9355-b6c5e8447a45 service placement] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:46.233704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69cad1-74b2-4e76-9355-b6c5e8447a45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:46.243590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69cad1-74b2-4e76-9355-b6c5e8447a45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:46.245143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69cad1-74b2-4e76-9355-b6c5e8447a45 service placement] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:46.266171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c36b2a-f4fe-4992-a836-22c3baf15535 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:46.266171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-24c36b2a-f4fe-4992-a836-22c3baf15535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:46.287363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1050/2105] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:46.324586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:46.396326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c36b2a-f4fe-4992-a836-22c3baf15535 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:46.402734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:46.403543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:46.403883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:46.404222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] PATH_INFO: `/v3/users/cc98fc52cf0f4e83ab8369221a6ba551` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:46.405548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc98fc52cf0f4e83ab8369221a6ba551)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:46.407788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:46.813261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc98fc52cf0f4e83ab8369221a6ba551'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:46.821585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc98fc52cf0f4e83ab8369221a6ba551'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:46.822320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc98fc52cf0f4e83ab8369221a6ba551'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:47.009296 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc98fc52cf0f4e83ab8369221a6ba551'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:47.024649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc98fc52cf0f4e83ab8369221a6ba551'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:47.030989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1056/2106] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:38:46 2022] DELETE /identity/v3/users/cc98fc52cf0f4e83ab8369221a6ba551 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:38:47.272948 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c4ca-ede6-422c-acd3-847f58baab40 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:47.273389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c4ca-ede6-422c-acd3-847f58baab40 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:47.273545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04c4ca-ede6-422c-acd3-847f58baab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:47.294519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-cf04c4ca-ede6-422c-acd3-847f58baab40 None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:47.295727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cf04c4ca-ede6-422c-acd3-847f58baab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:47.357478 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1051/2107] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:38:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:47.375158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:47.377248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:47.434981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04c4ca-ede6-422c-acd3-847f58baab40 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:47.437211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cf04c4ca-ede6-422c-acd3-847f58baab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:47.446499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:47.458842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b99e07-a70f-4938-b0a0-93b561302250 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:47.466275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42812c55-c3e5-441f-9991-46a1a8499073 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:47.466972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42812c55-c3e5-441f-9991-46a1a8499073 service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:47.467371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42812c55-c3e5-441f-9991-46a1a8499073 service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:47.468006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42812c55-c3e5-441f-9991-46a1a8499073 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:47.480241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42812c55-c3e5-441f-9991-46a1a8499073 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:47.482365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42812c55-c3e5-441f-9991-46a1a8499073 service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:47.492909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1057/2108] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:38:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:38:47.522160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04c4ca-ede6-422c-acd3-847f58baab40 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:47.527362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:47.528043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:47.528293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:47.528563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] PATH_INFO: `/v3/projects/323d6612105e4b6cb1a78c0a5c910b46` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:47.529763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=323d6612105e4b6cb1a78c0a5c910b46)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:47.531697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:47.755466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323d6612105e4b6cb1a78c0a5c910b46', 'request_id': 'req-e26b24f4-feee-4a72-ba13-7676c46ff96d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:47.767089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323d6612105e4b6cb1a78c0a5c910b46', 'request_id': 'req-e26b24f4-feee-4a72-ba13-7676c46ff96d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:47.778307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323d6612105e4b6cb1a78c0a5c910b46', 'request_id': 'req-e26b24f4-feee-4a72-ba13-7676c46ff96d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:47.919599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] The token cache is being invalidate because project 323d6612105e4b6cb1a78c0a5c910b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:38:47.919996 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:47.920878 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e26b24f4-feee-4a72-ba13-7676c46ff96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:47.923411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1052/2109] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:38:47 2022] DELETE /identity/v3/projects/323d6612105e4b6cb1a78c0a5c910b46 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:38:47.929518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541d8fb-7431-45e9-b6bd-6817c6a8c9d6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:47.930435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541d8fb-7431-45e9-b6bd-6817c6a8c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:47.930830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541d8fb-7431-45e9-b6bd-6817c6a8c9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:47.959084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e541d8fb-7431-45e9-b6bd-6817c6a8c9d6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:47.961157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e541d8fb-7431-45e9-b6bd-6817c6a8c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:47.996465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:48.062088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1058/2110] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:48.071074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cfec5-f418-46d2-a958-7edc2312c832 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:48.071361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cfec5-f418-46d2-a958-7edc2312c832 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:48.071934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cfec5-f418-46d2-a958-7edc2312c832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:48.100993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-249cfec5-f418-46d2-a958-7edc2312c832 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:48.105105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-249cfec5-f418-46d2-a958-7edc2312c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:48.116578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1053/2111] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:48.121065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541d8fb-7431-45e9-b6bd-6817c6a8c9d6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:48.134226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541d8fb-7431-45e9-b6bd-6817c6a8c9d6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:48.139464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e6593-ad78-43a8-a96b-f8d2ac116848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:48.140085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6593-ad78-43a8-a96b-f8d2ac116848 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:48.140385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6593-ad78-43a8-a96b-f8d2ac116848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:48.140627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e6593-ad78-43a8-a96b-f8d2ac116848 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:48.141280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e6593-ad78-43a8-a96b-f8d2ac116848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:38:48.141577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e6593-ad78-43a8-a96b-f8d2ac116848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:48.144078 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e6593-ad78-43a8-a96b-f8d2ac116848 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:48.167847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1059/2112] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:38:48.172335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cfec5-f418-46d2-a958-7edc2312c832 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:48.186585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249cfec5-f418-46d2-a958-7edc2312c832 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:48.197636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643fcd6-da62-41e6-91ee-e47c7254ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:48.198827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643fcd6-da62-41e6-91ee-e47c7254ad49 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:48.203677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643fcd6-da62-41e6-91ee-e47c7254ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:48.203677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643fcd6-da62-41e6-91ee-e47c7254ad49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:48.203677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643fcd6-da62-41e6-91ee-e47c7254ad49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:48.203677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643fcd6-da62-41e6-91ee-e47c7254ad49 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:48.302023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1054/2113] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:38:48 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:38:48.308435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e6593-ad78-43a8-a96b-f8d2ac116848 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:48.326750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e6593-ad78-43a8-a96b-f8d2ac116848 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:48.397303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528e27-2619-4742-af3a-515a76b6c5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:48.398108 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528e27-2619-4742-af3a-515a76b6c5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:48.398493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528e27-2619-4742-af3a-515a76b6c5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:48.406226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528e27-2619-4742-af3a-515a76b6c5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:48.407747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d528e27-2619-4742-af3a-515a76b6c5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:48.411247 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d528e27-2619-4742-af3a-515a76b6c5e8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:48.567159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1060/2114] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:38:48 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:38:48.573845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643fcd6-da62-41e6-91ee-e47c7254ad49 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:48.585516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643fcd6-da62-41e6-91ee-e47c7254ad49 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:48.594315 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6fe15-17d2-4321-9b6b-db266ea7f60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:48.599957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6fe15-17d2-4321-9b6b-db266ea7f60e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:48.599957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6fe15-17d2-4321-9b6b-db266ea7f60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:48.599957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6fe15-17d2-4321-9b6b-db266ea7f60e admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:48.599957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6fe15-17d2-4321-9b6b-db266ea7f60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:48.599957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6fe15-17d2-4321-9b6b-db266ea7f60e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:48.610517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1055/2115] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:38:48.615188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528e27-2619-4742-af3a-515a76b6c5e8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:48.626752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528e27-2619-4742-af3a-515a76b6c5e8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:48.633346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e6e4e-139a-4c2c-8a9f-903333195567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:48.637789 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e6e4e-139a-4c2c-8a9f-903333195567 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:48.638097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e6e4e-139a-4c2c-8a9f-903333195567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:48.638371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e6e4e-139a-4c2c-8a9f-903333195567 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:48.639038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e6e4e-139a-4c2c-8a9f-903333195567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:48.640643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e6e4e-139a-4c2c-8a9f-903333195567 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:48.655650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1061/2116] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:38:48.658230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6fe15-17d2-4321-9b6b-db266ea7f60e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:48.671461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6fe15-17d2-4321-9b6b-db266ea7f60e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:48.676939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d776e3e-b3f6-4f70-a7e1-5c9c90f57cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:48.677773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d776e3e-b3f6-4f70-a7e1-5c9c90f57cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:48.678150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d776e3e-b3f6-4f70-a7e1-5c9c90f57cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:48.678433 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d776e3e-b3f6-4f70-a7e1-5c9c90f57cd6 admin admin] PATH_INFO: `/v3/projects/03713da44c414420a770099b9c613c96/users/6be440a73a9848fd92b73ca1fcb6bcec/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:48.697551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d776e3e-b3f6-4f70-a7e1-5c9c90f57cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03713da44c414420a770099b9c613c96, user_id=6be440a73a9848fd92b73ca1fcb6bcec, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:48.705707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d776e3e-b3f6-4f70-a7e1-5c9c90f57cd6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:48.798474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1056/2117] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:38:48 2022] PUT /identity/v3/projects/03713da44c414420a770099b9c613c96/users/6be440a73a9848fd92b73ca1fcb6bcec/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:38:48.809559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef337d5-85aa-437f-805a-e3924f62a357 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:48.810020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef337d5-85aa-437f-805a-e3924f62a357 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:48.810131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef337d5-85aa-437f-805a-e3924f62a357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:48.840798 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-3ef337d5-85aa-437f-805a-e3924f62a357 None None] MFA Rules not processed for user `6be440a73a9848fd92b73ca1fcb6bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:48.842089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3ef337d5-85aa-437f-805a-e3924f62a357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:48.942988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1062/2118] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:38:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:48.951191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d776e3e-b3f6-4f70-a7e1-5c9c90f57cd6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:48.953069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5d776e3e-b3f6-4f70-a7e1-5c9c90f57cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:48.996177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:49.025179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d776e3e-b3f6-4f70-a7e1-5c9c90f57cd6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:49.032218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9732b9a-04e8-47ba-8e34-ab3b804aa566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:49.032860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732b9a-04e8-47ba-8e34-ab3b804aa566 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:49.033139 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732b9a-04e8-47ba-8e34-ab3b804aa566 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:49.034050 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732b9a-04e8-47ba-8e34-ab3b804aa566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:49.044074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9732b9a-04e8-47ba-8e34-ab3b804aa566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:49.046365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9732b9a-04e8-47ba-8e34-ab3b804aa566 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:49.057969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1057/2119] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:52.820180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef337d5-85aa-437f-805a-e3924f62a357 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:52.872434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:52.952449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef337d5-85aa-437f-805a-e3924f62a357 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:52.961221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:52.962561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:52.966036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:52.966036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] PATH_INFO: `/v3/users/6be440a73a9848fd92b73ca1fcb6bcec` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:52.966036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be440a73a9848fd92b73ca1fcb6bcec)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:52.969123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:53.203810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be440a73a9848fd92b73ca1fcb6bcec'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:53.212114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be440a73a9848fd92b73ca1fcb6bcec'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:53.212847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be440a73a9848fd92b73ca1fcb6bcec'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:53.284280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be440a73a9848fd92b73ca1fcb6bcec'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:53.300708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be440a73a9848fd92b73ca1fcb6bcec'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:53.307886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1063/2120] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:38:52 2022] DELETE /identity/v3/users/6be440a73a9848fd92b73ca1fcb6bcec => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:38:53.312736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeedef-8220-4332-b7d8-08ca0886e5d8 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:53.313277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeedef-8220-4332-b7d8-08ca0886e5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:53.313474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aeedef-8220-4332-b7d8-08ca0886e5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:53.335397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-54aeedef-8220-4332-b7d8-08ca0886e5d8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:53.336545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-54aeedef-8220-4332-b7d8-08ca0886e5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:53.402291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1058/2121] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:53.412952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:53.414443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:53.494683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729010c0-f84d-4aba-9aac-d3a92fe20842 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:53.498347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97cb056-76c8-4f4a-9b75-21ec96ccd593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:53.498954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb056-76c8-4f4a-9b75-21ec96ccd593 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:53.499258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb056-76c8-4f4a-9b75-21ec96ccd593 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:53.499532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97cb056-76c8-4f4a-9b75-21ec96ccd593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:53.510513 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb056-76c8-4f4a-9b75-21ec96ccd593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:53.511978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97cb056-76c8-4f4a-9b75-21ec96ccd593 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:53.526223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1064/2122] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:38:54.143996 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aeedef-8220-4332-b7d8-08ca0886e5d8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:54.145972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-54aeedef-8220-4332-b7d8-08ca0886e5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:54.161113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aeedef-8220-4332-b7d8-08ca0886e5d8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:54.172205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:54.173084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:54.173463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:54.173961 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] PATH_INFO: `/v3/projects/03713da44c414420a770099b9c613c96` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:54.176111 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] RBAC: Authorizing `identity:delete_project(project_id=03713da44c414420a770099b9c613c96)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:54.178333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:54.411237 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03713da44c414420a770099b9c613c96', 'request_id': 'req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:54.422970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03713da44c414420a770099b9c613c96', 'request_id': 'req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:54.429553 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03713da44c414420a770099b9c613c96', 'request_id': 'req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:54.568683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] The token cache is being invalidate because project 03713da44c414420a770099b9c613c96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:38:54.568995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:54.569615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2d9eac49-d8aa-4c07-9c75-0ded60c2349c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:38:54.571160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1059/2123] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:38:54 2022] DELETE /identity/v3/projects/03713da44c414420a770099b9c613c96 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:38:54.576122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332deb6-fe8d-478b-9279-0612d4983b37 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:54.576633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332deb6-fe8d-478b-9279-0612d4983b37 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:54.576728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332deb6-fe8d-478b-9279-0612d4983b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:54.599314 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7332deb6-fe8d-478b-9279-0612d4983b37 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:54.600555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7332deb6-fe8d-478b-9279-0612d4983b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:54.645262 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:54.669480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1065/2124] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:54.678455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effcc17-5b58-4180-8a98-650629ce78cd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:54.679158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effcc17-5b58-4180-8a98-650629ce78cd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:54.679158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effcc17-5b58-4180-8a98-650629ce78cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:54.708036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1effcc17-5b58-4180-8a98-650629ce78cd None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:54.709248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1effcc17-5b58-4180-8a98-650629ce78cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:54.717169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1060/2125] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:54.722543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332deb6-fe8d-478b-9279-0612d4983b37 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:54.733279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332deb6-fe8d-478b-9279-0612d4983b37 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:54.739489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4acfd5-3840-4198-98b9-6898cd992a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:54.740103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4acfd5-3840-4198-98b9-6898cd992a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:54.740382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4acfd5-3840-4198-98b9-6898cd992a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:54.740651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4acfd5-3840-4198-98b9-6898cd992a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:54.741304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4acfd5-3840-4198-98b9-6898cd992a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:38:54.741604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4acfd5-3840-4198-98b9-6898cd992a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:54.743445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4acfd5-3840-4198-98b9-6898cd992a1f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:54.761507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effcc17-5b58-4180-8a98-650629ce78cd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:54.765765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1066/2126] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:38:54.773911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effcc17-5b58-4180-8a98-650629ce78cd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:54.781749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93d3f7-c8b6-44cc-8cbe-8817be9e062c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:54.784779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93d3f7-c8b6-44cc-8cbe-8817be9e062c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:54.785355 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93d3f7-c8b6-44cc-8cbe-8817be9e062c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:54.785870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93d3f7-c8b6-44cc-8cbe-8817be9e062c admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:54.787186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93d3f7-c8b6-44cc-8cbe-8817be9e062c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:54.790200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93d3f7-c8b6-44cc-8cbe-8817be9e062c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:54.926895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1061/2127] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:38:54 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:38:54.931450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4acfd5-3840-4198-98b9-6898cd992a1f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:54.945280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4acfd5-3840-4198-98b9-6898cd992a1f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:55.018442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f75016-6a98-41e0-8616-d5082d87b0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:55.018677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75016-6a98-41e0-8616-d5082d87b0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:55.018904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75016-6a98-41e0-8616-d5082d87b0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:55.019167 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f75016-6a98-41e0-8616-d5082d87b0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:55.019939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f75016-6a98-41e0-8616-d5082d87b0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:55.023903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f75016-6a98-41e0-8616-d5082d87b0d5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:55.250527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1067/2128] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:38:54 2022] POST /identity/v3/users => generated 282 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:38:55.254977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93d3f7-c8b6-44cc-8cbe-8817be9e062c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:55.266751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93d3f7-c8b6-44cc-8cbe-8817be9e062c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:55.273899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a30f3-b555-4271-bd71-f2709632aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:55.274545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a30f3-b555-4271-bd71-f2709632aa42 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:55.274825 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a30f3-b555-4271-bd71-f2709632aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:55.275182 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a30f3-b555-4271-bd71-f2709632aa42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:55.275740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a30f3-b555-4271-bd71-f2709632aa42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:55.277418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a30f3-b555-4271-bd71-f2709632aa42 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:55.290834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1062/2129] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:38:55.295070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f75016-6a98-41e0-8616-d5082d87b0d5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:55.319624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f75016-6a98-41e0-8616-d5082d87b0d5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:55.325228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57178c3-c778-46c2-b167-813ef1fe41ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:55.325861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57178c3-c778-46c2-b167-813ef1fe41ca admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:55.326529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57178c3-c778-46c2-b167-813ef1fe41ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:55.326791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57178c3-c778-46c2-b167-813ef1fe41ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:55.327494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57178c3-c778-46c2-b167-813ef1fe41ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:55.329108 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57178c3-c778-46c2-b167-813ef1fe41ca admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:55.342353 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1068/2130] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:38:55.349082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a30f3-b555-4271-bd71-f2709632aa42 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:55.367179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a30f3-b555-4271-bd71-f2709632aa42 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:55.372229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de8ddc-2836-4221-ad60-e7e4806be68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:55.372903 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8ddc-2836-4221-ad60-e7e4806be68d admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:55.373240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8ddc-2836-4221-ad60-e7e4806be68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:55.373518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de8ddc-2836-4221-ad60-e7e4806be68d admin admin] PATH_INFO: `/v3/projects/0bdfad7195cc415bbb84a7398a45ce95/users/69fc8bf6292a4f8c8f654bc37a2d6baa/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:55.396487 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de8ddc-2836-4221-ad60-e7e4806be68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdfad7195cc415bbb84a7398a45ce95, user_id=69fc8bf6292a4f8c8f654bc37a2d6baa, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:55.399495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de8ddc-2836-4221-ad60-e7e4806be68d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:55.402201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:55.542799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1063/2131] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:38:55 2022] PUT /identity/v3/projects/0bdfad7195cc415bbb84a7398a45ce95/users/69fc8bf6292a4f8c8f654bc37a2d6baa/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:38:55.560438 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033c33f-0d4a-48b0-8979-caed3efe73a0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:55.560727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033c33f-0d4a-48b0-8979-caed3efe73a0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:55.560971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033c33f-0d4a-48b0-8979-caed3efe73a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:55.607625 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-a033c33f-0d4a-48b0-8979-caed3efe73a0 None None] MFA Rules not processed for user `69fc8bf6292a4f8c8f654bc37a2d6baa`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:38:55.608867 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a033c33f-0d4a-48b0-8979-caed3efe73a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:55.698732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1069/2132] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:38:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:38:55.711595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de8ddc-2836-4221-ad60-e7e4806be68d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:38:55.713320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c0de8ddc-2836-4221-ad60-e7e4806be68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:38:55.785682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de8ddc-2836-4221-ad60-e7e4806be68d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:38:55.791213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d546887-b335-4f4e-9f07-d5e7ca900536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:38:55.791863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d546887-b335-4f4e-9f07-d5e7ca900536 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:38:55.792127 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d546887-b335-4f4e-9f07-d5e7ca900536 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:38:55.792398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d546887-b335-4f4e-9f07-d5e7ca900536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:38:55.802828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d546887-b335-4f4e-9f07-d5e7ca900536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:38:55.804275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d546887-b335-4f4e-9f07-d5e7ca900536 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:38:55.819681 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1064/2133] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:38:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:01.744554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033c33f-0d4a-48b0-8979-caed3efe73a0 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:01.746101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a033c33f-0d4a-48b0-8979-caed3efe73a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:01.791907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:01.821453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033c33f-0d4a-48b0-8979-caed3efe73a0 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:01.831522 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:01.831718 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:01.831967 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:01.832236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] PATH_INFO: `/v3/users/2771cecf4f3342759999dbf1b66d77d6` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:01.833551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2771cecf4f3342759999dbf1b66d77d6)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:01.835382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:02.244726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2771cecf4f3342759999dbf1b66d77d6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:02.252677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2771cecf4f3342759999dbf1b66d77d6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:02.253467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2771cecf4f3342759999dbf1b66d77d6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:02.478023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2771cecf4f3342759999dbf1b66d77d6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:02.491313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2771cecf4f3342759999dbf1b66d77d6'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:02.497820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1070/2134] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:01 2022] DELETE /identity/v3/users/2771cecf4f3342759999dbf1b66d77d6 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:39:02.810947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d546887-b335-4f4e-9f07-d5e7ca900536 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:02.823453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d546887-b335-4f4e-9f07-d5e7ca900536 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:02.885826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:02.886495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:02.886773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:02.887069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] PATH_INFO: `/v3/projects/084d3b343b1a435e9449c8a91eaf605c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:02.888335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=084d3b343b1a435e9449c8a91eaf605c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:02.890279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:03.027386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084d3b343b1a435e9449c8a91eaf605c', 'request_id': 'req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:03.034463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084d3b343b1a435e9449c8a91eaf605c', 'request_id': 'req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:03.040721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084d3b343b1a435e9449c8a91eaf605c', 'request_id': 'req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:03.146809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] The token cache is being invalidate because project 084d3b343b1a435e9449c8a91eaf605c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:03.147102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:03.147742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:03.149412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1065/2135] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:02 2022] DELETE /identity/v3/projects/084d3b343b1a435e9449c8a91eaf605c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:03.153740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:03.155422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:03.170000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d0d7d-56e1-46ab-939b-894ce658261d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:03.237126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366168d1-be78-4a95-920a-670f737c8c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:03.237623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366168d1-be78-4a95-920a-670f737c8c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:03.238110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366168d1-be78-4a95-920a-670f737c8c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:03.238386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366168d1-be78-4a95-920a-670f737c8c37 admin admin] PATH_INFO: `/v3/users/c376ca7cc8a0417b858687feff53329a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:03.239590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366168d1-be78-4a95-920a-670f737c8c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c376ca7cc8a0417b858687feff53329a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:03.241561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366168d1-be78-4a95-920a-670f737c8c37 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:03.453079 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-366168d1-be78-4a95-920a-670f737c8c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c376ca7cc8a0417b858687feff53329a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:03.461576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-366168d1-be78-4a95-920a-670f737c8c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c376ca7cc8a0417b858687feff53329a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:03.462316 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-366168d1-be78-4a95-920a-670f737c8c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c376ca7cc8a0417b858687feff53329a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:03.465020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:03.558781 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-366168d1-be78-4a95-920a-670f737c8c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c376ca7cc8a0417b858687feff53329a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:03.574285 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-366168d1-be78-4a95-920a-670f737c8c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c376ca7cc8a0417b858687feff53329a'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:03.581243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1071/2136] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:03 2022] DELETE /identity/v3/users/c376ca7cc8a0417b858687feff53329a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:03.891369 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:03.892847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:03.907373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8f9be-7ac4-418d-94d9-7d9d5ef7f2c8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:03.951689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:03.986872 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:03.987724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:03.988018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:03.988296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] PATH_INFO: `/v3/projects/4f059cac958a40f7b6341db66b5833d5` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:03.989496 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f059cac958a40f7b6341db66b5833d5)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:03.991521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:04.113813 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f059cac958a40f7b6341db66b5833d5', 'request_id': 'req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:04.120071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f059cac958a40f7b6341db66b5833d5', 'request_id': 'req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:04.125641 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f059cac958a40f7b6341db66b5833d5', 'request_id': 'req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:04.233099 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] The token cache is being invalidate because project 4f059cac958a40f7b6341db66b5833d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:04.233317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:04.233977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-24ca0cc2-ae0d-4adb-8bce-9ed8473a0bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:04.235490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1066/2137] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:03 2022] DELETE /identity/v3/projects/4f059cac958a40f7b6341db66b5833d5 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:04.241586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f78b7e-c76c-4054-8a74-418186bc0f0c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:04.246841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f78b7e-c76c-4054-8a74-418186bc0f0c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:04.246841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f78b7e-c76c-4054-8a74-418186bc0f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:04.266297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-84f78b7e-c76c-4054-8a74-418186bc0f0c None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:04.267559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-84f78b7e-c76c-4054-8a74-418186bc0f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:04.332437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1072/2138] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:04.340274 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397a17c-17f8-403b-a70e-940af66d84bf None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:04.340631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397a17c-17f8-403b-a70e-940af66d84bf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:04.340972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397a17c-17f8-403b-a70e-940af66d84bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:04.361412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b397a17c-17f8-403b-a70e-940af66d84bf None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:04.363251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b397a17c-17f8-403b-a70e-940af66d84bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:04.371355 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1067/2139] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:04.375931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f78b7e-c76c-4054-8a74-418186bc0f0c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:04.387346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f78b7e-c76c-4054-8a74-418186bc0f0c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:04.392066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51169e62-1090-45b6-99aa-084d2de905f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:04.392678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51169e62-1090-45b6-99aa-084d2de905f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:04.392953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51169e62-1090-45b6-99aa-084d2de905f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:04.393248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51169e62-1090-45b6-99aa-084d2de905f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:04.394270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51169e62-1090-45b6-99aa-084d2de905f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:39:04.394270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51169e62-1090-45b6-99aa-084d2de905f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:04.401416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51169e62-1090-45b6-99aa-084d2de905f0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:04.408119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1073/2140] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:39:04.412740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397a17c-17f8-403b-a70e-940af66d84bf None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:04.422087 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397a17c-17f8-403b-a70e-940af66d84bf None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:04.427555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100e3d0-c3be-4c29-8637-c4d22d6e5d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:04.428150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100e3d0-c3be-4c29-8637-c4d22d6e5d93 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:04.428432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100e3d0-c3be-4c29-8637-c4d22d6e5d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:04.428704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100e3d0-c3be-4c29-8637-c4d22d6e5d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:04.429334 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100e3d0-c3be-4c29-8637-c4d22d6e5d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:04.431259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100e3d0-c3be-4c29-8637-c4d22d6e5d93 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:04.556371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1068/2141] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:04 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:04.559556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51169e62-1090-45b6-99aa-084d2de905f0 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:04.570324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51169e62-1090-45b6-99aa-084d2de905f0 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:04.636325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ae6fa-638a-4965-8668-147ab9f12c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:04.637071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ae6fa-638a-4965-8668-147ab9f12c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:04.637412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ae6fa-638a-4965-8668-147ab9f12c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:04.637750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ae6fa-638a-4965-8668-147ab9f12c59 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:04.638498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ae6fa-638a-4965-8668-147ab9f12c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:04.640421 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ae6fa-638a-4965-8668-147ab9f12c59 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:05.931870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1074/2142] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:04 2022] POST /identity/v3/users => generated 292 bytes in 1373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:05.935923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100e3d0-c3be-4c29-8637-c4d22d6e5d93 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:05.947325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100e3d0-c3be-4c29-8637-c4d22d6e5d93 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:05.952119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176e32b-6b9b-4b60-8c9e-9246391c8cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:05.952772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e32b-6b9b-4b60-8c9e-9246391c8cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:05.953052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e32b-6b9b-4b60-8c9e-9246391c8cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:05.953327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176e32b-6b9b-4b60-8c9e-9246391c8cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:05.954086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176e32b-6b9b-4b60-8c9e-9246391c8cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:05.956301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176e32b-6b9b-4b60-8c9e-9246391c8cfe admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:05.967477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1069/2143] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:05.972567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ae6fa-638a-4965-8668-147ab9f12c59 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:05.983117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ae6fa-638a-4965-8668-147ab9f12c59 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:05.989032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657eb37-3236-494c-aef1-baf88c9f7bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:05.989675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657eb37-3236-494c-aef1-baf88c9f7bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:05.990075 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657eb37-3236-494c-aef1-baf88c9f7bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:05.998091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657eb37-3236-494c-aef1-baf88c9f7bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:05.999128 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657eb37-3236-494c-aef1-baf88c9f7bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:06.000771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657eb37-3236-494c-aef1-baf88c9f7bb6 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:06.017195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1075/2144] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:06.019594 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176e32b-6b9b-4b60-8c9e-9246391c8cfe admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:06.031890 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176e32b-6b9b-4b60-8c9e-9246391c8cfe admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:06.037480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ea91c-9a97-4fd1-be29-1751d136bef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:06.038219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea91c-9a97-4fd1-be29-1751d136bef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:06.038504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea91c-9a97-4fd1-be29-1751d136bef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:06.038781 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ea91c-9a97-4fd1-be29-1751d136bef4 admin admin] PATH_INFO: `/v3/projects/d8127fd25565461e844417c61f09d8f6/users/9080b420da8f4cd0a9572b9456b9c2cc/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:06.055279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ea91c-9a97-4fd1-be29-1751d136bef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8127fd25565461e844417c61f09d8f6, user_id=9080b420da8f4cd0a9572b9456b9c2cc, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:06.057944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ea91c-9a97-4fd1-be29-1751d136bef4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:06.209664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1070/2145] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:06 2022] PUT /identity/v3/projects/d8127fd25565461e844417c61f09d8f6/users/9080b420da8f4cd0a9572b9456b9c2cc/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:06.218666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10ee0a-4eac-496e-9255-5c58a50597f2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:06.218956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10ee0a-4eac-496e-9255-5c58a50597f2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:06.219303 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10ee0a-4eac-496e-9255-5c58a50597f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:06.258181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-df10ee0a-4eac-496e-9255-5c58a50597f2 None None] MFA Rules not processed for user `9080b420da8f4cd0a9572b9456b9c2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:06.259571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-df10ee0a-4eac-496e-9255-5c58a50597f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:06.293838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:06.331263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1076/2146] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:06.336649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ea91c-9a97-4fd1-be29-1751d136bef4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:06.398176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:06.411738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ea91c-9a97-4fd1-be29-1751d136bef4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:06.416551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566ecea-fa53-44fa-b38f-70ae8ef47a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:06.417177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566ecea-fa53-44fa-b38f-70ae8ef47a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:06.417452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566ecea-fa53-44fa-b38f-70ae8ef47a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:06.417721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566ecea-fa53-44fa-b38f-70ae8ef47a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:06.418391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566ecea-fa53-44fa-b38f-70ae8ef47a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:06.420338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566ecea-fa53-44fa-b38f-70ae8ef47a22 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:06.534815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1071/2147] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:06 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:06.536140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10ee0a-4eac-496e-9255-5c58a50597f2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:06.548762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10ee0a-4eac-496e-9255-5c58a50597f2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:06.611430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecf0c1-76e7-4d2a-a09c-8a239a84e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:06.616005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecf0c1-76e7-4d2a-a09c-8a239a84e0fa admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:06.616005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecf0c1-76e7-4d2a-a09c-8a239a84e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:06.616005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eecf0c1-76e7-4d2a-a09c-8a239a84e0fa admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:06.616005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecf0c1-76e7-4d2a-a09c-8a239a84e0fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:06.616404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eecf0c1-76e7-4d2a-a09c-8a239a84e0fa admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:06.764238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1077/2148] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:06 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:06.768403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566ecea-fa53-44fa-b38f-70ae8ef47a22 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:06.779052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566ecea-fa53-44fa-b38f-70ae8ef47a22 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:06.784311 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d443d7-1a55-487f-862e-4ca6fa93fb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:06.784983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d443d7-1a55-487f-862e-4ca6fa93fb2e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:06.785206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d443d7-1a55-487f-862e-4ca6fa93fb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:06.785509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d443d7-1a55-487f-862e-4ca6fa93fb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:06.786267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d443d7-1a55-487f-862e-4ca6fa93fb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:06.788651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d443d7-1a55-487f-862e-4ca6fa93fb2e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:06.802815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1072/2149] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:06.811389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecf0c1-76e7-4d2a-a09c-8a239a84e0fa admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:06.823307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eecf0c1-76e7-4d2a-a09c-8a239a84e0fa admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:06.828506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee23be9-4a63-4ae0-9519-2f3e90101873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:06.829173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee23be9-4a63-4ae0-9519-2f3e90101873 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:06.829451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee23be9-4a63-4ae0-9519-2f3e90101873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:06.829726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee23be9-4a63-4ae0-9519-2f3e90101873 admin admin] PATH_INFO: `/v3/projects/2096d306d87749fc9dfa8e8139edda70/users/d526a20c791e4cdc9e08f6b004896b00/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:06.847357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee23be9-4a63-4ae0-9519-2f3e90101873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2096d306d87749fc9dfa8e8139edda70, user_id=d526a20c791e4cdc9e08f6b004896b00, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:06.850707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee23be9-4a63-4ae0-9519-2f3e90101873 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:06.963804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1078/2150] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:06 2022] PUT /identity/v3/projects/2096d306d87749fc9dfa8e8139edda70/users/d526a20c791e4cdc9e08f6b004896b00/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:06.967882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d443d7-1a55-487f-862e-4ca6fa93fb2e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:06.978721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d443d7-1a55-487f-862e-4ca6fa93fb2e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:07.035208 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a923360-8b9b-430a-90d0-5a66bc4fd37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:07.035733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a923360-8b9b-430a-90d0-5a66bc4fd37d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:07.036010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a923360-8b9b-430a-90d0-5a66bc4fd37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:07.036279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a923360-8b9b-430a-90d0-5a66bc4fd37d admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:07.036912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a923360-8b9b-430a-90d0-5a66bc4fd37d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:07.038517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a923360-8b9b-430a-90d0-5a66bc4fd37d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:07.048221 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1073/2151] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:07.053409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee23be9-4a63-4ae0-9519-2f3e90101873 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:07.064682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee23be9-4a63-4ae0-9519-2f3e90101873 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:07.071671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9891c-3f7b-4ad8-b143-58daf4ca3403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:07.072709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9891c-3f7b-4ad8-b143-58daf4ca3403 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:07.072709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9891c-3f7b-4ad8-b143-58daf4ca3403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:07.073018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9891c-3f7b-4ad8-b143-58daf4ca3403 admin admin] PATH_INFO: `/v3/projects/2096d306d87749fc9dfa8e8139edda70/users/d526a20c791e4cdc9e08f6b004896b00/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:07.075054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9891c-3f7b-4ad8-b143-58daf4ca3403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2096d306d87749fc9dfa8e8139edda70, user_id=d526a20c791e4cdc9e08f6b004896b00, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:07.077713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9891c-3f7b-4ad8-b143-58daf4ca3403 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:07.090353 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1079/2152] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:07 2022] PUT /identity/v3/projects/2096d306d87749fc9dfa8e8139edda70/users/d526a20c791e4cdc9e08f6b004896b00/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:07.101423 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d535df6-94f8-40f8-a171-525d07c77097 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:07.101709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d535df6-94f8-40f8-a171-525d07c77097 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:07.102020 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d535df6-94f8-40f8-a171-525d07c77097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:07.195445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6d535df6-94f8-40f8-a171-525d07c77097 None None] MFA Rules not processed for user `d526a20c791e4cdc9e08f6b004896b00`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:07.196653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6d535df6-94f8-40f8-a171-525d07c77097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:07.289058 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1074/2153] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:07.299903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9891c-3f7b-4ad8-b143-58daf4ca3403 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:07.301572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-dff9891c-3f7b-4ad8-b143-58daf4ca3403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:07.361954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9891c-3f7b-4ad8-b143-58daf4ca3403 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:07.366279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf876f2e-aea4-42dd-860b-6f3d91952801 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:07.366888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf876f2e-aea4-42dd-860b-6f3d91952801 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:07.367166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf876f2e-aea4-42dd-860b-6f3d91952801 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:07.367617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf876f2e-aea4-42dd-860b-6f3d91952801 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:07.410450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:07.429363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf876f2e-aea4-42dd-860b-6f3d91952801 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:07.430905 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf876f2e-aea4-42dd-860b-6f3d91952801 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:07.440632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1080/2154] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:09.859036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5726a8-e360-42f6-8878-3ec5c62cd696 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:09.859578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5726a8-e360-42f6-8878-3ec5c62cd696 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:09.859578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5726a8-e360-42f6-8878-3ec5c62cd696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:09.881366 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1e5726a8-e360-42f6-8878-3ec5c62cd696 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:09.882735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1e5726a8-e360-42f6-8878-3ec5c62cd696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:09.931303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:09.954632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1075/2155] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Sep 1 16:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:09.974936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf876f2e-aea4-42dd-860b-6f3d91952801 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:09.977187 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cf876f2e-aea4-42dd-860b-6f3d91952801 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:10.059971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf876f2e-aea4-42dd-860b-6f3d91952801 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:10.066998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6fd99-f8c6-4fbd-8746-74990b2719b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:10.067634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6fd99-f8c6-4fbd-8746-74990b2719b4 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:10.067953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6fd99-f8c6-4fbd-8746-74990b2719b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:10.080607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6fd99-f8c6-4fbd-8746-74990b2719b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:10.080607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6fd99-f8c6-4fbd-8746-74990b2719b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:10.080607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6fd99-f8c6-4fbd-8746-74990b2719b4 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:10.089861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1081/2156] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:11.849338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b3acf-740d-4e34-abaa-f2daf5489384 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:11.849791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b3acf-740d-4e34-abaa-f2daf5489384 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:11.850036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b3acf-740d-4e34-abaa-f2daf5489384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:11.872822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3f6b3acf-740d-4e34-abaa-f2daf5489384 None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:11.874079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3f6b3acf-740d-4e34-abaa-f2daf5489384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:11.943948 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1076/2157] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 1 16:39:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:11.980515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6fd99-f8c6-4fbd-8746-74990b2719b4 service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:11.980515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-47b6fd99-f8c6-4fbd-8746-74990b2719b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:12.046492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6fd99-f8c6-4fbd-8746-74990b2719b4 service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:12.051674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4883d5-91f5-4b85-8511-0d83b9dc8a23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:12.052286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4883d5-91f5-4b85-8511-0d83b9dc8a23 service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:12.052562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4883d5-91f5-4b85-8511-0d83b9dc8a23 service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:12.052830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4883d5-91f5-4b85-8511-0d83b9dc8a23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:12.061463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4883d5-91f5-4b85-8511-0d83b9dc8a23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:12.063114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4883d5-91f5-4b85-8511-0d83b9dc8a23 service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:12.071941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1082/2158] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:39:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:39:13.793025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b3acf-740d-4e34-abaa-f2daf5489384 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:13.802738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b3acf-740d-4e34-abaa-f2daf5489384 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:13.807055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52476b62-a1da-4ec7-a443-4bc9ae9b736a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:13.807692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52476b62-a1da-4ec7-a443-4bc9ae9b736a service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:13.808028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52476b62-a1da-4ec7-a443-4bc9ae9b736a service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:13.809245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52476b62-a1da-4ec7-a443-4bc9ae9b736a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:13.822162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52476b62-a1da-4ec7-a443-4bc9ae9b736a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:13.823603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52476b62-a1da-4ec7-a443-4bc9ae9b736a service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:13.835987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1077/2159] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:17.913072 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5a706-3c54-4ca5-870c-178d3abf61f8 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:17.913589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5a706-3c54-4ca5-870c-178d3abf61f8 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:17.913589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5a706-3c54-4ca5-870c-178d3abf61f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:17.934461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-11d5a706-3c54-4ca5-870c-178d3abf61f8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:17.935651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-11d5a706-3c54-4ca5-870c-178d3abf61f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:17.944030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1083/2160] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Sep 1 16:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:17.974307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52476b62-a1da-4ec7-a443-4bc9ae9b736a service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:17.975753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-52476b62-a1da-4ec7-a443-4bc9ae9b736a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:17.992491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52476b62-a1da-4ec7-a443-4bc9ae9b736a service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:17.998440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91688230-49a0-4445-9988-8ab36cae9b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:17.999051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91688230-49a0-4445-9988-8ab36cae9b20 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:17.999327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91688230-49a0-4445-9988-8ab36cae9b20 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:17.999594 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91688230-49a0-4445-9988-8ab36cae9b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:18.011016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91688230-49a0-4445-9988-8ab36cae9b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:18.012842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91688230-49a0-4445-9988-8ab36cae9b20 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:18.026265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1078/2161] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:20.071822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5a706-3c54-4ca5-870c-178d3abf61f8 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:20.084273 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5a706-3c54-4ca5-870c-178d3abf61f8 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:20.089546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:20.090343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:20.090562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:20.090819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] PATH_INFO: `/v3/users/9080b420da8f4cd0a9572b9456b9c2cc` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:20.092713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9080b420da8f4cd0a9572b9456b9c2cc)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:20.095622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:20.281719 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:20.286791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9080b420da8f4cd0a9572b9456b9c2cc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:20.293774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9080b420da8f4cd0a9572b9456b9c2cc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:20.294520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9080b420da8f4cd0a9572b9456b9c2cc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:20.408984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9080b420da8f4cd0a9572b9456b9c2cc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:20.423384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9080b420da8f4cd0a9572b9456b9c2cc'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:20.431409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1084/2162] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:20 2022] DELETE /identity/v3/users/9080b420da8f4cd0a9572b9456b9c2cc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:20.435751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1ff06-53ec-432c-8f36-c41dcdca2dfe None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:20.441086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1ff06-53ec-432c-8f36-c41dcdca2dfe None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:20.441086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1ff06-53ec-432c-8f36-c41dcdca2dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:20.458201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b8e1ff06-53ec-432c-8f36-c41dcdca2dfe None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:20.459472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b8e1ff06-53ec-432c-8f36-c41dcdca2dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:20.524246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1079/2163] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:20.534425 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:20.535740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:20.595645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afbde0-bbd6-4982-b18a-a5015a25ee44 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:20.599578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bade1-6ed3-44de-a90b-c5a5f1e96503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:20.600184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bade1-6ed3-44de-a90b-c5a5f1e96503 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:20.600459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bade1-6ed3-44de-a90b-c5a5f1e96503 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:20.600721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bade1-6ed3-44de-a90b-c5a5f1e96503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:20.613117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bade1-6ed3-44de-a90b-c5a5f1e96503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:20.614872 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7bade1-6ed3-44de-a90b-c5a5f1e96503 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:20.625512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1085/2164] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:21.055036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1ff06-53ec-432c-8f36-c41dcdca2dfe None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:21.059880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b8e1ff06-53ec-432c-8f36-c41dcdca2dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:21.076050 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1ff06-53ec-432c-8f36-c41dcdca2dfe None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:21.081559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:21.082358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:21.082651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:21.082929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] PATH_INFO: `/v3/projects/d8127fd25565461e844417c61f09d8f6` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:21.084154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8127fd25565461e844417c61f09d8f6)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:21.086105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:21.267414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8127fd25565461e844417c61f09d8f6', 'request_id': 'req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:21.274921 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8127fd25565461e844417c61f09d8f6', 'request_id': 'req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:21.280677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8127fd25565461e844417c61f09d8f6', 'request_id': 'req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:21.282512 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:21.438089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] The token cache is being invalidate because project d8127fd25565461e844417c61f09d8f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:21.438695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:21.439537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:21.441851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1080/2165] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:21 2022] DELETE /identity/v3/projects/d8127fd25565461e844417c61f09d8f6 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:21.448514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bade1-6ed3-44de-a90b-c5a5f1e96503 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:21.456890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7bade1-6ed3-44de-a90b-c5a5f1e96503 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:21.518636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18643f-160e-40bd-acf3-14b3bb888a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:21.519297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18643f-160e-40bd-acf3-14b3bb888a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:21.519561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18643f-160e-40bd-acf3-14b3bb888a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:21.519834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18643f-160e-40bd-acf3-14b3bb888a87 admin admin] PATH_INFO: `/v3/users/d526a20c791e4cdc9e08f6b004896b00` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:21.520988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18643f-160e-40bd-acf3-14b3bb888a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d526a20c791e4cdc9e08f6b004896b00)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:21.522959 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18643f-160e-40bd-acf3-14b3bb888a87 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:21.834409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0f18643f-160e-40bd-acf3-14b3bb888a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd526a20c791e4cdc9e08f6b004896b00'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:21.841336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0f18643f-160e-40bd-acf3-14b3bb888a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd526a20c791e4cdc9e08f6b004896b00'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:21.842031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0f18643f-160e-40bd-acf3-14b3bb888a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd526a20c791e4cdc9e08f6b004896b00'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:21.958014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0f18643f-160e-40bd-acf3-14b3bb888a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd526a20c791e4cdc9e08f6b004896b00'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:21.959641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:21.983745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0f18643f-160e-40bd-acf3-14b3bb888a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd526a20c791e4cdc9e08f6b004896b00'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:21.995744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1086/2166] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:21 2022] DELETE /identity/v3/users/d526a20c791e4cdc9e08f6b004896b00 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:22.662964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:22.664444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:22.678269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2276a6-9f40-4d24-9b02-a2ba2e09c55e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:22.744642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:22.745312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:22.745593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:22.745865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] PATH_INFO: `/v3/projects/2096d306d87749fc9dfa8e8139edda70` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:22.747220 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2096d306d87749fc9dfa8e8139edda70)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:22.750340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:22.911586 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2096d306d87749fc9dfa8e8139edda70', 'request_id': 'req-77a1137b-352e-42bd-872e-602f79270995'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:22.918184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2096d306d87749fc9dfa8e8139edda70', 'request_id': 'req-77a1137b-352e-42bd-872e-602f79270995'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:22.927581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2096d306d87749fc9dfa8e8139edda70', 'request_id': 'req-77a1137b-352e-42bd-872e-602f79270995'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:23.058469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] The token cache is being invalidate because project 2096d306d87749fc9dfa8e8139edda70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:23.058797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:23.059535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-77a1137b-352e-42bd-872e-602f79270995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:23.061065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1081/2167] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:22 2022] DELETE /identity/v3/projects/2096d306d87749fc9dfa8e8139edda70 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:23.068578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca93b44-ca10-481a-847a-cab5b6095fe4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:23.069119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca93b44-ca10-481a-847a-cab5b6095fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:23.069119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca93b44-ca10-481a-847a-cab5b6095fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:23.089765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4ca93b44-ca10-481a-847a-cab5b6095fe4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:23.091009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4ca93b44-ca10-481a-847a-cab5b6095fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:23.165671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1087/2168] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:23.175362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692c22-d8ac-4f6c-bed2-6157e8709410 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:23.175362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692c22-d8ac-4f6c-bed2-6157e8709410 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:23.175362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692c22-d8ac-4f6c-bed2-6157e8709410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:23.200868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-20692c22-d8ac-4f6c-bed2-6157e8709410 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:23.202237 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-20692c22-d8ac-4f6c-bed2-6157e8709410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:23.210922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1082/2169] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:23.215063 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca93b44-ca10-481a-847a-cab5b6095fe4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:23.231745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca93b44-ca10-481a-847a-cab5b6095fe4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:23.236378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465e40c-a687-4eac-89c9-d9d2c062597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:23.237534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465e40c-a687-4eac-89c9-d9d2c062597c admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:23.237801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465e40c-a687-4eac-89c9-d9d2c062597c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:23.238100 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465e40c-a687-4eac-89c9-d9d2c062597c admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:23.238746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465e40c-a687-4eac-89c9-d9d2c062597c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:39:23.239034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465e40c-a687-4eac-89c9-d9d2c062597c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:23.240617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465e40c-a687-4eac-89c9-d9d2c062597c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:23.254338 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1088/2170] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:39:23.259190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20692c22-d8ac-4f6c-bed2-6157e8709410 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:23.269401 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20692c22-d8ac-4f6c-bed2-6157e8709410 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:23.277086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249ccb-08f2-4489-bf83-0d4c85ae8642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:23.277832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249ccb-08f2-4489-bf83-0d4c85ae8642 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:23.278142 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249ccb-08f2-4489-bf83-0d4c85ae8642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:23.278398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd249ccb-08f2-4489-bf83-0d4c85ae8642 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:23.279048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd249ccb-08f2-4489-bf83-0d4c85ae8642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:23.280972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd249ccb-08f2-4489-bf83-0d4c85ae8642 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:23.437986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1083/2171] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:23 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:23.440786 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465e40c-a687-4eac-89c9-d9d2c062597c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:23.462430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465e40c-a687-4eac-89c9-d9d2c062597c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:23.577022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952ebb7-d4c3-4e76-bd54-dd37a7722b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:23.577748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952ebb7-d4c3-4e76-bd54-dd37a7722b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:23.578216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952ebb7-d4c3-4e76-bd54-dd37a7722b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:23.578497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952ebb7-d4c3-4e76-bd54-dd37a7722b71 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:23.579246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952ebb7-d4c3-4e76-bd54-dd37a7722b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:23.582502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952ebb7-d4c3-4e76-bd54-dd37a7722b71 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:23.721090 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1089/2172] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:23 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:23.726472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249ccb-08f2-4489-bf83-0d4c85ae8642 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:23.738581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd249ccb-08f2-4489-bf83-0d4c85ae8642 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:23.743803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d100d3f-5fe7-4ebd-90a1-c9341d135d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:23.744722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100d3f-5fe7-4ebd-90a1-c9341d135d34 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:23.745232 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100d3f-5fe7-4ebd-90a1-c9341d135d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:23.745585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d100d3f-5fe7-4ebd-90a1-c9341d135d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:23.746711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d100d3f-5fe7-4ebd-90a1-c9341d135d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:23.749399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d100d3f-5fe7-4ebd-90a1-c9341d135d34 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:23.763261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1084/2173] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:39:23.773120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952ebb7-d4c3-4e76-bd54-dd37a7722b71 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:23.788420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952ebb7-d4c3-4e76-bd54-dd37a7722b71 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:23.796739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033cd94-fb0c-4b19-9e2a-d8440131360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:23.800749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033cd94-fb0c-4b19-9e2a-d8440131360e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:23.800749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033cd94-fb0c-4b19-9e2a-d8440131360e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:23.800749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033cd94-fb0c-4b19-9e2a-d8440131360e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:23.800749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033cd94-fb0c-4b19-9e2a-d8440131360e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:23.802194 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033cd94-fb0c-4b19-9e2a-d8440131360e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:23.817500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1090/2174] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:39:23.821521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d100d3f-5fe7-4ebd-90a1-c9341d135d34 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:23.835096 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d100d3f-5fe7-4ebd-90a1-c9341d135d34 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:23.840463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd060-2517-4841-a987-4b61738030e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:23.847718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd060-2517-4841-a987-4b61738030e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:23.847718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd060-2517-4841-a987-4b61738030e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:23.847718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dd060-2517-4841-a987-4b61738030e2 admin admin] PATH_INFO: `/v3/projects/fb47b1066c3e4dc78f576297837c82b1/users/d7cceaa43f1346888d5d9c4e9d4f4475/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:23.859929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dd060-2517-4841-a987-4b61738030e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb47b1066c3e4dc78f576297837c82b1, user_id=d7cceaa43f1346888d5d9c4e9d4f4475, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:23.863391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dd060-2517-4841-a987-4b61738030e2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:23.985819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1085/2175] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:23 2022] PUT /identity/v3/projects/fb47b1066c3e4dc78f576297837c82b1/users/d7cceaa43f1346888d5d9c4e9d4f4475/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:24.000373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dec240-24e8-4d95-b38f-a38a6b1d4b3f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:24.000707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dec240-24e8-4d95-b38f-a38a6b1d4b3f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:24.001177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dec240-24e8-4d95-b38f-a38a6b1d4b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:24.036924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-58dec240-24e8-4d95-b38f-a38a6b1d4b3f None None] MFA Rules not processed for user `d7cceaa43f1346888d5d9c4e9d4f4475`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:24.038463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-58dec240-24e8-4d95-b38f-a38a6b1d4b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:24.075530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:24.123369 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1091/2176] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:24.139051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd060-2517-4841-a987-4b61738030e2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:24.140820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3f6dd060-2517-4841-a987-4b61738030e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:24.165138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:24.209363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dd060-2517-4841-a987-4b61738030e2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:24.213819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b3db0-eb29-44e4-9ba4-276e350c1d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:24.214514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3db0-eb29-44e4-9ba4-276e350c1d80 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:24.214860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3db0-eb29-44e4-9ba4-276e350c1d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:24.215184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b3db0-eb29-44e4-9ba4-276e350c1d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:24.230815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b3db0-eb29-44e4-9ba4-276e350c1d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:24.234883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b3db0-eb29-44e4-9ba4-276e350c1d80 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:24.242419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1086/2177] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:24.269368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dec240-24e8-4d95-b38f-a38a6b1d4b3f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:24.335984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dec240-24e8-4d95-b38f-a38a6b1d4b3f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:24.341349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:24.342016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:24.342323 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:24.342558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] PATH_INFO: `/v3/users/d7cceaa43f1346888d5d9c4e9d4f4475` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:24.344353 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7cceaa43f1346888d5d9c4e9d4f4475)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:24.346782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:24.715895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7cceaa43f1346888d5d9c4e9d4f4475'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:24.730084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7cceaa43f1346888d5d9c4e9d4f4475'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:24.731349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7cceaa43f1346888d5d9c4e9d4f4475'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:25.056681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7cceaa43f1346888d5d9c4e9d4f4475'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:25.077257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7cceaa43f1346888d5d9c4e9d4f4475'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:25.085670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1092/2178] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:24 2022] DELETE /identity/v3/users/d7cceaa43f1346888d5d9c4e9d4f4475 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:25.090689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2d711-5463-441d-8373-a32297e47942 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:25.091214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2d711-5463-441d-8373-a32297e47942 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:25.091617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2d711-5463-441d-8373-a32297e47942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:25.123422 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-38c2d711-5463-441d-8373-a32297e47942 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:25.124706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-38c2d711-5463-441d-8373-a32297e47942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:25.247214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1087/2179] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:25.258775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:25.260235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:25.366964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8209967-887f-4ff5-a3b6-5d89d9b371f1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:25.371618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca1832-676e-40e8-8cbe-248e295174f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:25.372255 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1832-676e-40e8-8cbe-248e295174f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:25.372530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1832-676e-40e8-8cbe-248e295174f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:25.372798 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1832-676e-40e8-8cbe-248e295174f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:25.386485 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca1832-676e-40e8-8cbe-248e295174f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:25.391317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca1832-676e-40e8-8cbe-248e295174f5 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:25.394972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:25.408043 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1093/2180] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:39:26.016612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2d711-5463-441d-8373-a32297e47942 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:26.021081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-38c2d711-5463-441d-8373-a32297e47942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:26.046305 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2d711-5463-441d-8373-a32297e47942 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:26.060177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:26.061289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.062380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.063140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] PATH_INFO: `/v3/projects/fb47b1066c3e4dc78f576297837c82b1` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.064782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb47b1066c3e4dc78f576297837c82b1)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:26.066833 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:26.210376 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb47b1066c3e4dc78f576297837c82b1', 'request_id': 'req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:26.218646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb47b1066c3e4dc78f576297837c82b1', 'request_id': 'req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:26.227286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb47b1066c3e4dc78f576297837c82b1', 'request_id': 'req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:26.311970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] The token cache is being invalidate because project fb47b1066c3e4dc78f576297837c82b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:26.312269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:26.313226 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c9ad8d6d-3ca5-43a7-9ac2-78abe3583b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:26.319619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1088/2181] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:26 2022] DELETE /identity/v3/projects/fb47b1066c3e4dc78f576297837c82b1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:26.321729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab6f9-d1b2-48e8-9579-734c9ae0dbd6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.322325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab6f9-d1b2-48e8-9579-734c9ae0dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.322325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afab6f9-d1b2-48e8-9579-734c9ae0dbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.356719 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-3afab6f9-d1b2-48e8-9579-734c9ae0dbd6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:26.358482 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3afab6f9-d1b2-48e8-9579-734c9ae0dbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:26.462544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1094/2182] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:26.470590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a06e-0aef-4afb-b98e-9bee64212f1a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.471402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a06e-0aef-4afb-b98e-9bee64212f1a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.471897 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217a06e-0aef-4afb-b98e-9bee64212f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.508579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d217a06e-0aef-4afb-b98e-9bee64212f1a None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:26.510598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d217a06e-0aef-4afb-b98e-9bee64212f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:26.523844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1089/2183] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:26.528519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afab6f9-d1b2-48e8-9579-734c9ae0dbd6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:26.543131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afab6f9-d1b2-48e8-9579-734c9ae0dbd6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:26.548310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ce922-61f2-4867-8846-57e609572f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:26.550689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ce922-61f2-4867-8846-57e609572f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.550992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ce922-61f2-4867-8846-57e609572f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.551285 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ce922-61f2-4867-8846-57e609572f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.551974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ce922-61f2-4867-8846-57e609572f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:39:26.552333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ce922-61f2-4867-8846-57e609572f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:26.553930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ce922-61f2-4867-8846-57e609572f9b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:26.579454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1095/2184] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:39:26.582976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217a06e-0aef-4afb-b98e-9bee64212f1a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:26.595678 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217a06e-0aef-4afb-b98e-9bee64212f1a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:26.603891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0f009-69f9-4440-b644-534284f09187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:26.605492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0f009-69f9-4440-b644-534284f09187 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.606022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0f009-69f9-4440-b644-534284f09187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.606303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0f009-69f9-4440-b644-534284f09187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.607179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0f009-69f9-4440-b644-534284f09187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:26.609248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0f009-69f9-4440-b644-534284f09187 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:26.703078 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dcc68-9e95-40f0-a000-7c67c0563515 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.703432 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dcc68-9e95-40f0-a000-7c67c0563515 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.703652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dcc68-9e95-40f0-a000-7c67c0563515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.729252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-677dcc68-9e95-40f0-a000-7c67c0563515 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:26.730537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-677dcc68-9e95-40f0-a000-7c67c0563515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:26.737955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1090/2185] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:26 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:26.742112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0f009-69f9-4440-b644-534284f09187 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:26.743701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1096/2186] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Sep 1 16:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:26.760996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dcc68-9e95-40f0-a000-7c67c0563515 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:26.762916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-677dcc68-9e95-40f0-a000-7c67c0563515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:26.764333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:26.833401 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0f009-69f9-4440-b644-534284f09187 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:26.839052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd04b-843a-4058-bfeb-79b6744308ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:26.839896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd04b-843a-4058-bfeb-79b6744308ab admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.840178 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd04b-843a-4058-bfeb-79b6744308ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.840445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd04b-843a-4058-bfeb-79b6744308ab admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.841090 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd04b-843a-4058-bfeb-79b6744308ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:26.843123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd04b-843a-4058-bfeb-79b6744308ab admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:26.875068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dcc68-9e95-40f0-a000-7c67c0563515 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:26.944062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1091/2187] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:26 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:39:26.948152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd04b-843a-4058-bfeb-79b6744308ab admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:26.957466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff5785-9295-461a-b1b0-5c3c546b6381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:26.958158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff5785-9295-461a-b1b0-5c3c546b6381 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.958441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff5785-9295-461a-b1b0-5c3c546b6381 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.958762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff5785-9295-461a-b1b0-5c3c546b6381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.960412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd04b-843a-4058-bfeb-79b6744308ab admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:26.965574 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10080-3522-406e-94b4-4ac0754b2721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:26.966606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10080-3522-406e-94b4-4ac0754b2721 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:26.966606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10080-3522-406e-94b4-4ac0754b2721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:26.966988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10080-3522-406e-94b4-4ac0754b2721 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:26.967726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea10080-3522-406e-94b4-4ac0754b2721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:26.968995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff5785-9295-461a-b1b0-5c3c546b6381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:26.969463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea10080-3522-406e-94b4-4ac0754b2721 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:26.972177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff5785-9295-461a-b1b0-5c3c546b6381 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:26.982151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1092/2188] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:39:26.985558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1097/2189] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:39:26.987060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10080-3522-406e-94b4-4ac0754b2721 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:26.998737 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10080-3522-406e-94b4-4ac0754b2721 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:27.006245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca54f2b-8422-4e6e-86cb-91caffaaf738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:27.007393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54f2b-8422-4e6e-86cb-91caffaaf738 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:27.007393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54f2b-8422-4e6e-86cb-91caffaaf738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:27.008154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54f2b-8422-4e6e-86cb-91caffaaf738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:27.008977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca54f2b-8422-4e6e-86cb-91caffaaf738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:27.011612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca54f2b-8422-4e6e-86cb-91caffaaf738 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:27.025425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1093/2190] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:39:27.029808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff5785-9295-461a-b1b0-5c3c546b6381 service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:27.036131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:27.042859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff5785-9295-461a-b1b0-5c3c546b6381 service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:27.047969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9bca2-704c-4857-b701-bd36cd046f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:27.050236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9bca2-704c-4857-b701-bd36cd046f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:27.050541 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9bca2-704c-4857-b701-bd36cd046f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:27.050818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9bca2-704c-4857-b701-bd36cd046f67 admin admin] PATH_INFO: `/v3/projects/659841139542464983436ac83c7c5e3d/users/b284ef2bb3e14112b6aefb993c99313f/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:27.069566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9bca2-704c-4857-b701-bd36cd046f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659841139542464983436ac83c7c5e3d, user_id=b284ef2bb3e14112b6aefb993c99313f, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:27.072403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e9bca2-704c-4857-b701-bd36cd046f67 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:27.195050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1098/2191] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:27 2022] PUT /identity/v3/projects/659841139542464983436ac83c7c5e3d/users/b284ef2bb3e14112b6aefb993c99313f/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:27.198290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3d76c-f418-4a48-9e2e-28366d55860b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:27.198889 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3d76c-f418-4a48-9e2e-28366d55860b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:27.200546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3d76c-f418-4a48-9e2e-28366d55860b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:27.243762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ffb3d76c-f418-4a48-9e2e-28366d55860b None None] MFA Rules not processed for user `b284ef2bb3e14112b6aefb993c99313f`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:27.245050 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ffb3d76c-f418-4a48-9e2e-28366d55860b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:27.337077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1094/2192] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:27.348599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9bca2-704c-4857-b701-bd36cd046f67 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:27.350715 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-98e9bca2-704c-4857-b701-bd36cd046f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:27.425645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e9bca2-704c-4857-b701-bd36cd046f67 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:27.429405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6b254-2e8e-42f4-bd93-92b0e6e71a9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:27.430086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b254-2e8e-42f4-bd93-92b0e6e71a9d service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:27.430488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b254-2e8e-42f4-bd93-92b0e6e71a9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:27.430772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6b254-2e8e-42f4-bd93-92b0e6e71a9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:27.442153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6b254-2e8e-42f4-bd93-92b0e6e71a9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:27.443883 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6b254-2e8e-42f4-bd93-92b0e6e71a9d service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:27.455994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1099/2193] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:31.533689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f55b-b6b2-41c9-bc81-cb383962c782 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:31.534488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f55b-b6b2-41c9-bc81-cb383962c782 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:31.534488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85f55b-b6b2-41c9-bc81-cb383962c782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:31.557636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5a85f55b-b6b2-41c9-bc81-cb383962c782 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:31.558821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5a85f55b-b6b2-41c9-bc81-cb383962c782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:31.636722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1095/2194] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Sep 1 16:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:31.755345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6b254-2e8e-42f4-bd93-92b0e6e71a9d service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:31.758359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a5e6b254-2e8e-42f4-bd93-92b0e6e71a9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:31.858289 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6b254-2e8e-42f4-bd93-92b0e6e71a9d service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:31.865102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0baef-c0f0-41a0-b33f-1a27a4e0d606 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:31.866193 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0baef-c0f0-41a0-b33f-1a27a4e0d606 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:31.866473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0baef-c0f0-41a0-b33f-1a27a4e0d606 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:31.866742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0baef-c0f0-41a0-b33f-1a27a4e0d606 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:31.875971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0baef-c0f0-41a0-b33f-1a27a4e0d606 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:31.878081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0baef-c0f0-41a0-b33f-1a27a4e0d606 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:31.891707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1100/2195] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:32.096566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85f55b-b6b2-41c9-bc81-cb383962c782 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:32.107299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85f55b-b6b2-41c9-bc81-cb383962c782 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:32.112628 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:32.113237 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:32.113488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:32.113761 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] PATH_INFO: `/v3/users/b284ef2bb3e14112b6aefb993c99313f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:32.114946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b284ef2bb3e14112b6aefb993c99313f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:32.116985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:32.123163 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:32.385773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b284ef2bb3e14112b6aefb993c99313f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:32.394437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b284ef2bb3e14112b6aefb993c99313f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:32.395203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b284ef2bb3e14112b6aefb993c99313f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:32.522600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b284ef2bb3e14112b6aefb993c99313f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:32.527022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b284ef2bb3e14112b6aefb993c99313f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:32.558892 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1096/2196] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:32 2022] DELETE /identity/v3/users/b284ef2bb3e14112b6aefb993c99313f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:32.563258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441182b9-e93e-454d-8024-3d337341700c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:32.563554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441182b9-e93e-454d-8024-3d337341700c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:32.563823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441182b9-e93e-454d-8024-3d337341700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:32.584152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-441182b9-e93e-454d-8024-3d337341700c None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:32.585346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-441182b9-e93e-454d-8024-3d337341700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:32.655233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1101/2197] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:32.664546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:32.666009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:32.727970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064c39-3ba9-438b-a887-d3407cb22711 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:32.731891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087575a5-6adf-497a-be8b-6f2545ac6daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:32.732539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087575a5-6adf-497a-be8b-6f2545ac6daf service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:32.732815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087575a5-6adf-497a-be8b-6f2545ac6daf service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:32.733084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087575a5-6adf-497a-be8b-6f2545ac6daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:32.744156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087575a5-6adf-497a-be8b-6f2545ac6daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:32.745576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087575a5-6adf-497a-be8b-6f2545ac6daf service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:32.758270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1097/2198] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:39:33.295491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441182b9-e93e-454d-8024-3d337341700c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:33.302685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-441182b9-e93e-454d-8024-3d337341700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:33.309695 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441182b9-e93e-454d-8024-3d337341700c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:33.316313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:33.317276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:33.323388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:33.323695 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] PATH_INFO: `/v3/projects/659841139542464983436ac83c7c5e3d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:33.325094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=659841139542464983436ac83c7c5e3d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:33.327157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:33.328874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:33.501368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659841139542464983436ac83c7c5e3d', 'request_id': 'req-5aafeafc-7878-407f-a64d-80f801c97ec5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:33.509516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659841139542464983436ac83c7c5e3d', 'request_id': 'req-5aafeafc-7878-407f-a64d-80f801c97ec5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:33.631894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659841139542464983436ac83c7c5e3d', 'request_id': 'req-5aafeafc-7878-407f-a64d-80f801c97ec5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:33.643526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] The token cache is being invalidate because project 659841139542464983436ac83c7c5e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:33.671288 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:33.671288 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5aafeafc-7878-407f-a64d-80f801c97ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:33.671288 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1102/2199] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:33 2022] DELETE /identity/v3/projects/659841139542464983436ac83c7c5e3d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:33.671626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e32e3-d748-4534-9a3b-ad246f190fa8 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:33.671626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e32e3-d748-4534-9a3b-ad246f190fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:33.671626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e32e3-d748-4534-9a3b-ad246f190fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:33.675077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-349e32e3-d748-4534-9a3b-ad246f190fa8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:33.676358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-349e32e3-d748-4534-9a3b-ad246f190fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:33.738523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1098/2200] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:33.747801 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac49b4-114c-4ee5-b922-5b739f2ddd96 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:33.748198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac49b4-114c-4ee5-b922-5b739f2ddd96 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:33.748390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac49b4-114c-4ee5-b922-5b739f2ddd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:33.770728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-17ac49b4-114c-4ee5-b922-5b739f2ddd96 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:33.773965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-17ac49b4-114c-4ee5-b922-5b739f2ddd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:33.780103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1103/2201] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:33.785447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e32e3-d748-4534-9a3b-ad246f190fa8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:33.795371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e32e3-d748-4534-9a3b-ad246f190fa8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:33.802506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b80145-8e79-4157-b4a5-dd3fd834f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:33.802506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b80145-8e79-4157-b4a5-dd3fd834f93b admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:33.802506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b80145-8e79-4157-b4a5-dd3fd834f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:33.802506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b80145-8e79-4157-b4a5-dd3fd834f93b admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:33.802930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b80145-8e79-4157-b4a5-dd3fd834f93b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:39:33.802930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b80145-8e79-4157-b4a5-dd3fd834f93b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:33.804393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b80145-8e79-4157-b4a5-dd3fd834f93b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:33.818151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1099/2202] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:39:33.821610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac49b4-114c-4ee5-b922-5b739f2ddd96 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:33.835244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac49b4-114c-4ee5-b922-5b739f2ddd96 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:33.840146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8251c8-bfc3-4136-bcfe-4e07b77e4ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:33.840739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8251c8-bfc3-4136-bcfe-4e07b77e4ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:33.841013 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8251c8-bfc3-4136-bcfe-4e07b77e4ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:33.841331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8251c8-bfc3-4136-bcfe-4e07b77e4ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:33.842000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8251c8-bfc3-4136-bcfe-4e07b77e4ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:33.853194 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8251c8-bfc3-4136-bcfe-4e07b77e4ef4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:34.002555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1104/2203] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:33 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:34.002752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b80145-8e79-4157-b4a5-dd3fd834f93b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:34.005448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b80145-8e79-4157-b4a5-dd3fd834f93b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:34.017643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:34.067024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb78760-8e3d-402f-921d-557dc6b8a850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:34.067637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78760-8e3d-402f-921d-557dc6b8a850 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:34.067915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78760-8e3d-402f-921d-557dc6b8a850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:34.068186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb78760-8e3d-402f-921d-557dc6b8a850 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:34.068816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb78760-8e3d-402f-921d-557dc6b8a850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:34.070759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb78760-8e3d-402f-921d-557dc6b8a850 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:34.290852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1100/2204] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:33 2022] POST /identity/v3/users => generated 287 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:34.297010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8251c8-bfc3-4136-bcfe-4e07b77e4ef4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:34.307933 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8251c8-bfc3-4136-bcfe-4e07b77e4ef4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:34.312664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fc426-8ebb-4f2a-9d52-2387b7d780ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:34.313275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fc426-8ebb-4f2a-9d52-2387b7d780ad admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:34.313921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fc426-8ebb-4f2a-9d52-2387b7d780ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:34.313921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fc426-8ebb-4f2a-9d52-2387b7d780ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:34.314530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fc426-8ebb-4f2a-9d52-2387b7d780ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:34.316505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fc426-8ebb-4f2a-9d52-2387b7d780ad admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:34.327351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1105/2205] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:34.337084 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb78760-8e3d-402f-921d-557dc6b8a850 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:34.347758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb78760-8e3d-402f-921d-557dc6b8a850 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:34.354140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e0f74-abe4-433e-bf7a-33dc8eab7607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:34.354773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e0f74-abe4-433e-bf7a-33dc8eab7607 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:34.355048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e0f74-abe4-433e-bf7a-33dc8eab7607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:34.355317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e0f74-abe4-433e-bf7a-33dc8eab7607 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:34.355963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e0f74-abe4-433e-bf7a-33dc8eab7607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:34.357539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e0f74-abe4-433e-bf7a-33dc8eab7607 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:34.370462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1101/2206] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:34.374884 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fc426-8ebb-4f2a-9d52-2387b7d780ad admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:34.385461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fc426-8ebb-4f2a-9d52-2387b7d780ad admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:34.390107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eefc2-bfa8-46b5-95bd-3b4846402256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:34.390832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eefc2-bfa8-46b5-95bd-3b4846402256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:34.391039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eefc2-bfa8-46b5-95bd-3b4846402256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:34.391308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eefc2-bfa8-46b5-95bd-3b4846402256 admin admin] PATH_INFO: `/v3/projects/52ed24ff4ed34f948e58f78fba13dc24/users/7f309d1af48544fcb9891113446a05cf/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:34.409095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eefc2-bfa8-46b5-95bd-3b4846402256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ed24ff4ed34f948e58f78fba13dc24, user_id=7f309d1af48544fcb9891113446a05cf, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:34.411841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eefc2-bfa8-46b5-95bd-3b4846402256 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:34.537325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1106/2207] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:34 2022] PUT /identity/v3/projects/52ed24ff4ed34f948e58f78fba13dc24/users/7f309d1af48544fcb9891113446a05cf/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:34.542547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1208e4-c053-4883-8916-5271a5e432b9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:34.548290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1208e4-c053-4883-8916-5271a5e432b9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:34.548290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1208e4-c053-4883-8916-5271a5e432b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:34.563943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5a1208e4-c053-4883-8916-5271a5e432b9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:34.565235 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5a1208e4-c053-4883-8916-5271a5e432b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:34.650826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1102/2208] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:34.661758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eefc2-bfa8-46b5-95bd-3b4846402256 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:34.663589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b57eefc2-bfa8-46b5-95bd-3b4846402256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:34.736800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eefc2-bfa8-46b5-95bd-3b4846402256 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:34.742460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9671c81-a753-49a8-8f47-e93d54ef3836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:34.743101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9671c81-a753-49a8-8f47-e93d54ef3836 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:34.743380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9671c81-a753-49a8-8f47-e93d54ef3836 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:34.743652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9671c81-a753-49a8-8f47-e93d54ef3836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:34.759688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9671c81-a753-49a8-8f47-e93d54ef3836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:34.761370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9671c81-a753-49a8-8f47-e93d54ef3836 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:34.778839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1107/2209] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:37.487370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf250d-2062-4fed-beee-e4444860d03e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:37.488421 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf250d-2062-4fed-beee-e4444860d03e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:37.488746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf250d-2062-4fed-beee-e4444860d03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:37.512854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4daf250d-2062-4fed-beee-e4444860d03e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:37.514604 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4daf250d-2062-4fed-beee-e4444860d03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:37.533709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1103/2210] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Sep 1 16:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:37.556416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9671c81-a753-49a8-8f47-e93d54ef3836 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:37.559429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f9671c81-a753-49a8-8f47-e93d54ef3836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:37.646487 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:37.776463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9671c81-a753-49a8-8f47-e93d54ef3836 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:37.795132 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864962ff-57f2-4628-bba6-4dca8d3380fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:37.796289 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864962ff-57f2-4628-bba6-4dca8d3380fd service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:37.798350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864962ff-57f2-4628-bba6-4dca8d3380fd service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:37.801650 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864962ff-57f2-4628-bba6-4dca8d3380fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:37.825904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864962ff-57f2-4628-bba6-4dca8d3380fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:37.827664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864962ff-57f2-4628-bba6-4dca8d3380fd service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:37.854733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1108/2211] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:42.020186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6335c45-6b4d-4e2a-9ed6-f367b1d152d8 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:42.022754 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6335c45-6b4d-4e2a-9ed6-f367b1d152d8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:42.023308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6335c45-6b4d-4e2a-9ed6-f367b1d152d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:42.059863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a6335c45-6b4d-4e2a-9ed6-f367b1d152d8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:42.062248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a6335c45-6b4d-4e2a-9ed6-f367b1d152d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:42.091049 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1104/2212] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Sep 1 16:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:42.129780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864962ff-57f2-4628-bba6-4dca8d3380fd service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:42.131430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-864962ff-57f2-4628-bba6-4dca8d3380fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:42.198895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864962ff-57f2-4628-bba6-4dca8d3380fd service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:42.222160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8e82-8884-4603-b813-c5c0880e3391 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:42.223521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8e82-8884-4603-b813-c5c0880e3391 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:42.225554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8e82-8884-4603-b813-c5c0880e3391 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:42.226300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8e82-8884-4603-b813-c5c0880e3391 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:42.271362 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff8e82-8884-4603-b813-c5c0880e3391 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:42.275106 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff8e82-8884-4603-b813-c5c0880e3391 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:42.350548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1109/2213] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:43.289814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6335c45-6b4d-4e2a-9ed6-f367b1d152d8 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:43.292117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a6335c45-6b4d-4e2a-9ed6-f367b1d152d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:43.336209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6335c45-6b4d-4e2a-9ed6-f367b1d152d8 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:43.345644 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:43.347224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:43.349183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:43.353382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] PATH_INFO: `/v3/users/69fc8bf6292a4f8c8f654bc37a2d6baa` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:43.353382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] RBAC: Authorizing `identity:delete_user(user_id=69fc8bf6292a4f8c8f654bc37a2d6baa)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:43.355537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:43.675037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69fc8bf6292a4f8c8f654bc37a2d6baa'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:43.689131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69fc8bf6292a4f8c8f654bc37a2d6baa'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:43.690895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69fc8bf6292a4f8c8f654bc37a2d6baa'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:43.740008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8248ff-1472-482a-a3f6-239470ebf51d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:43.740552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8248ff-1472-482a-a3f6-239470ebf51d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:43.740552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8248ff-1472-482a-a3f6-239470ebf51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:43.772035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4c8248ff-1472-482a-a3f6-239470ebf51d None None] MFA Rules not processed for user `b1628c4903b34a219d19e01bf73e0b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:43.773320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4c8248ff-1472-482a-a3f6-239470ebf51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:43.837391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69fc8bf6292a4f8c8f654bc37a2d6baa'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:43.838555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69fc8bf6292a4f8c8f654bc37a2d6baa'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:43.857342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:43.865603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1110/2214] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:43.870407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1105/2215] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:43 2022] DELETE /identity/v3/users/69fc8bf6292a4f8c8f654bc37a2d6baa => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:43.879996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01be2-4ae7-4c0e-8d9f-ead223b63399 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:43.880291 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01be2-4ae7-4c0e-8d9f-ead223b63399 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:43.880568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a01be2-4ae7-4c0e-8d9f-ead223b63399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:43.906379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-13a01be2-4ae7-4c0e-8d9f-ead223b63399 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:43.907663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-13a01be2-4ae7-4c0e-8d9f-ead223b63399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:44.064071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1111/2216] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:44.087627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:44.089558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:44.199594 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3790921-101f-43cc-b504-824bd9a9afea admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:44.206465 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264314a-1a6b-4d73-b181-7a5191c52456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:44.206824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264314a-1a6b-4d73-b181-7a5191c52456 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:44.206824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264314a-1a6b-4d73-b181-7a5191c52456 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:44.207206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264314a-1a6b-4d73-b181-7a5191c52456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:44.219488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264314a-1a6b-4d73-b181-7a5191c52456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:44.228019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b264314a-1a6b-4d73-b181-7a5191c52456 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:44.236973 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1106/2217] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:44.681463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709391f3-b248-4ec0-b126-5661a759f1a3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:44.681772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709391f3-b248-4ec0-b126-5661a759f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:44.682069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709391f3-b248-4ec0-b126-5661a759f1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:44.775222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-709391f3-b248-4ec0-b126-5661a759f1a3 None None] MFA Rules not processed for user `7f309d1af48544fcb9891113446a05cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:44.783824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-709391f3-b248-4ec0-b126-5661a759f1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:44.907729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:44.992966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264314a-1a6b-4d73-b181-7a5191c52456 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:44.995270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1112/2218] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:44.996511 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b264314a-1a6b-4d73-b181-7a5191c52456 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:45.062309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264314a-1a6b-4d73-b181-7a5191c52456 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.078590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17b408-1099-4be8-b447-66c983821331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.079630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b408-1099-4be8-b447-66c983821331 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.084758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b408-1099-4be8-b447-66c983821331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.085257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b408-1099-4be8-b447-66c983821331 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.086479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17b408-1099-4be8-b447-66c983821331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.094592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17b408-1099-4be8-b447-66c983821331 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.311550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1107/2219] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:44 2022] POST /identity/v3/projects => generated 373 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:45.317074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709391f3-b248-4ec0-b126-5661a759f1a3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.345367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709391f3-b248-4ec0-b126-5661a759f1a3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.478295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a794-690a-419f-a966-2e57760297a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.478938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a794-690a-419f-a966-2e57760297a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.479598 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a794-690a-419f-a966-2e57760297a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.480048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a794-690a-419f-a966-2e57760297a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.480885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3a794-690a-419f-a966-2e57760297a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.483306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3a794-690a-419f-a966-2e57760297a6 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.610175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17b408-1099-4be8-b447-66c983821331 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.612846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5f17b408-1099-4be8-b447-66c983821331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:45.672218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17b408-1099-4be8-b447-66c983821331 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.674112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1113/2220] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:45 2022] POST /identity/v3/users => generated 293 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:45.678799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a794-690a-419f-a966-2e57760297a6 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.694920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.695503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.695778 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.696043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] PATH_INFO: `/v3/projects/0bdfad7195cc415bbb84a7398a45ce95` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.699782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bdfad7195cc415bbb84a7398a45ce95)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.708977 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a794-690a-419f-a966-2e57760297a6 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.718400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26787ce9-8693-4739-8f64-a02d7e743b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.719796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787ce9-8693-4739-8f64-a02d7e743b96 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.720153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787ce9-8693-4739-8f64-a02d7e743b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.723251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.723529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26787ce9-8693-4739-8f64-a02d7e743b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.724223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26787ce9-8693-4739-8f64-a02d7e743b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.728619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26787ce9-8693-4739-8f64-a02d7e743b96 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.772974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1114/2221] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:39:45.774392 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26787ce9-8693-4739-8f64-a02d7e743b96 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:45.788802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26787ce9-8693-4739-8f64-a02d7e743b96 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:45.795458 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32dc35-975d-4f42-95e6-ac68a0e98b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:45.797042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32dc35-975d-4f42-95e6-ac68a0e98b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:45.797380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32dc35-975d-4f42-95e6-ac68a0e98b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:45.798355 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b32dc35-975d-4f42-95e6-ac68a0e98b21 admin admin] PATH_INFO: `/v3/projects/c3ce56dc74d04e2589c4cf3d3c8320f8/users/32dda62d101c4e9b84c624b1f0e5d86b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:45.844130 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32dc35-975d-4f42-95e6-ac68a0e98b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ce56dc74d04e2589c4cf3d3c8320f8, user_id=32dda62d101c4e9b84c624b1f0e5d86b, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:45.849009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b32dc35-975d-4f42-95e6-ac68a0e98b21 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:45.982146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1115/2222] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:45 2022] PUT /identity/v3/projects/c3ce56dc74d04e2589c4cf3d3c8320f8/users/32dda62d101c4e9b84c624b1f0e5d86b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:45.998500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32dc35-975d-4f42-95e6-ac68a0e98b21 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.023710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bdfad7195cc415bbb84a7398a45ce95', 'request_id': 'req-92374f2b-beba-45c9-b1c0-ed1a22b8264d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:46.034193 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bdfad7195cc415bbb84a7398a45ce95', 'request_id': 'req-92374f2b-beba-45c9-b1c0-ed1a22b8264d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:46.042661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bdfad7195cc415bbb84a7398a45ce95', 'request_id': 'req-92374f2b-beba-45c9-b1c0-ed1a22b8264d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:46.152237 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] The token cache is being invalidate because project 0bdfad7195cc415bbb84a7398a45ce95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:46.154244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:46.154244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-92374f2b-beba-45c9-b1c0-ed1a22b8264d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:46.156299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1108/2223] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:45 2022] DELETE /identity/v3/projects/0bdfad7195cc415bbb84a7398a45ce95 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:46.165861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c71f0-e393-40e1-a398-ad1c1bfc2c17 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.166469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c71f0-e393-40e1-a398-ad1c1bfc2c17 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.167065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c71f0-e393-40e1-a398-ad1c1bfc2c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.176939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b32dc35-975d-4f42-95e6-ac68a0e98b21 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.211764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1f9c71f0-e393-40e1-a398-ad1c1bfc2c17 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:46.213624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1f9c71f0-e393-40e1-a398-ad1c1bfc2c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:46.279813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:46.314041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dd8e9-1474-4ba3-bf80-59cd302c2c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.315485 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dd8e9-1474-4ba3-bf80-59cd302c2c2e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.316199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:46.316755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dd8e9-1474-4ba3-bf80-59cd302c2c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.317185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dd8e9-1474-4ba3-bf80-59cd302c2c2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.319500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dd8e9-1474-4ba3-bf80-59cd302c2c2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.321958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017dd8e9-1474-4ba3-bf80-59cd302c2c2e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.338613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1116/2224] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:46.338826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1109/2225] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:46.341264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ec88-959c-4cf4-b95e-13154719d1ba None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.341847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ec88-959c-4cf4-b95e-13154719d1ba None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.346596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1ec88-959c-4cf4-b95e-13154719d1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.347435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c71f0-e393-40e1-a398-ad1c1bfc2c17 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.349063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1f9c71f0-e393-40e1-a398-ad1c1bfc2c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:46.372324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c71f0-e393-40e1-a398-ad1c1bfc2c17 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.382025 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-4dd1ec88-959c-4cf4-b95e-13154719d1ba None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:46.383767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4dd1ec88-959c-4cf4-b95e-13154719d1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:46.384429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aba9f6-5218-4c38-b050-723be5183df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.386288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aba9f6-5218-4c38-b050-723be5183df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.387418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aba9f6-5218-4c38-b050-723be5183df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.388244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aba9f6-5218-4c38-b050-723be5183df3 admin admin] PATH_INFO: `/v3/projects/c3ce56dc74d04e2589c4cf3d3c8320f8/users/32dda62d101c4e9b84c624b1f0e5d86b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.395279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aba9f6-5218-4c38-b050-723be5183df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3ce56dc74d04e2589c4cf3d3c8320f8, user_id=32dda62d101c4e9b84c624b1f0e5d86b, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.402964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aba9f6-5218-4c38-b050-723be5183df3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.412378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1117/2226] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:46.419518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1ec88-959c-4cf4-b95e-13154719d1ba None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.436165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1ec88-959c-4cf4-b95e-13154719d1ba None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.445313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef03a7-669f-4f81-b5a9-25d6ec28e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.446233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef03a7-669f-4f81-b5a9-25d6ec28e8be admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.450159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef03a7-669f-4f81-b5a9-25d6ec28e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.450159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef03a7-669f-4f81-b5a9-25d6ec28e8be admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.450159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef03a7-669f-4f81-b5a9-25d6ec28e8be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:39:46.450159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef03a7-669f-4f81-b5a9-25d6ec28e8be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.451622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef03a7-669f-4f81-b5a9-25d6ec28e8be admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.475778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1118/2227] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:39:46.479873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1110/2228] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:46 2022] PUT /identity/v3/projects/c3ce56dc74d04e2589c4cf3d3c8320f8/users/32dda62d101c4e9b84c624b1f0e5d86b/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:46.482406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef03a7-669f-4f81-b5a9-25d6ec28e8be admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.499505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef03a7-669f-4f81-b5a9-25d6ec28e8be admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.617723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd348-4504-43a3-8dc3-0b92d25bade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.618676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd348-4504-43a3-8dc3-0b92d25bade9 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.618676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd348-4504-43a3-8dc3-0b92d25bade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.618965 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbd348-4504-43a3-8dc3-0b92d25bade9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.619661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbd348-4504-43a3-8dc3-0b92d25bade9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.621481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbd348-4504-43a3-8dc3-0b92d25bade9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:46.799664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1119/2229] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:46 2022] POST /identity/v3/projects => generated 373 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:46.806175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aba9f6-5218-4c38-b050-723be5183df3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:46.819168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aba9f6-5218-4c38-b050-723be5183df3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:46.902400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ebb45-0e12-4d8f-9a2a-4fa4184454e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:46.902400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ebb45-0e12-4d8f-9a2a-4fa4184454e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:46.905064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ebb45-0e12-4d8f-9a2a-4fa4184454e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:46.905064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ebb45-0e12-4d8f-9a2a-4fa4184454e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:46.905064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ebb45-0e12-4d8f-9a2a-4fa4184454e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:46.911987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ebb45-0e12-4d8f-9a2a-4fa4184454e4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:47.001128 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1111/2230] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:46 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:47.012514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd348-4504-43a3-8dc3-0b92d25bade9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:47.042870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbd348-4504-43a3-8dc3-0b92d25bade9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:47.055127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea3f41-79f7-42a0-acb2-def18d4246ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:47.056550 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea3f41-79f7-42a0-acb2-def18d4246ce admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:47.056923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea3f41-79f7-42a0-acb2-def18d4246ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:47.057411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea3f41-79f7-42a0-acb2-def18d4246ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:47.063943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea3f41-79f7-42a0-acb2-def18d4246ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:47.066083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea3f41-79f7-42a0-acb2-def18d4246ce admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:47.122706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1120/2231] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:47.126502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ebb45-0e12-4d8f-9a2a-4fa4184454e4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:47.187099 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ebb45-0e12-4d8f-9a2a-4fa4184454e4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:47.205245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656c897-2f8d-4b41-a38e-669ddefc026c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:47.207659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656c897-2f8d-4b41-a38e-669ddefc026c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:47.208259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656c897-2f8d-4b41-a38e-669ddefc026c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:47.208771 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656c897-2f8d-4b41-a38e-669ddefc026c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:47.209738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656c897-2f8d-4b41-a38e-669ddefc026c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:47.211602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656c897-2f8d-4b41-a38e-669ddefc026c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:47.234054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1112/2232] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:47.251305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea3f41-79f7-42a0-acb2-def18d4246ce admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:47.275866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea3f41-79f7-42a0-acb2-def18d4246ce admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:47.308131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beae7d3-c434-42b1-ac01-c79c62c1ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:47.309168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beae7d3-c434-42b1-ac01-c79c62c1ee66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:47.309639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beae7d3-c434-42b1-ac01-c79c62c1ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:47.310184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beae7d3-c434-42b1-ac01-c79c62c1ee66 admin admin] PATH_INFO: `/v3/projects/1779bfe202de426e84b8aecca7836a00/users/e15f687d7f024f6bb12e376ed2e8b9ac/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:47.335559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beae7d3-c434-42b1-ac01-c79c62c1ee66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1779bfe202de426e84b8aecca7836a00, user_id=e15f687d7f024f6bb12e376ed2e8b9ac, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:47.338799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beae7d3-c434-42b1-ac01-c79c62c1ee66 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:47.469461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1121/2233] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:47 2022] PUT /identity/v3/projects/1779bfe202de426e84b8aecca7836a00/users/e15f687d7f024f6bb12e376ed2e8b9ac/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:47.482535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd3e81-7825-4b23-be5a-eb82fddc683b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:47.483014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd3e81-7825-4b23-be5a-eb82fddc683b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:47.483626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd3e81-7825-4b23-be5a-eb82fddc683b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:47.554106 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9fdd3e81-7825-4b23-be5a-eb82fddc683b None None] MFA Rules not processed for user `e15f687d7f024f6bb12e376ed2e8b9ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:47.555504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9fdd3e81-7825-4b23-be5a-eb82fddc683b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:47.717505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1113/2234] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:47.762709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beae7d3-c434-42b1-ac01-c79c62c1ee66 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:47.787386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0beae7d3-c434-42b1-ac01-c79c62c1ee66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:47.924442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beae7d3-c434-42b1-ac01-c79c62c1ee66 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:47.934865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31154594-4ffa-4b2b-aaba-36c5a33b1223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:47.936621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154594-4ffa-4b2b-aaba-36c5a33b1223 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:47.937341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154594-4ffa-4b2b-aaba-36c5a33b1223 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:47.938120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31154594-4ffa-4b2b-aaba-36c5a33b1223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:47.956687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31154594-4ffa-4b2b-aaba-36c5a33b1223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:47.960263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31154594-4ffa-4b2b-aaba-36c5a33b1223 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:47.984704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1122/2235] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:48.040116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd3e81-7825-4b23-be5a-eb82fddc683b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:48.154733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd3e81-7825-4b23-be5a-eb82fddc683b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:48.161108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:48.161942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:48.162275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:48.174312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] PATH_INFO: `/v3/users/e15f687d7f024f6bb12e376ed2e8b9ac` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:48.174312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15f687d7f024f6bb12e376ed2e8b9ac)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:48.174312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:48.512066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15f687d7f024f6bb12e376ed2e8b9ac'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:48.522007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15f687d7f024f6bb12e376ed2e8b9ac'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:48.522620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15f687d7f024f6bb12e376ed2e8b9ac'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:48.680443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15f687d7f024f6bb12e376ed2e8b9ac'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:48.681583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15f687d7f024f6bb12e376ed2e8b9ac'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:48.710190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1114/2236] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:39:48 2022] DELETE /identity/v3/users/e15f687d7f024f6bb12e376ed2e8b9ac => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:48.716292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1a5c-c6c9-4c74-be45-dd347f1cb143 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:48.716627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1a5c-c6c9-4c74-be45-dd347f1cb143 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:48.716911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc1a5c-c6c9-4c74-be45-dd347f1cb143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:48.733545 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:48.747773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1cfc1a5c-c6c9-4c74-be45-dd347f1cb143 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:48.749306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1cfc1a5c-c6c9-4c74-be45-dd347f1cb143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:48.788088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:48.884702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1123/2237] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:48.896904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:48.898823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:49.144795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd60d0-f9a7-425c-a410-795c77a92269 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:49.151389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faac0b7-0e9d-44fd-a9af-1669245f6593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:49.158668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac0b7-0e9d-44fd-a9af-1669245f6593 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:49.158668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac0b7-0e9d-44fd-a9af-1669245f6593 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:49.158668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac0b7-0e9d-44fd-a9af-1669245f6593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:49.167790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac0b7-0e9d-44fd-a9af-1669245f6593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:49.169258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac0b7-0e9d-44fd-a9af-1669245f6593 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:49.186209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1115/2238] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:39:49.976945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc1a5c-c6c9-4c74-be45-dd347f1cb143 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:49.980575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1cfc1a5c-c6c9-4c74-be45-dd347f1cb143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:50.014746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc1a5c-c6c9-4c74-be45-dd347f1cb143 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:50.023846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:50.028270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.028913 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.029333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] PATH_INFO: `/v3/projects/1779bfe202de426e84b8aecca7836a00` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.036857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1779bfe202de426e84b8aecca7836a00)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:50.037267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:50.186470 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1779bfe202de426e84b8aecca7836a00', 'request_id': 'req-f2e05b12-3718-4a5b-88e6-897a7f163ecb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.199377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1779bfe202de426e84b8aecca7836a00', 'request_id': 'req-f2e05b12-3718-4a5b-88e6-897a7f163ecb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.314284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1779bfe202de426e84b8aecca7836a00', 'request_id': 'req-f2e05b12-3718-4a5b-88e6-897a7f163ecb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.331849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] The token cache is being invalidate because project 1779bfe202de426e84b8aecca7836a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:39:50.332492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.333728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f2e05b12-3718-4a5b-88e6-897a7f163ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:39:50.342262 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1124/2239] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:39:49 2022] DELETE /identity/v3/projects/1779bfe202de426e84b8aecca7836a00 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:50.344313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30ef9-1b2b-4fd7-b603-52f1fc81be4e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.344313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30ef9-1b2b-4fd7-b603-52f1fc81be4e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.344313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30ef9-1b2b-4fd7-b603-52f1fc81be4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.372360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1ad30ef9-1b2b-4fd7-b603-52f1fc81be4e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:50.377165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1ad30ef9-1b2b-4fd7-b603-52f1fc81be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:50.499119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1116/2240] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:50.511059 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004711-b4c7-444c-949c-30630316d916 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.511472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004711-b4c7-444c-949c-30630316d916 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.511968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30004711-b4c7-444c-949c-30630316d916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.534037 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-30004711-b4c7-444c-949c-30630316d916 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:50.535571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-30004711-b4c7-444c-949c-30630316d916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:50.550895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1125/2241] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:50.556376 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad30ef9-1b2b-4fd7-b603-52f1fc81be4e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:50.568688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad30ef9-1b2b-4fd7-b603-52f1fc81be4e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:50.574501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd2203-153a-49a4-b4e1-498bdfbd402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:50.591633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd2203-153a-49a4-b4e1-498bdfbd402a admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.591633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd2203-153a-49a4-b4e1-498bdfbd402a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.591633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd2203-153a-49a4-b4e1-498bdfbd402a admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.591633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd2203-153a-49a4-b4e1-498bdfbd402a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:39:50.591633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd2203-153a-49a4-b4e1-498bdfbd402a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:50.591633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd2203-153a-49a4-b4e1-498bdfbd402a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:50.596136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1117/2242] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:39:50.604537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30004711-b4c7-444c-949c-30630316d916 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:50.631139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30004711-b4c7-444c-949c-30630316d916 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:50.646732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf70220-d2e0-4241-833f-57af58e617de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:50.647360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf70220-d2e0-4241-833f-57af58e617de admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.647851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf70220-d2e0-4241-833f-57af58e617de admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.648748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf70220-d2e0-4241-833f-57af58e617de admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.650126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf70220-d2e0-4241-833f-57af58e617de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:50.652110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf70220-d2e0-4241-833f-57af58e617de admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:50.771200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd2203-153a-49a4-b4e1-498bdfbd402a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:50.777162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1126/2243] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:39:50 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:50.781654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:50.787786 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd2203-153a-49a4-b4e1-498bdfbd402a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:50.874197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6372017-a24d-4a2a-a56c-416a5e4f204c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:50.874817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6372017-a24d-4a2a-a56c-416a5e4f204c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:50.875095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6372017-a24d-4a2a-a56c-416a5e4f204c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:50.875367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6372017-a24d-4a2a-a56c-416a5e4f204c admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:50.876092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6372017-a24d-4a2a-a56c-416a5e4f204c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:50.878642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6372017-a24d-4a2a-a56c-416a5e4f204c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.111245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1118/2244] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:39:50 2022] POST /identity/v3/users => generated 288 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:39:51.115782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf70220-d2e0-4241-833f-57af58e617de admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.136459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf70220-d2e0-4241-833f-57af58e617de admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.142619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c6483-392c-4bdd-a130-18a9983603bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.144089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c6483-392c-4bdd-a130-18a9983603bd admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.144484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c6483-392c-4bdd-a130-18a9983603bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.144972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c6483-392c-4bdd-a130-18a9983603bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.146053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c6483-392c-4bdd-a130-18a9983603bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.148385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c6483-392c-4bdd-a130-18a9983603bd admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.172652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1127/2245] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:51.176101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6372017-a24d-4a2a-a56c-416a5e4f204c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.191436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6372017-a24d-4a2a-a56c-416a5e4f204c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.198704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660444a9-86d9-466d-905f-7e9a70b28290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.199448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660444a9-86d9-466d-905f-7e9a70b28290 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.199842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660444a9-86d9-466d-905f-7e9a70b28290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.200637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660444a9-86d9-466d-905f-7e9a70b28290 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.201542 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660444a9-86d9-466d-905f-7e9a70b28290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.203350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660444a9-86d9-466d-905f-7e9a70b28290 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.229620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1119/2246] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:39:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:39:51.244709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c6483-392c-4bdd-a130-18a9983603bd admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.262882 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c6483-392c-4bdd-a130-18a9983603bd admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.270189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8301c-cc98-4247-befb-b19fe0786313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.271117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8301c-cc98-4247-befb-b19fe0786313 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.271431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8301c-cc98-4247-befb-b19fe0786313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.271773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8301c-cc98-4247-befb-b19fe0786313 admin admin] PATH_INFO: `/v3/projects/7e014ec3be4a40dda59806cc1fc8bdb9/users/d0becc4d85c54d8398744b4c1e4691d0/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.290660 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8301c-cc98-4247-befb-b19fe0786313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e014ec3be4a40dda59806cc1fc8bdb9, user_id=d0becc4d85c54d8398744b4c1e4691d0, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.293815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8301c-cc98-4247-befb-b19fe0786313 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.549085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1128/2247] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:39:51 2022] PUT /identity/v3/projects/7e014ec3be4a40dda59806cc1fc8bdb9/users/d0becc4d85c54d8398744b4c1e4691d0/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:39:51.560653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de81cb-7269-4552-bd18-72e0a31cfcfa None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.561277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de81cb-7269-4552-bd18-72e0a31cfcfa None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.561277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de81cb-7269-4552-bd18-72e0a31cfcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.610347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-25de81cb-7269-4552-bd18-72e0a31cfcfa None None] MFA Rules not processed for user `d0becc4d85c54d8398744b4c1e4691d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:51.612009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-25de81cb-7269-4552-bd18-72e0a31cfcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:51.739893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1120/2248] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:51.754779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8301c-cc98-4247-befb-b19fe0786313 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:51.758976 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-edb8301c-cc98-4247-befb-b19fe0786313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:51.829702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:51.880607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8301c-cc98-4247-befb-b19fe0786313 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:51.888157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370c920-aba4-4e4e-bd0b-73d71d14b40c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:51.891196 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c920-aba4-4e4e-bd0b-73d71d14b40c service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:51.891196 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c920-aba4-4e4e-bd0b-73d71d14b40c service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:51.891196 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370c920-aba4-4e4e-bd0b-73d71d14b40c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:51.912385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370c920-aba4-4e4e-bd0b-73d71d14b40c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:51.914442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370c920-aba4-4e4e-bd0b-73d71d14b40c service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:51.937819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1129/2249] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:39:54.162945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d5a93-1f02-4a79-9e5f-c9d94909c77e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:54.163738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d5a93-1f02-4a79-9e5f-c9d94909c77e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:54.163738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d5a93-1f02-4a79-9e5f-c9d94909c77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:54.190852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-fd4d5a93-1f02-4a79-9e5f-c9d94909c77e None None] MFA Rules not processed for user `d0becc4d85c54d8398744b4c1e4691d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:54.192527 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fd4d5a93-1f02-4a79-9e5f-c9d94909c77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:54.203366 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1121/2250] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:39:57.067976 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93d2d3-bd65-4995-bff0-4df6b242e795 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:57.068732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93d2d3-bd65-4995-bff0-4df6b242e795 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:57.077282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93d2d3-bd65-4995-bff0-4df6b242e795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:57.139881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9b93d2d3-bd65-4995-bff0-4df6b242e795 None None] MFA Rules not processed for user `32dda62d101c4e9b84c624b1f0e5d86b`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:39:57.141808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9b93d2d3-bd65-4995-bff0-4df6b242e795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:57.369918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1130/2251] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:39:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:39:57.401498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d5a93-1f02-4a79-9e5f-c9d94909c77e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:39:57.403024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fd4d5a93-1f02-4a79-9e5f-c9d94909c77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:57.676493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:57.694782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d5a93-1f02-4a79-9e5f-c9d94909c77e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:39:57.704677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e46b59-ffb6-4b1d-b472-c7f89f7ed6f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:39:57.706175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e46b59-ffb6-4b1d-b472-c7f89f7ed6f7 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:39:57.706682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e46b59-ffb6-4b1d-b472-c7f89f7ed6f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:39:57.707188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e46b59-ffb6-4b1d-b472-c7f89f7ed6f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:39:57.712816 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-27e46b59-ffb6-4b1d-b472-c7f89f7ed6f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:39:57.848997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e46b59-ffb6-4b1d-b472-c7f89f7ed6f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:39:57.851007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e46b59-ffb6-4b1d-b472-c7f89f7ed6f7 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:39:57.896952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1122/2252] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:39:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:04.764863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258e52-0b80-4826-98e2-f181b0e677a3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:04.766451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258e52-0b80-4826-98e2-f181b0e677a3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:04.767595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b258e52-0b80-4826-98e2-f181b0e677a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:04.803103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9b258e52-0b80-4826-98e2-f181b0e677a3 None None] MFA Rules not processed for user `7f309d1af48544fcb9891113446a05cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:04.804770 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9b258e52-0b80-4826-98e2-f181b0e677a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:04.814218 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1131/2253] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:40:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:06.899561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccc7b4-6662-4cba-9aae-71945178da54 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:06.900112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccc7b4-6662-4cba-9aae-71945178da54 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:06.900344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccc7b4-6662-4cba-9aae-71945178da54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:06.931359 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ccccc7b4-6662-4cba-9aae-71945178da54 None None] MFA Rules not processed for user `aab3db3757f24ffd9f2e0ab397bbf20d`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:06.934445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ccccc7b4-6662-4cba-9aae-71945178da54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:07.022733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1123/2254] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:40:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:40:08.763494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3623e-c94a-4c37-9224-a0fdb4f72834 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:08.764612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3623e-c94a-4c37-9224-a0fdb4f72834 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:08.765175 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3623e-c94a-4c37-9224-a0fdb4f72834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:08.788534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5ac3623e-c94a-4c37-9224-a0fdb4f72834 None None] MFA Rules not processed for user `67ceab80e8744b478ec9cb93e1b56f5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:08.789639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5ac3623e-c94a-4c37-9224-a0fdb4f72834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:08.845199 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1132/2255] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:40:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:16.585415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdf5ad-ae9c-46b2-bbad-f0694ce8f02e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:16.586265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdf5ad-ae9c-46b2-bbad-f0694ce8f02e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:16.586265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbdf5ad-ae9c-46b2-bbad-f0694ce8f02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:16.609921 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7cbdf5ad-ae9c-46b2-bbad-f0694ce8f02e None None] MFA Rules not processed for user `36ae407308bf4947b1f113f5390db714`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:16.612719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7cbdf5ad-ae9c-46b2-bbad-f0694ce8f02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:16.715253 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1124/2256] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:40:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:18.838460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=76 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:24.644238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54045061-d99b-42ac-b2c4-1168ddbafe48 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:24.645272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54045061-d99b-42ac-b2c4-1168ddbafe48 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:24.645272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54045061-d99b-42ac-b2c4-1168ddbafe48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:24.674406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-54045061-d99b-42ac-b2c4-1168ddbafe48 None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:24.676186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-54045061-d99b-42ac-b2c4-1168ddbafe48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:24.771081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1133/2257] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:40:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:24.994445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdf5ad-ae9c-46b2-bbad-f0694ce8f02e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:24.996068 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7cbdf5ad-ae9c-46b2-bbad-f0694ce8f02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:25.088686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:25.111571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbdf5ad-ae9c-46b2-bbad-f0694ce8f02e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:25.123409 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63fe24-88a0-47cc-9b1a-38d5bde41b87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:25.123745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63fe24-88a0-47cc-9b1a-38d5bde41b87 service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:25.124137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63fe24-88a0-47cc-9b1a-38d5bde41b87 service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:25.124636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63fe24-88a0-47cc-9b1a-38d5bde41b87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:25.138033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63fe24-88a0-47cc-9b1a-38d5bde41b87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:25.139806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63fe24-88a0-47cc-9b1a-38d5bde41b87 service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:25.152303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1125/2258] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:40:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:26.369024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaaf1d-4f6a-4600-a113-c14cfd99160e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:26.369514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaaf1d-4f6a-4600-a113-c14cfd99160e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:26.369604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdaaf1d-4f6a-4600-a113-c14cfd99160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:26.391053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6bdaaf1d-4f6a-4600-a113-c14cfd99160e None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:26.393094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6bdaaf1d-4f6a-4600-a113-c14cfd99160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:26.400192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1134/2259] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 1 16:40:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:26.412608 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63fe24-88a0-47cc-9b1a-38d5bde41b87 service swift] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:26.424213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63fe24-88a0-47cc-9b1a-38d5bde41b87 service swift] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:26.429562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabe3d7-5540-4c1a-a8d6-5ee465e3a775 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:26.430277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabe3d7-5540-4c1a-a8d6-5ee465e3a775 service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:26.430555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabe3d7-5540-4c1a-a8d6-5ee465e3a775 service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:26.430823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabe3d7-5540-4c1a-a8d6-5ee465e3a775 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:26.440814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabe3d7-5540-4c1a-a8d6-5ee465e3a775 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:26.442489 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabe3d7-5540-4c1a-a8d6-5ee465e3a775 service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:26.450837 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1126/2260] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:40:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:27.368819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a60030-3a71-4d01-8c3a-02638fd447bf None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:27.369139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a60030-3a71-4d01-8c3a-02638fd447bf None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:27.370062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a60030-3a71-4d01-8c3a-02638fd447bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:27.407091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-48a60030-3a71-4d01-8c3a-02638fd447bf None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:27.408634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-48a60030-3a71-4d01-8c3a-02638fd447bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:27.434486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1135/2261] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:40:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:27.451266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabe3d7-5540-4c1a-a8d6-5ee465e3a775 service swift] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:27.466004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabe3d7-5540-4c1a-a8d6-5ee465e3a775 service swift] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:27.471370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fa150-45ed-4056-afca-65030cdd06ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:27.471985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa150-45ed-4056-afca-65030cdd06ee service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:27.472240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa150-45ed-4056-afca-65030cdd06ee service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:27.472521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa150-45ed-4056-afca-65030cdd06ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:27.482921 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fa150-45ed-4056-afca-65030cdd06ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:27.486150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fa150-45ed-4056-afca-65030cdd06ee service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:27.496033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1127/2262] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:40:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:28.367146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132a76a-1f06-47b2-8cd2-37194b60b3ae None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:28.367531 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132a76a-1f06-47b2-8cd2-37194b60b3ae None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:28.367699 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132a76a-1f06-47b2-8cd2-37194b60b3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:28.388787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1132a76a-1f06-47b2-8cd2-37194b60b3ae None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:28.389958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1132a76a-1f06-47b2-8cd2-37194b60b3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:28.398655 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1136/2263] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 1 16:40:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:28.411490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fa150-45ed-4056-afca-65030cdd06ee service swift] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:28.424994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fa150-45ed-4056-afca-65030cdd06ee service swift] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:28.448724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76129cdc-e482-4e45-8643-5e6942dcae05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:28.449459 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76129cdc-e482-4e45-8643-5e6942dcae05 service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:28.450181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76129cdc-e482-4e45-8643-5e6942dcae05 service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:28.452012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76129cdc-e482-4e45-8643-5e6942dcae05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:28.476165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76129cdc-e482-4e45-8643-5e6942dcae05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:28.480909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76129cdc-e482-4e45-8643-5e6942dcae05 service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:28.501730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1128/2264] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:40:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:40:31.920279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132a76a-1f06-47b2-8cd2-37194b60b3ae None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:31.988569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132a76a-1f06-47b2-8cd2-37194b60b3ae None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:31.993043 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:31.993698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:31.994005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:31.994328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] PATH_INFO: `/v3/users/d0becc4d85c54d8398744b4c1e4691d0` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:31.995519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0becc4d85c54d8398744b4c1e4691d0)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:31.998559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:32.324058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0becc4d85c54d8398744b4c1e4691d0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:32.334997 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0becc4d85c54d8398744b4c1e4691d0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:32.335831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0becc4d85c54d8398744b4c1e4691d0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:32.431139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0becc4d85c54d8398744b4c1e4691d0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:32.456476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0becc4d85c54d8398744b4c1e4691d0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:32.468056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1137/2265] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:40:31 2022] DELETE /identity/v3/users/d0becc4d85c54d8398744b4c1e4691d0 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:32.470673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37f8e-de90-444e-a977-db8261a84e3a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:32.486236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37f8e-de90-444e-a977-db8261a84e3a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:32.486236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b37f8e-de90-444e-a977-db8261a84e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:32.510118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-58b37f8e-de90-444e-a977-db8261a84e3a None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:32.511676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-58b37f8e-de90-444e-a977-db8261a84e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:32.580147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1129/2266] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:40:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:40:32.590344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:32.592382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:32.600939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:32.665318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592ced6-c2aa-4bda-9893-88d054adc88c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:32.669911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22608f7-19de-4a06-a6b1-8bec85b532dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:32.670712 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22608f7-19de-4a06-a6b1-8bec85b532dd service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:32.671057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22608f7-19de-4a06-a6b1-8bec85b532dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:32.671561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22608f7-19de-4a06-a6b1-8bec85b532dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:32.686586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22608f7-19de-4a06-a6b1-8bec85b532dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:32.689071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22608f7-19de-4a06-a6b1-8bec85b532dd service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:32.700379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1138/2267] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:33.175004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37f8e-de90-444e-a977-db8261a84e3a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:33.175004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-58b37f8e-de90-444e-a977-db8261a84e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:33.184720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b37f8e-de90-444e-a977-db8261a84e3a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:33.191116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:33.191383 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:33.191754 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:33.192029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] PATH_INFO: `/v3/projects/7e014ec3be4a40dda59806cc1fc8bdb9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:33.193181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e014ec3be4a40dda59806cc1fc8bdb9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:33.195244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:33.546172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e014ec3be4a40dda59806cc1fc8bdb9', 'request_id': 'req-1757103a-3d42-47d0-bfec-373469214613'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:33.556788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e014ec3be4a40dda59806cc1fc8bdb9', 'request_id': 'req-1757103a-3d42-47d0-bfec-373469214613'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:33.564588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e014ec3be4a40dda59806cc1fc8bdb9', 'request_id': 'req-1757103a-3d42-47d0-bfec-373469214613'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:33.729172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] The token cache is being invalidate because project 7e014ec3be4a40dda59806cc1fc8bdb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:40:33.745724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:33.745724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:40:33.745724 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1130/2268] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:40:33 2022] DELETE /identity/v3/projects/7e014ec3be4a40dda59806cc1fc8bdb9 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:40:39.857486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d92f2-7a6f-4ac0-8f7e-19fce716caf7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:39.861914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d92f2-7a6f-4ac0-8f7e-19fce716caf7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:39.862456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d92f2-7a6f-4ac0-8f7e-19fce716caf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:39.897934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-906d92f2-7a6f-4ac0-8f7e-19fce716caf7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:39.900103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-906d92f2-7a6f-4ac0-8f7e-19fce716caf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:40.018528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1139/2269] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Sep 1 16:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:40.040407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:40.044556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:40.106222 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:40.202454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757103a-3d42-47d0-bfec-373469214613 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:40.211213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a259-bf69-4ae8-84ee-cd508c3cb9ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:40.215875 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a259-bf69-4ae8-84ee-cd508c3cb9ca service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:40.215875 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a259-bf69-4ae8-84ee-cd508c3cb9ca service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:40.215875 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a259-bf69-4ae8-84ee-cd508c3cb9ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:40.227583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0a259-bf69-4ae8-84ee-cd508c3cb9ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:40.229502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0a259-bf69-4ae8-84ee-cd508c3cb9ca service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:40.242914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1131/2270] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:41.777066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d92f2-7a6f-4ac0-8f7e-19fce716caf7 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:41.779168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-906d92f2-7a6f-4ac0-8f7e-19fce716caf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:41.864973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d92f2-7a6f-4ac0-8f7e-19fce716caf7 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:41.871823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad450525-5bad-4647-950c-61a489ec2f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:41.872611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad450525-5bad-4647-950c-61a489ec2f18 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:41.873057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad450525-5bad-4647-950c-61a489ec2f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:41.873500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad450525-5bad-4647-950c-61a489ec2f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:41.876690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ad450525-5bad-4647-950c-61a489ec2f18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:41.901752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad450525-5bad-4647-950c-61a489ec2f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:41.904092 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad450525-5bad-4647-950c-61a489ec2f18 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:41.918416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1140/2271] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:43.150198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a259-bf69-4ae8-84ee-cd508c3cb9ca service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:43.151711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c2e0a259-bf69-4ae8-84ee-cd508c3cb9ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:43.152050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112650c-54c2-4548-b168-c23bd81c9def None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:43.152504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112650c-54c2-4548-b168-c23bd81c9def None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:43.152833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112650c-54c2-4548-b168-c23bd81c9def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:43.166848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a259-bf69-4ae8-84ee-cd508c3cb9ca service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:43.171643 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6745bbd-6909-47bf-8aa2-cf7851a5a080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:43.172721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6745bbd-6909-47bf-8aa2-cf7851a5a080 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:43.173686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6745bbd-6909-47bf-8aa2-cf7851a5a080 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:43.173686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6745bbd-6909-47bf-8aa2-cf7851a5a080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:43.175462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a6745bbd-6909-47bf-8aa2-cf7851a5a080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:43.177588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e112650c-54c2-4548-b168-c23bd81c9def None None] MFA Rules not processed for user `c33b81f98c4e4e919d60f408ad24e594`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:43.178835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e112650c-54c2-4548-b168-c23bd81c9def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:43.192494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6745bbd-6909-47bf-8aa2-cf7851a5a080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:43.194042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6745bbd-6909-47bf-8aa2-cf7851a5a080 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:43.208488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1132/2272] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:43.250115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:43.266477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1141/2273] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:40:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:43.583980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6745bbd-6909-47bf-8aa2-cf7851a5a080 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:43.596452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6745bbd-6909-47bf-8aa2-cf7851a5a080 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:43.605257 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b159e-4e2c-40dd-8150-9f78077b35b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:43.606078 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b159e-4e2c-40dd-8150-9f78077b35b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:43.606404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b159e-4e2c-40dd-8150-9f78077b35b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:43.606881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b159e-4e2c-40dd-8150-9f78077b35b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:43.609972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c78b159e-4e2c-40dd-8150-9f78077b35b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:43.705391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b159e-4e2c-40dd-8150-9f78077b35b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:43.707119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b159e-4e2c-40dd-8150-9f78077b35b2 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:43.717910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1133/2274] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:46.443014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbc3c1-d3de-4977-af61-543ffac7c0b7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:46.443576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbc3c1-d3de-4977-af61-543ffac7c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:46.443576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cbc3c1-d3de-4977-af61-543ffac7c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:46.465852 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-10cbc3c1-d3de-4977-af61-543ffac7c0b7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:46.467078 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-10cbc3c1-d3de-4977-af61-543ffac7c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:46.479962 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1142/2275] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Sep 1 16:40:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:46.496551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b159e-4e2c-40dd-8150-9f78077b35b2 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:46.545161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b159e-4e2c-40dd-8150-9f78077b35b2 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:46.555806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf947427-58b6-4472-ae44-6239f2e9c29c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:46.557004 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf947427-58b6-4472-ae44-6239f2e9c29c service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:46.557544 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf947427-58b6-4472-ae44-6239f2e9c29c service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:46.557986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf947427-58b6-4472-ae44-6239f2e9c29c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:46.570545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf947427-58b6-4472-ae44-6239f2e9c29c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:46.572148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf947427-58b6-4472-ae44-6239f2e9c29c service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:46.584327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1134/2276] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:50.459100 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caa2cf-1bf6-42b9-83b7-a26590ed6ad6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:50.459952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caa2cf-1bf6-42b9-83b7-a26590ed6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:50.459952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95caa2cf-1bf6-42b9-83b7-a26590ed6ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:50.492879 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-95caa2cf-1bf6-42b9-83b7-a26590ed6ad6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:50.495187 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-95caa2cf-1bf6-42b9-83b7-a26590ed6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:50.510203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1143/2277] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Sep 1 16:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:50.535327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf947427-58b6-4472-ae44-6239f2e9c29c service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:50.535327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bf947427-58b6-4472-ae44-6239f2e9c29c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:50.549722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf947427-58b6-4472-ae44-6239f2e9c29c service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:50.555789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c1102-7417-4131-800e-7f764816ff3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:50.556407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1102-7417-4131-800e-7f764816ff3b service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:50.556686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1102-7417-4131-800e-7f764816ff3b service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:50.556960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c1102-7417-4131-800e-7f764816ff3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:50.570124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c1102-7417-4131-800e-7f764816ff3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:50.571856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c1102-7417-4131-800e-7f764816ff3b service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:50.583353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1135/2278] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:54.751293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bac79-55e7-4d6b-8b1d-b0bf65818e93 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:54.751834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bac79-55e7-4d6b-8b1d-b0bf65818e93 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:54.751834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bac79-55e7-4d6b-8b1d-b0bf65818e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:54.772819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e79bac79-55e7-4d6b-8b1d-b0bf65818e93 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:54.774058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e79bac79-55e7-4d6b-8b1d-b0bf65818e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:54.782780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1144/2279] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Sep 1 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:54.804736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c1102-7417-4131-800e-7f764816ff3b service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:54.816619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c1102-7417-4131-800e-7f764816ff3b service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:54.822243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc8059-fe87-49d9-b68f-0dd746a7a366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:54.826834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc8059-fe87-49d9-b68f-0dd746a7a366 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:54.826834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc8059-fe87-49d9-b68f-0dd746a7a366 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:54.826834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc8059-fe87-49d9-b68f-0dd746a7a366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:54.832453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc8059-fe87-49d9-b68f-0dd746a7a366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:54.834070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc8059-fe87-49d9-b68f-0dd746a7a366 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:54.851288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1136/2280] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:40:59.304424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adff6-b654-4a3c-addb-42c9e436ae52 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:59.304424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adff6-b654-4a3c-addb-42c9e436ae52 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:59.304424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adff6-b654-4a3c-addb-42c9e436ae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:59.316409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-237adff6-b654-4a3c-addb-42c9e436ae52 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:40:59.317703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-237adff6-b654-4a3c-addb-42c9e436ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:40:59.326083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1145/2281] 10.222.0.17 () {58 vars in 1016 bytes} [Thu Sep 1 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:40:59.341745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc8059-fe87-49d9-b68f-0dd746a7a366 service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:40:59.354422 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc8059-fe87-49d9-b68f-0dd746a7a366 service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:40:59.360976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a90547-4550-4c8b-ae28-3d38b4faf89a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:40:59.361659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90547-4550-4c8b-ae28-3d38b4faf89a service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:40:59.362041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90547-4550-4c8b-ae28-3d38b4faf89a service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:40:59.362388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90547-4550-4c8b-ae28-3d38b4faf89a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:40:59.371035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a90547-4550-4c8b-ae28-3d38b4faf89a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:40:59.372633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a90547-4550-4c8b-ae28-3d38b4faf89a service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:40:59.383930 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1137/2282] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:00.270623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237adff6-b654-4a3c-addb-42c9e436ae52 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:00.272589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-237adff6-b654-4a3c-addb-42c9e436ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:00.346931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237adff6-b654-4a3c-addb-42c9e436ae52 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:00.351134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68765e5-c4af-4338-bf87-5bd56c076e3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:00.352123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68765e5-c4af-4338-bf87-5bd56c076e3c service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:00.352123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68765e5-c4af-4338-bf87-5bd56c076e3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:00.352455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68765e5-c4af-4338-bf87-5bd56c076e3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:00.354828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b68765e5-c4af-4338-bf87-5bd56c076e3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:00.428964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68765e5-c4af-4338-bf87-5bd56c076e3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:00.430476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68765e5-c4af-4338-bf87-5bd56c076e3c service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:00.450215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1146/2283] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:01.439528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a90547-4550-4c8b-ae28-3d38b4faf89a service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:01.451149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a90547-4550-4c8b-ae28-3d38b4faf89a service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:01.457495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86be1c0-3d77-4cf3-b1f9-300250b1e80f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:01.458130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be1c0-3d77-4cf3-b1f9-300250b1e80f service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:01.476468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be1c0-3d77-4cf3-b1f9-300250b1e80f service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:01.476468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86be1c0-3d77-4cf3-b1f9-300250b1e80f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:01.476468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c86be1c0-3d77-4cf3-b1f9-300250b1e80f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:01.496980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:01.524082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86be1c0-3d77-4cf3-b1f9-300250b1e80f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:01.525686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86be1c0-3d77-4cf3-b1f9-300250b1e80f service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:01.536624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1138/2284] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:05.354995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68765e5-c4af-4338-bf87-5bd56c076e3c service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:05.370547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68765e5-c4af-4338-bf87-5bd56c076e3c service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:05.377263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968a80c-b0f2-4eab-a9c3-37efd0aa23b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:05.378112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968a80c-b0f2-4eab-a9c3-37efd0aa23b3 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:05.378392 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968a80c-b0f2-4eab-a9c3-37efd0aa23b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:05.378664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968a80c-b0f2-4eab-a9c3-37efd0aa23b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:05.380485 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3968a80c-b0f2-4eab-a9c3-37efd0aa23b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:05.392676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968a80c-b0f2-4eab-a9c3-37efd0aa23b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:05.394349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968a80c-b0f2-4eab-a9c3-37efd0aa23b3 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:05.404322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1147/2285] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:11.613128 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=11 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:15.399728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=68 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:18.694670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86be1c0-3d77-4cf3-b1f9-300250b1e80f service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:18.708353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86be1c0-3d77-4cf3-b1f9-300250b1e80f service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:18.712147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da34b25-8932-42ec-aefc-09538e20ec5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:18.712768 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34b25-8932-42ec-aefc-09538e20ec5f service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:18.713089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34b25-8932-42ec-aefc-09538e20ec5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:18.713365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34b25-8932-42ec-aefc-09538e20ec5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:18.715351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2da34b25-8932-42ec-aefc-09538e20ec5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:18.727633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da34b25-8932-42ec-aefc-09538e20ec5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:18.729120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da34b25-8932-42ec-aefc-09538e20ec5f service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:18.740172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1139/2286] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:27.562824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968a80c-b0f2-4eab-a9c3-37efd0aa23b3 service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:27.584212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968a80c-b0f2-4eab-a9c3-37efd0aa23b3 service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:27.584212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8d8e8-7b06-4ad2-99c4-9c9dff15b844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:27.587768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8d8e8-7b06-4ad2-99c4-9c9dff15b844 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:27.588265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8d8e8-7b06-4ad2-99c4-9c9dff15b844 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:27.588728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8d8e8-7b06-4ad2-99c4-9c9dff15b844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:27.590835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bac8d8e8-7b06-4ad2-99c4-9c9dff15b844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:27.608682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8d8e8-7b06-4ad2-99c4-9c9dff15b844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:27.611609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8d8e8-7b06-4ad2-99c4-9c9dff15b844 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:27.625555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1148/2287] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:28.734386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=6 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:34.447549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da34b25-8932-42ec-aefc-09538e20ec5f service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:34.456628 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da34b25-8932-42ec-aefc-09538e20ec5f service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:34.460552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa21a28-681b-4743-bb71-7d294c5272b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:34.461150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21a28-681b-4743-bb71-7d294c5272b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:34.461429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21a28-681b-4743-bb71-7d294c5272b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:34.461706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa21a28-681b-4743-bb71-7d294c5272b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:34.463648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5aa21a28-681b-4743-bb71-7d294c5272b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:34.477625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa21a28-681b-4743-bb71-7d294c5272b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:34.479072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa21a28-681b-4743-bb71-7d294c5272b9 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:34.489760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1140/2288] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:34.935378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8d8e8-7b06-4ad2-99c4-9c9dff15b844 service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:34.947203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8d8e8-7b06-4ad2-99c4-9c9dff15b844 service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:34.953731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054deef2-de9e-42df-9c93-69c9daed99c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:34.954389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054deef2-de9e-42df-9c93-69c9daed99c5 service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:34.954669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054deef2-de9e-42df-9c93-69c9daed99c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:34.954933 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054deef2-de9e-42df-9c93-69c9daed99c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:34.957010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-054deef2-de9e-42df-9c93-69c9daed99c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:35.022181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054deef2-de9e-42df-9c93-69c9daed99c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:35.023966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054deef2-de9e-42df-9c93-69c9daed99c5 service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:35.035072 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1149/2289] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:38.123857 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdfdbb-f8ea-4a58-94a6-99ec7efa7a8a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:38.124385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdfdbb-f8ea-4a58-94a6-99ec7efa7a8a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:38.124475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdfdbb-f8ea-4a58-94a6-99ec7efa7a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:38.146823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e0fdfdbb-f8ea-4a58-94a6-99ec7efa7a8a None None] MFA Rules not processed for user `b1628c4903b34a219d19e01bf73e0b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:38.147980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e0fdfdbb-f8ea-4a58-94a6-99ec7efa7a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:38.156464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1141/2290] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:38.572925 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054deef2-de9e-42df-9c93-69c9daed99c5 service nova] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:38.585787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054deef2-de9e-42df-9c93-69c9daed99c5 service nova] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:38.590060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4442533-bdc2-4847-b708-a72b79f9d11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:38.590926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4442533-bdc2-4847-b708-a72b79f9d11f service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:38.591399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4442533-bdc2-4847-b708-a72b79f9d11f service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:38.592035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4442533-bdc2-4847-b708-a72b79f9d11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:38.594671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e4442533-bdc2-4847-b708-a72b79f9d11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:38.608591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4442533-bdc2-4847-b708-a72b79f9d11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:38.613000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4442533-bdc2-4847-b708-a72b79f9d11f service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:38.623590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1150/2291] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:39.228677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdfdbb-f8ea-4a58-94a6-99ec7efa7a8a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:39.230652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e0fdfdbb-f8ea-4a58-94a6-99ec7efa7a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:39.317186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4442533-bdc2-4847-b708-a72b79f9d11f service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:39.319860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e4442533-bdc2-4847-b708-a72b79f9d11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:39.322997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdfdbb-f8ea-4a58-94a6-99ec7efa7a8a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:39.331068 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdf9ea-a2be-4627-9240-7b86d85ffd84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d15478ca864f49aae2301e2328fe23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:39.331738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdf9ea-a2be-4627-9240-7b86d85ffd84 service placement] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:39.333248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdf9ea-a2be-4627-9240-7b86d85ffd84 service placement] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:39.333248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdf9ea-a2be-4627-9240-7b86d85ffd84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:39.336250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e6bdf9ea-a2be-4627-9240-7b86d85ffd84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:39.339422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4442533-bdc2-4847-b708-a72b79f9d11f service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:39.346617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e787392-4ac9-416f-bbc4-8d7a6814cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:39.348583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e787392-4ac9-416f-bbc4-8d7a6814cdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:39.351417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e787392-4ac9-416f-bbc4-8d7a6814cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:39.352068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e787392-4ac9-416f-bbc4-8d7a6814cdfb admin admin] PATH_INFO: `/v3/users/67ceab80e8744b478ec9cb93e1b56f5f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:39.353240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bdf9ea-a2be-4627-9240-7b86d85ffd84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:39.354961 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bdf9ea-a2be-4627-9240-7b86d85ffd84 service placement] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:39.355448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e787392-4ac9-416f-bbc4-8d7a6814cdfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ceab80e8744b478ec9cb93e1b56f5f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:39.357394 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e787392-4ac9-416f-bbc4-8d7a6814cdfb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:39.366662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1142/2292] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:39.720019 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5e787392-4ac9-416f-bbc4-8d7a6814cdfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ceab80e8744b478ec9cb93e1b56f5f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:39.727703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5e787392-4ac9-416f-bbc4-8d7a6814cdfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ceab80e8744b478ec9cb93e1b56f5f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:39.728393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5e787392-4ac9-416f-bbc4-8d7a6814cdfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ceab80e8744b478ec9cb93e1b56f5f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:39.807648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5e787392-4ac9-416f-bbc4-8d7a6814cdfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ceab80e8744b478ec9cb93e1b56f5f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:39.823035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5e787392-4ac9-416f-bbc4-8d7a6814cdfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ceab80e8744b478ec9cb93e1b56f5f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:39.830737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1151/2293] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:41:39 2022] DELETE /identity/v3/users/67ceab80e8744b478ec9cb93e1b56f5f => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:41:40.143148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdf9ea-a2be-4627-9240-7b86d85ffd84 service placement] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:40.149611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdf9ea-a2be-4627-9240-7b86d85ffd84 service placement] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:40.229452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:40.230229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:40.230490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:40.230774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] PATH_INFO: `/v3/projects/f89012e15d0441a8b9c2d76042c3756c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:40.232079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89012e15d0441a8b9c2d76042c3756c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:40.238016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:40.388501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89012e15d0441a8b9c2d76042c3756c', 'request_id': 'req-cfc828b4-d22c-4b33-b5a5-82d274dd942d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:40.395899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89012e15d0441a8b9c2d76042c3756c', 'request_id': 'req-cfc828b4-d22c-4b33-b5a5-82d274dd942d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:40.401855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89012e15d0441a8b9c2d76042c3756c', 'request_id': 'req-cfc828b4-d22c-4b33-b5a5-82d274dd942d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:40.522178 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:40.526447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] The token cache is being invalidate because project f89012e15d0441a8b9c2d76042c3756c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:41:40.526759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:40.527387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cfc828b4-d22c-4b33-b5a5-82d274dd942d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:40.529180 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1143/2294] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:41:40 2022] DELETE /identity/v3/projects/f89012e15d0441a8b9c2d76042c3756c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:40.534856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14443f-fa5e-4398-8d43-3f222a1a7839 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:40.535143 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14443f-fa5e-4398-8d43-3f222a1a7839 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:40.535419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b14443f-fa5e-4398-8d43-3f222a1a7839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:40.562226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-2b14443f-fa5e-4398-8d43-3f222a1a7839 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:40.562226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2b14443f-fa5e-4398-8d43-3f222a1a7839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:40.606315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:40.630316 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1152/2295] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:40.638235 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92af5d2-24d3-4144-83bc-a18ca621894f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:40.638525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92af5d2-24d3-4144-83bc-a18ca621894f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:40.638809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92af5d2-24d3-4144-83bc-a18ca621894f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:40.660324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c92af5d2-24d3-4144-83bc-a18ca621894f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:40.661572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c92af5d2-24d3-4144-83bc-a18ca621894f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:40.669746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1144/2296] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:40.676953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14443f-fa5e-4398-8d43-3f222a1a7839 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:40.694788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b14443f-fa5e-4398-8d43-3f222a1a7839 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:40.701042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c610eca-cf3f-4956-8c8d-89b41613cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:40.701939 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610eca-cf3f-4956-8c8d-89b41613cf49 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:40.705017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610eca-cf3f-4956-8c8d-89b41613cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:40.705017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c610eca-cf3f-4956-8c8d-89b41613cf49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:40.705017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c610eca-cf3f-4956-8c8d-89b41613cf49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:41:40.705017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c610eca-cf3f-4956-8c8d-89b41613cf49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:40.706875 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c610eca-cf3f-4956-8c8d-89b41613cf49 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:40.733147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1153/2297] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:41:40.739169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92af5d2-24d3-4144-83bc-a18ca621894f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:40.753018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92af5d2-24d3-4144-83bc-a18ca621894f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:40.759433 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995f2d3-7447-4999-aeb1-6a44d2516f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:40.760065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995f2d3-7447-4999-aeb1-6a44d2516f62 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:40.760348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995f2d3-7447-4999-aeb1-6a44d2516f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:40.760618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995f2d3-7447-4999-aeb1-6a44d2516f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:40.761297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995f2d3-7447-4999-aeb1-6a44d2516f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:40.763323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995f2d3-7447-4999-aeb1-6a44d2516f62 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:40.935486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1145/2298] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:40 2022] POST /identity/v3/projects => generated 363 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:40.941158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c610eca-cf3f-4956-8c8d-89b41613cf49 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:40.955360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c610eca-cf3f-4956-8c8d-89b41613cf49 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:41.035598 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0c519-bd25-47c5-a621-993bd775d6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:41.036217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c519-bd25-47c5-a621-993bd775d6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:41.036512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c519-bd25-47c5-a621-993bd775d6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:41.036776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0c519-bd25-47c5-a621-993bd775d6d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:41.037416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0c519-bd25-47c5-a621-993bd775d6d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:41.039425 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d0c519-bd25-47c5-a621-993bd775d6d2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:41.149183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1154/2299] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:40 2022] POST /identity/v3/users => generated 282 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:41.157023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995f2d3-7447-4999-aeb1-6a44d2516f62 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:41.166027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995f2d3-7447-4999-aeb1-6a44d2516f62 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:41.171315 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d23e67-303e-45e5-9cc0-a0ee66c71957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:41.171954 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d23e67-303e-45e5-9cc0-a0ee66c71957 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:41.172231 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d23e67-303e-45e5-9cc0-a0ee66c71957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:41.173354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d23e67-303e-45e5-9cc0-a0ee66c71957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:41.173354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d23e67-303e-45e5-9cc0-a0ee66c71957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:41.174757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d23e67-303e-45e5-9cc0-a0ee66c71957 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:41.185291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1146/2300] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:41.189565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0c519-bd25-47c5-a621-993bd775d6d2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:41.199530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d0c519-bd25-47c5-a621-993bd775d6d2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:41.204761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecba542-63fc-4ae9-8521-93c60cb43308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:41.205368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba542-63fc-4ae9-8521-93c60cb43308 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:41.205643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba542-63fc-4ae9-8521-93c60cb43308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:41.205935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecba542-63fc-4ae9-8521-93c60cb43308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:41.206575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecba542-63fc-4ae9-8521-93c60cb43308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:41.208151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecba542-63fc-4ae9-8521-93c60cb43308 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:41.220227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1155/2301] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:41:41.227058 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d23e67-303e-45e5-9cc0-a0ee66c71957 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:41.239442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d23e67-303e-45e5-9cc0-a0ee66c71957 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:41.250184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9b915-0ed8-41ee-bf8a-83b049dffc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:41.250184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9b915-0ed8-41ee-bf8a-83b049dffc80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:41.250184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9b915-0ed8-41ee-bf8a-83b049dffc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:41.250184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9b915-0ed8-41ee-bf8a-83b049dffc80 admin admin] PATH_INFO: `/v3/projects/5d4ba755396247bdabdf172c09017eea/users/3b526fd74b36410398fcbb5385207878/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:41.269374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9b915-0ed8-41ee-bf8a-83b049dffc80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4ba755396247bdabdf172c09017eea, user_id=3b526fd74b36410398fcbb5385207878, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:41.272098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9b915-0ed8-41ee-bf8a-83b049dffc80 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:41.403464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1147/2302] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:41 2022] PUT /identity/v3/projects/5d4ba755396247bdabdf172c09017eea/users/3b526fd74b36410398fcbb5385207878/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:41.426503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03d351-028e-4ec2-80a2-8a0f206094bb None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:41.427042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03d351-028e-4ec2-80a2-8a0f206094bb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:41.427495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03d351-028e-4ec2-80a2-8a0f206094bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:41.503089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-cb03d351-028e-4ec2-80a2-8a0f206094bb None None] MFA Rules not processed for user `3b526fd74b36410398fcbb5385207878`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:41.504671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cb03d351-028e-4ec2-80a2-8a0f206094bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:41.618358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1156/2303] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:41.626171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9b915-0ed8-41ee-bf8a-83b049dffc80 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:41.704031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9b915-0ed8-41ee-bf8a-83b049dffc80 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:41.718745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce29a0d-72fc-4393-b0cb-5fd65667cd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:41.718745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce29a0d-72fc-4393-b0cb-5fd65667cd0d admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:41.718745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce29a0d-72fc-4393-b0cb-5fd65667cd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:41.718745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce29a0d-72fc-4393-b0cb-5fd65667cd0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:41.719122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce29a0d-72fc-4393-b0cb-5fd65667cd0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:41.719122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce29a0d-72fc-4393-b0cb-5fd65667cd0d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:41.894880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1148/2304] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:41 2022] POST /identity/v3/projects => generated 363 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:41.899181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03d351-028e-4ec2-80a2-8a0f206094bb None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:41.915950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03d351-028e-4ec2-80a2-8a0f206094bb None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:41.978784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4204375-6983-48e6-801e-4e4575e76dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:41.979742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4204375-6983-48e6-801e-4e4575e76dce admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:41.980246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4204375-6983-48e6-801e-4e4575e76dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:41.980727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4204375-6983-48e6-801e-4e4575e76dce admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:41.981891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4204375-6983-48e6-801e-4e4575e76dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:41.985830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4204375-6983-48e6-801e-4e4575e76dce admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:42.148028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1157/2305] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:41 2022] POST /identity/v3/users => generated 288 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:41:42.155434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce29a0d-72fc-4393-b0cb-5fd65667cd0d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:42.163222 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce29a0d-72fc-4393-b0cb-5fd65667cd0d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:42.168830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087696cf-79c4-40a2-b7f4-9b479f0f0b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:42.169449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087696cf-79c4-40a2-b7f4-9b479f0f0b01 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:42.169759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087696cf-79c4-40a2-b7f4-9b479f0f0b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:42.170070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087696cf-79c4-40a2-b7f4-9b479f0f0b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:42.170722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087696cf-79c4-40a2-b7f4-9b479f0f0b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:42.173051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087696cf-79c4-40a2-b7f4-9b479f0f0b01 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:42.184506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1149/2306] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:42.189525 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4204375-6983-48e6-801e-4e4575e76dce admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:42.200953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4204375-6983-48e6-801e-4e4575e76dce admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:42.212975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc315aa5-0312-4b03-8972-59f3be7dc8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:42.213665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc315aa5-0312-4b03-8972-59f3be7dc8fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:42.213979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc315aa5-0312-4b03-8972-59f3be7dc8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:42.214258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc315aa5-0312-4b03-8972-59f3be7dc8fc admin admin] PATH_INFO: `/v3/projects/925ff72a789348e2b0d501ce8043aaf0/users/cc815463ed5b400182aeef2bb5dccd4d/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:42.230957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc315aa5-0312-4b03-8972-59f3be7dc8fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=925ff72a789348e2b0d501ce8043aaf0, user_id=cc815463ed5b400182aeef2bb5dccd4d, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:42.233673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc315aa5-0312-4b03-8972-59f3be7dc8fc admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:42.392314 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1158/2307] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:42 2022] PUT /identity/v3/projects/925ff72a789348e2b0d501ce8043aaf0/users/cc815463ed5b400182aeef2bb5dccd4d/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:42.396539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087696cf-79c4-40a2-b7f4-9b479f0f0b01 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:42.407836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087696cf-79c4-40a2-b7f4-9b479f0f0b01 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:42.485352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40919291-f60c-4054-8122-5626ceda56c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:42.486538 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40919291-f60c-4054-8122-5626ceda56c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:42.487017 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40919291-f60c-4054-8122-5626ceda56c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:42.487473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40919291-f60c-4054-8122-5626ceda56c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:42.488349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40919291-f60c-4054-8122-5626ceda56c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:42.490130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40919291-f60c-4054-8122-5626ceda56c5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:42.492698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:42.511406 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1150/2308] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:42.518021 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc315aa5-0312-4b03-8972-59f3be7dc8fc admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:42.530068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc315aa5-0312-4b03-8972-59f3be7dc8fc admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:42.536455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f550fcd-929e-4dbb-abe3-4c59d26b68d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:42.537464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f550fcd-929e-4dbb-abe3-4c59d26b68d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:42.537902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f550fcd-929e-4dbb-abe3-4c59d26b68d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:42.538210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f550fcd-929e-4dbb-abe3-4c59d26b68d2 admin admin] PATH_INFO: `/v3/projects/925ff72a789348e2b0d501ce8043aaf0/users/cc815463ed5b400182aeef2bb5dccd4d/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:42.540300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f550fcd-929e-4dbb-abe3-4c59d26b68d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925ff72a789348e2b0d501ce8043aaf0, user_id=cc815463ed5b400182aeef2bb5dccd4d, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:42.543342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f550fcd-929e-4dbb-abe3-4c59d26b68d2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:42.590945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1159/2309] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:42 2022] PUT /identity/v3/projects/925ff72a789348e2b0d501ce8043aaf0/users/cc815463ed5b400182aeef2bb5dccd4d/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:42.593656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920933ce-3ed5-43ce-b000-8670734d6c98 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:42.594720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920933ce-3ed5-43ce-b000-8670734d6c98 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:42.595347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920933ce-3ed5-43ce-b000-8670734d6c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:42.616340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:42.643493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-920933ce-3ed5-43ce-b000-8670734d6c98 None None] MFA Rules not processed for user `cc815463ed5b400182aeef2bb5dccd4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:42.645457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-920933ce-3ed5-43ce-b000-8670734d6c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:42.745024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1151/2310] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:42.769634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f550fcd-929e-4dbb-abe3-4c59d26b68d2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:42.771832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9f550fcd-929e-4dbb-abe3-4c59d26b68d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:42.841264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f550fcd-929e-4dbb-abe3-4c59d26b68d2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:42.847343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf070f-05ee-45ea-95f6-82ee97c24d95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:42.848030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf070f-05ee-45ea-95f6-82ee97c24d95 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:42.848313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf070f-05ee-45ea-95f6-82ee97c24d95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:42.848580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf070f-05ee-45ea-95f6-82ee97c24d95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:42.858725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf070f-05ee-45ea-95f6-82ee97c24d95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:42.860566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf070f-05ee-45ea-95f6-82ee97c24d95 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:42.871382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1160/2311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:44.150411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920933ce-3ed5-43ce-b000-8670734d6c98 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:44.257008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920933ce-3ed5-43ce-b000-8670734d6c98 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:44.272022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:44.274915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:44.275212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:44.275658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] PATH_INFO: `/v3/users/3b526fd74b36410398fcbb5385207878` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:44.277406 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b526fd74b36410398fcbb5385207878)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:44.279594 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:44.556233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b526fd74b36410398fcbb5385207878'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:44.564249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b526fd74b36410398fcbb5385207878'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:44.565312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b526fd74b36410398fcbb5385207878'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:44.693813 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b526fd74b36410398fcbb5385207878'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:44.694726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b526fd74b36410398fcbb5385207878'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:44.723418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1152/2312] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:41:44 2022] DELETE /identity/v3/users/3b526fd74b36410398fcbb5385207878 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:44.725047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361db2-357f-4eae-9617-c054829eefd6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:44.725623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361db2-357f-4eae-9617-c054829eefd6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:44.725623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e361db2-357f-4eae-9617-c054829eefd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:44.749374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1e361db2-357f-4eae-9617-c054829eefd6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:44.750859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1e361db2-357f-4eae-9617-c054829eefd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:44.821448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1161/2313] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:44.833426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:44.835262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:44.852003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:44.899734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3aea5-c3d1-4760-9168-8a5b3df19cc9 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:44.903362 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19787b5-5f18-479f-b545-be27569df1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:44.903966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19787b5-5f18-479f-b545-be27569df1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:44.904242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19787b5-5f18-479f-b545-be27569df1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:44.904512 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19787b5-5f18-479f-b545-be27569df1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:44.914614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19787b5-5f18-479f-b545-be27569df1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:44.916040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19787b5-5f18-479f-b545-be27569df1f5 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:44.925941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1153/2314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:45.775530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361db2-357f-4eae-9617-c054829eefd6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:45.777087 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1e361db2-357f-4eae-9617-c054829eefd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:45.790519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e361db2-357f-4eae-9617-c054829eefd6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:45.796858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:45.797767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:45.798151 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:45.798426 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] PATH_INFO: `/v3/projects/5d4ba755396247bdabdf172c09017eea` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:45.799643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4ba755396247bdabdf172c09017eea)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:45.801793 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:45.935546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:45.958755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4ba755396247bdabdf172c09017eea', 'request_id': 'req-81f10f9c-e6bc-4c47-b053-16ed3c020ace'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:45.966262 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4ba755396247bdabdf172c09017eea', 'request_id': 'req-81f10f9c-e6bc-4c47-b053-16ed3c020ace'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.082144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4ba755396247bdabdf172c09017eea', 'request_id': 'req-81f10f9c-e6bc-4c47-b053-16ed3c020ace'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.096466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] The token cache is being invalidate because project 5d4ba755396247bdabdf172c09017eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:41:46.096757 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.097428 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.099270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1162/2315] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:41:45 2022] DELETE /identity/v3/projects/5d4ba755396247bdabdf172c09017eea => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:46.103170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19787b5-5f18-479f-b545-be27569df1f5 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:46.114384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19787b5-5f18-479f-b545-be27569df1f5 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:46.175094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd328c-e6cd-4d01-bb76-cb997e02e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:46.175739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd328c-e6cd-4d01-bb76-cb997e02e3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:46.179032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd328c-e6cd-4d01-bb76-cb997e02e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:46.179032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd328c-e6cd-4d01-bb76-cb997e02e3a9 admin admin] PATH_INFO: `/v3/users/cc815463ed5b400182aeef2bb5dccd4d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:46.179032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd328c-e6cd-4d01-bb76-cb997e02e3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc815463ed5b400182aeef2bb5dccd4d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:46.179563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd328c-e6cd-4d01-bb76-cb997e02e3a9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:46.484550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-25dd328c-e6cd-4d01-bb76-cb997e02e3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc815463ed5b400182aeef2bb5dccd4d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.491514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-25dd328c-e6cd-4d01-bb76-cb997e02e3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc815463ed5b400182aeef2bb5dccd4d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.492196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-25dd328c-e6cd-4d01-bb76-cb997e02e3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc815463ed5b400182aeef2bb5dccd4d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.608075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-25dd328c-e6cd-4d01-bb76-cb997e02e3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc815463ed5b400182aeef2bb5dccd4d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.609418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-25dd328c-e6cd-4d01-bb76-cb997e02e3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc815463ed5b400182aeef2bb5dccd4d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:46.634959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1154/2316] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:41:46 2022] DELETE /identity/v3/users/cc815463ed5b400182aeef2bb5dccd4d => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:41:47.329663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:47.331224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:47.346928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f10f9c-e6bc-4c47-b053-16ed3c020ace admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:47.446459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:47.448560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:47.450103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:47.450103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] PATH_INFO: `/v3/projects/925ff72a789348e2b0d501ce8043aaf0` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:47.450748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=925ff72a789348e2b0d501ce8043aaf0)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:47.453504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:47.667317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925ff72a789348e2b0d501ce8043aaf0', 'request_id': 'req-9be3e526-dc3d-402c-830e-a7caed3425a0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:47.675825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925ff72a789348e2b0d501ce8043aaf0', 'request_id': 'req-9be3e526-dc3d-402c-830e-a7caed3425a0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:47.801573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925ff72a789348e2b0d501ce8043aaf0', 'request_id': 'req-9be3e526-dc3d-402c-830e-a7caed3425a0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:47.814327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] The token cache is being invalidate because project 925ff72a789348e2b0d501ce8043aaf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:41:47.814620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:47.815326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9be3e526-dc3d-402c-830e-a7caed3425a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:47.816894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1163/2317] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:41:47 2022] DELETE /identity/v3/projects/925ff72a789348e2b0d501ce8043aaf0 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:47.824618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad4614-0242-4c79-9e9c-c5ffb9c14092 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:47.825130 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad4614-0242-4c79-9e9c-c5ffb9c14092 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:47.825446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad4614-0242-4c79-9e9c-c5ffb9c14092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:47.849652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-adad4614-0242-4c79-9e9c-c5ffb9c14092 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:47.850909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-adad4614-0242-4c79-9e9c-c5ffb9c14092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:47.888769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:47.928294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1155/2318] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:47.936061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c05fd4-8710-4270-83fa-9424ce713ae1 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:47.936337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c05fd4-8710-4270-83fa-9424ce713ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:47.936627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c05fd4-8710-4270-83fa-9424ce713ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:47.962834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-74c05fd4-8710-4270-83fa-9424ce713ae1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:47.964066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-74c05fd4-8710-4270-83fa-9424ce713ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:47.973986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1164/2319] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:47.978286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad4614-0242-4c79-9e9c-c5ffb9c14092 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:47.991604 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad4614-0242-4c79-9e9c-c5ffb9c14092 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:47.993989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284911a8-52b5-457c-934d-cabef19e5a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:47.994639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284911a8-52b5-457c-934d-cabef19e5a9e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:47.994969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284911a8-52b5-457c-934d-cabef19e5a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:47.995170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284911a8-52b5-457c-934d-cabef19e5a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:47.997108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284911a8-52b5-457c-934d-cabef19e5a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:41:47.997108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284911a8-52b5-457c-934d-cabef19e5a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:47.997704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284911a8-52b5-457c-934d-cabef19e5a9e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:48.012827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1156/2320] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:41:48.018489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c05fd4-8710-4270-83fa-9424ce713ae1 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:48.028922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c05fd4-8710-4270-83fa-9424ce713ae1 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:48.034459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749656d4-d495-4dcd-90ba-d0b12d6859f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:48.035087 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749656d4-d495-4dcd-90ba-d0b12d6859f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.035363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749656d4-d495-4dcd-90ba-d0b12d6859f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.035632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749656d4-d495-4dcd-90ba-d0b12d6859f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.036274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749656d4-d495-4dcd-90ba-d0b12d6859f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:48.038295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749656d4-d495-4dcd-90ba-d0b12d6859f9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:48.157476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1165/2321] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:48 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:48.161974 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284911a8-52b5-457c-934d-cabef19e5a9e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:48.175968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284911a8-52b5-457c-934d-cabef19e5a9e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:48.239077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e812974-75ba-4968-81d6-e472be42ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:48.239776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e812974-75ba-4968-81d6-e472be42ac09 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.240060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e812974-75ba-4968-81d6-e472be42ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.240340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e812974-75ba-4968-81d6-e472be42ac09 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.240991 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e812974-75ba-4968-81d6-e472be42ac09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:48.242961 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e812974-75ba-4968-81d6-e472be42ac09 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:48.397267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1157/2322] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:48 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:48.401764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749656d4-d495-4dcd-90ba-d0b12d6859f9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:48.416723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749656d4-d495-4dcd-90ba-d0b12d6859f9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:48.425214 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2841a70-241c-4f8d-baba-7ae5da52ad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:48.426321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2841a70-241c-4f8d-baba-7ae5da52ad38 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.426812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2841a70-241c-4f8d-baba-7ae5da52ad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.427309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2841a70-241c-4f8d-baba-7ae5da52ad38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.428482 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2841a70-241c-4f8d-baba-7ae5da52ad38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:48.431137 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2841a70-241c-4f8d-baba-7ae5da52ad38 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:48.444473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1166/2323] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:48.448725 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e812974-75ba-4968-81d6-e472be42ac09 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:48.459857 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e812974-75ba-4968-81d6-e472be42ac09 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:48.464976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd472a-72a5-4e9e-a335-d484cd510c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:48.465715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd472a-72a5-4e9e-a335-d484cd510c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.466216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd472a-72a5-4e9e-a335-d484cd510c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.466524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd472a-72a5-4e9e-a335-d484cd510c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.467177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd472a-72a5-4e9e-a335-d484cd510c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:48.468883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd472a-72a5-4e9e-a335-d484cd510c5c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:48.481998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1158/2324] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:48.487527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2841a70-241c-4f8d-baba-7ae5da52ad38 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:48.500652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2841a70-241c-4f8d-baba-7ae5da52ad38 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:48.505994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b30f6b-c08e-402e-a0fb-da17c0d5f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:48.506671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30f6b-c08e-402e-a0fb-da17c0d5f21c admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.506948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30f6b-c08e-402e-a0fb-da17c0d5f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.507224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30f6b-c08e-402e-a0fb-da17c0d5f21c admin admin] PATH_INFO: `/v3/projects/951245f9b286421388b31a1d66700f74/users/596f7d49525845f8940e7263c59f286c/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.511371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:48.524119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b30f6b-c08e-402e-a0fb-da17c0d5f21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=951245f9b286421388b31a1d66700f74, user_id=596f7d49525845f8940e7263c59f286c, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:48.526809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b30f6b-c08e-402e-a0fb-da17c0d5f21c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:48.680415 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1167/2325] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:48 2022] PUT /identity/v3/projects/951245f9b286421388b31a1d66700f74/users/596f7d49525845f8940e7263c59f286c/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:41:48.692722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99216c8-1b83-448e-92da-7b692f987965 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.693009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99216c8-1b83-448e-92da-7b692f987965 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.693284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99216c8-1b83-448e-92da-7b692f987965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.731801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c99216c8-1b83-448e-92da-7b692f987965 None None] MFA Rules not processed for user `596f7d49525845f8940e7263c59f286c`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:48.733019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c99216c8-1b83-448e-92da-7b692f987965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:48.820854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1159/2326] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:48.825478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b30f6b-c08e-402e-a0fb-da17c0d5f21c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:48.897860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b30f6b-c08e-402e-a0fb-da17c0d5f21c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:48.902989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abc4c4-796e-4133-a3ce-6b694f7d9164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:48.903705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc4c4-796e-4133-a3ce-6b694f7d9164 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:48.904033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc4c4-796e-4133-a3ce-6b694f7d9164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:48.904326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abc4c4-796e-4133-a3ce-6b694f7d9164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:48.904799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abc4c4-796e-4133-a3ce-6b694f7d9164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:48.907676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abc4c4-796e-4133-a3ce-6b694f7d9164 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.041744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1168/2327] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:48 2022] POST /identity/v3/projects => generated 365 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:49.044550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99216c8-1b83-448e-92da-7b692f987965 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:49.061193 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99216c8-1b83-448e-92da-7b692f987965 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:49.097229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:49.142553 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4873-8f80-4e77-8826-3765e5b8648d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:49.143187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4873-8f80-4e77-8826-3765e5b8648d admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.143465 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4873-8f80-4e77-8826-3765e5b8648d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.143735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d4873-8f80-4e77-8826-3765e5b8648d admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.144372 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d4873-8f80-4e77-8826-3765e5b8648d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:49.146350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d4873-8f80-4e77-8826-3765e5b8648d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.266191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1160/2328] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:49 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:41:49.270329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abc4c4-796e-4133-a3ce-6b694f7d9164 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:49.281998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abc4c4-796e-4133-a3ce-6b694f7d9164 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:49.286920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39317f-ea5f-4242-8d26-013e078b5f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:49.287536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39317f-ea5f-4242-8d26-013e078b5f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.287816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39317f-ea5f-4242-8d26-013e078b5f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.288087 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39317f-ea5f-4242-8d26-013e078b5f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.288734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39317f-ea5f-4242-8d26-013e078b5f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:49.290385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39317f-ea5f-4242-8d26-013e078b5f7a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.302183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1169/2329] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:49.306518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4873-8f80-4e77-8826-3765e5b8648d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:49.317077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d4873-8f80-4e77-8826-3765e5b8648d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:49.322000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465b7b2-3c98-4e85-9127-a7b981f1d8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:49.322687 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465b7b2-3c98-4e85-9127-a7b981f1d8ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.322962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465b7b2-3c98-4e85-9127-a7b981f1d8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.323234 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465b7b2-3c98-4e85-9127-a7b981f1d8ef admin admin] PATH_INFO: `/v3/projects/c9e5c8ac800f48a59d0dbd8147d9e9ac/users/e24789a88d204ec8ac0cebe1184f1d32/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.343861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465b7b2-3c98-4e85-9127-a7b981f1d8ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e5c8ac800f48a59d0dbd8147d9e9ac, user_id=e24789a88d204ec8ac0cebe1184f1d32, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:49.347607 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465b7b2-3c98-4e85-9127-a7b981f1d8ef admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.447661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1161/2330] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:49 2022] PUT /identity/v3/projects/c9e5c8ac800f48a59d0dbd8147d9e9ac/users/e24789a88d204ec8ac0cebe1184f1d32/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:49.451692 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39317f-ea5f-4242-8d26-013e078b5f7a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:49.465006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39317f-ea5f-4242-8d26-013e078b5f7a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:49.538950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3e693-0335-44bd-82c8-82e65cd3f99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:49.539483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3e693-0335-44bd-82c8-82e65cd3f99d admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.539761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3e693-0335-44bd-82c8-82e65cd3f99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.540034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3e693-0335-44bd-82c8-82e65cd3f99d admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.540679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3e693-0335-44bd-82c8-82e65cd3f99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:49.542366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3e693-0335-44bd-82c8-82e65cd3f99d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.554601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1170/2331] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:49.558853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465b7b2-3c98-4e85-9127-a7b981f1d8ef admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:49.570788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465b7b2-3c98-4e85-9127-a7b981f1d8ef admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:49.581554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7b73d-aaf2-46bc-882c-a99843a885fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:49.582562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7b73d-aaf2-46bc-882c-a99843a885fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.582965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7b73d-aaf2-46bc-882c-a99843a885fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.583279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7b73d-aaf2-46bc-882c-a99843a885fd admin admin] PATH_INFO: `/v3/projects/c9e5c8ac800f48a59d0dbd8147d9e9ac/users/e24789a88d204ec8ac0cebe1184f1d32/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.586217 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7b73d-aaf2-46bc-882c-a99843a885fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e5c8ac800f48a59d0dbd8147d9e9ac, user_id=e24789a88d204ec8ac0cebe1184f1d32, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:49.591171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7b73d-aaf2-46bc-882c-a99843a885fd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.604870 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1162/2332] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:49 2022] PUT /identity/v3/projects/c9e5c8ac800f48a59d0dbd8147d9e9ac/users/e24789a88d204ec8ac0cebe1184f1d32/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:41:49.616901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e31b49-cb21-458a-b30c-b393ab744433 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.617322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e31b49-cb21-458a-b30c-b393ab744433 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.617727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e31b49-cb21-458a-b30c-b393ab744433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.661154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c9e31b49-cb21-458a-b30c-b393ab744433 None None] MFA Rules not processed for user `e24789a88d204ec8ac0cebe1184f1d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:49.662890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c9e31b49-cb21-458a-b30c-b393ab744433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:49.744876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:49.781583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1171/2333] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:49.796058 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7b73d-aaf2-46bc-882c-a99843a885fd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:49.798807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-35e7b73d-aaf2-46bc-882c-a99843a885fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:49.911389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7b73d-aaf2-46bc-882c-a99843a885fd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:49.917186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3adc1-2ca0-43f4-9c58-0adc49668c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:49.918142 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3adc1-2ca0-43f4-9c58-0adc49668c06 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:49.918508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3adc1-2ca0-43f4-9c58-0adc49668c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:49.918788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3adc1-2ca0-43f4-9c58-0adc49668c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:49.931368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3adc1-2ca0-43f4-9c58-0adc49668c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:49.932884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3adc1-2ca0-43f4-9c58-0adc49668c06 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:49.962134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1163/2334] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:50.272251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e31b49-cb21-458a-b30c-b393ab744433 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:50.293274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e31b49-cb21-458a-b30c-b393ab744433 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:50.301100 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987901a-5e14-43fa-a58e-829823b0cdeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:50.302144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987901a-5e14-43fa-a58e-829823b0cdeb service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:50.302144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987901a-5e14-43fa-a58e-829823b0cdeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:50.302453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987901a-5e14-43fa-a58e-829823b0cdeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:50.406434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987901a-5e14-43fa-a58e-829823b0cdeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:50.407561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987901a-5e14-43fa-a58e-829823b0cdeb service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:50.418579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1172/2335] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:51.871977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3adc1-2ca0-43f4-9c58-0adc49668c06 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:51.875600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7ad3adc1-2ca0-43f4-9c58-0adc49668c06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:51.951689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3adc1-2ca0-43f4-9c58-0adc49668c06 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:51.957568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9540d8b-cedd-4a24-94f3-0d05842b4861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:51.958195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9540d8b-cedd-4a24-94f3-0d05842b4861 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:51.958479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9540d8b-cedd-4a24-94f3-0d05842b4861 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:51.958756 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9540d8b-cedd-4a24-94f3-0d05842b4861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:51.960535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b9540d8b-cedd-4a24-94f3-0d05842b4861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:51.974132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9540d8b-cedd-4a24-94f3-0d05842b4861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:51.975836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9540d8b-cedd-4a24-94f3-0d05842b4861 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:51.987905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1164/2336] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:41:53.607005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987901a-5e14-43fa-a58e-829823b0cdeb service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:53.611597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8987901a-5e14-43fa-a58e-829823b0cdeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:53.679865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987901a-5e14-43fa-a58e-829823b0cdeb service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:53.686923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:53.686923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:53.687427 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:53.689354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] PATH_INFO: `/v3/users/aab3db3757f24ffd9f2e0ab397bbf20d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:53.691577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab3db3757f24ffd9f2e0ab397bbf20d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:53.693534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:53.866993 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab3db3757f24ffd9f2e0ab397bbf20d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:53.874508 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab3db3757f24ffd9f2e0ab397bbf20d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:53.878065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab3db3757f24ffd9f2e0ab397bbf20d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:53.987822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab3db3757f24ffd9f2e0ab397bbf20d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:54.003054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab3db3757f24ffd9f2e0ab397bbf20d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:54.005184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:54.012104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1173/2337] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:41:53 2022] DELETE /identity/v3/users/aab3db3757f24ffd9f2e0ab397bbf20d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:41:54.427896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9540d8b-cedd-4a24-94f3-0d05842b4861 service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:54.440939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9540d8b-cedd-4a24-94f3-0d05842b4861 service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:54.446343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:54.514611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:54.515434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:54.515715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:54.515985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] PATH_INFO: `/v3/projects/5c3f893f1523421b9541fa72bd9a7863` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:54.517258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3f893f1523421b9541fa72bd9a7863)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:54.519366 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:54.588663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:54.590331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:54.611105 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f577ead-b2d5-4e5a-a570-d403f3dd293c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:54.614446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72666d-3424-4efb-8657-c4d5b28f0839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:54.615087 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72666d-3424-4efb-8657-c4d5b28f0839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:54.615370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72666d-3424-4efb-8657-c4d5b28f0839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:54.615645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72666d-3424-4efb-8657-c4d5b28f0839 admin admin] PATH_INFO: `/v3/users/596f7d49525845f8940e7263c59f286c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:54.617041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72666d-3424-4efb-8657-c4d5b28f0839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=596f7d49525845f8940e7263c59f286c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:54.618820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72666d-3424-4efb-8657-c4d5b28f0839 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:54.663863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3f893f1523421b9541fa72bd9a7863', 'request_id': 'req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:54.670293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3f893f1523421b9541fa72bd9a7863', 'request_id': 'req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:54.676694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3f893f1523421b9541fa72bd9a7863', 'request_id': 'req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:54.791425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] The token cache is being invalidate because project 5c3f893f1523421b9541fa72bd9a7863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:41:54.791890 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:54.792503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-0422c0ef-c6db-4813-99b2-b2caec4b0ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:54.794081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1165/2338] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:41:54 2022] DELETE /identity/v3/projects/5c3f893f1523421b9541fa72bd9a7863 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:41:54.800606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d6d1c-2aea-483b-992c-4f5563c7da69 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:54.800606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d6d1c-2aea-483b-992c-4f5563c7da69 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:54.800606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d6d1c-2aea-483b-992c-4f5563c7da69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:54.822352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d57d6d1c-2aea-483b-992c-4f5563c7da69 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:54.823572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d57d6d1c-2aea-483b-992c-4f5563c7da69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:54.880618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ea72666d-3424-4efb-8657-c4d5b28f0839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '596f7d49525845f8940e7263c59f286c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:54.890330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ea72666d-3424-4efb-8657-c4d5b28f0839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '596f7d49525845f8940e7263c59f286c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:54.891552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ea72666d-3424-4efb-8657-c4d5b28f0839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '596f7d49525845f8940e7263c59f286c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:54.898707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1166/2339] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:54.901303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba486450-017a-455e-b743-d8f0cb1104b9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:54.901810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba486450-017a-455e-b743-d8f0cb1104b9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:54.902391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba486450-017a-455e-b743-d8f0cb1104b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:54.931159 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ba486450-017a-455e-b743-d8f0cb1104b9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:54.932436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ba486450-017a-455e-b743-d8f0cb1104b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:54.942464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1167/2340] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:54.946827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba486450-017a-455e-b743-d8f0cb1104b9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:54.957197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba486450-017a-455e-b743-d8f0cb1104b9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:54.963858 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0ac95-4bf7-4b5c-ab13-1e266e7667cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:54.964479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0ac95-4bf7-4b5c-ab13-1e266e7667cc admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:54.964827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0ac95-4bf7-4b5c-ab13-1e266e7667cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:54.965102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0ac95-4bf7-4b5c-ab13-1e266e7667cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:54.965868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0ac95-4bf7-4b5c-ab13-1e266e7667cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:41:54.966206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0ac95-4bf7-4b5c-ab13-1e266e7667cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:54.967928 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0ac95-4bf7-4b5c-ab13-1e266e7667cc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:54.980798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1168/2341] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:41:54.985672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0ac95-4bf7-4b5c-ab13-1e266e7667cc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:54.997289 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0ac95-4bf7-4b5c-ab13-1e266e7667cc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:55.003052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2af09-800b-4ba0-8233-774a88350c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:55.003979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2af09-800b-4ba0-8233-774a88350c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:55.004262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2af09-800b-4ba0-8233-774a88350c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:55.004583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be2af09-800b-4ba0-8233-774a88350c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:55.005223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2af09-800b-4ba0-8233-774a88350c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:55.005591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ea72666d-3424-4efb-8657-c4d5b28f0839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '596f7d49525845f8940e7263c59f286c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:55.007250 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be2af09-800b-4ba0-8233-774a88350c0f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:55.023664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ea72666d-3424-4efb-8657-c4d5b28f0839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '596f7d49525845f8940e7263c59f286c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:55.030780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1174/2342] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:41:54 2022] DELETE /identity/v3/users/596f7d49525845f8940e7263c59f286c => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:41:55.035750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31acd30-cb0c-4e69-9315-39b6048597a4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:55.036105 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31acd30-cb0c-4e69-9315-39b6048597a4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:55.036378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31acd30-cb0c-4e69-9315-39b6048597a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:55.059260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c31acd30-cb0c-4e69-9315-39b6048597a4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:55.060370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c31acd30-cb0c-4e69-9315-39b6048597a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:55.111373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:55.124639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1169/2343] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:54 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:41:55.127157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2af09-800b-4ba0-8233-774a88350c0f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:55.129434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9be2af09-800b-4ba0-8233-774a88350c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:55.131246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1175/2344] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:55.141627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31acd30-cb0c-4e69-9315-39b6048597a4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:55.143782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c31acd30-cb0c-4e69-9315-39b6048597a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:55.229164 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31acd30-cb0c-4e69-9315-39b6048597a4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:55.233943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be2af09-800b-4ba0-8233-774a88350c0f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:55.239595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76126304-1f24-4b4a-a839-62b6fc4baf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:55.240323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76126304-1f24-4b4a-a839-62b6fc4baf47 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:55.240677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76126304-1f24-4b4a-a839-62b6fc4baf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:55.241023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76126304-1f24-4b4a-a839-62b6fc4baf47 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:55.241736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76126304-1f24-4b4a-a839-62b6fc4baf47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:55.244016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76126304-1f24-4b4a-a839-62b6fc4baf47 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:55.267205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:55.318600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d332f1-b19f-4141-b5b5-e50e35cf60ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:55.319359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d332f1-b19f-4141-b5b5-e50e35cf60ef service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:55.319825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d332f1-b19f-4141-b5b5-e50e35cf60ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:55.320247 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d332f1-b19f-4141-b5b5-e50e35cf60ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:55.346371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d332f1-b19f-4141-b5b5-e50e35cf60ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:55.346371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d332f1-b19f-4141-b5b5-e50e35cf60ef service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:55.346371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1176/2345] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:41:55.375871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1170/2346] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:55 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:55.380339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d332f1-b19f-4141-b5b5-e50e35cf60ef service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:55.390799 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d332f1-b19f-4141-b5b5-e50e35cf60ef service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:55.404125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6fa0-9960-4075-99cf-06e1ba086040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:55.405953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6fa0-9960-4075-99cf-06e1ba086040 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:55.406622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6fa0-9960-4075-99cf-06e1ba086040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:55.407111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b6fa0-9960-4075-99cf-06e1ba086040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:55.408229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6fa0-9960-4075-99cf-06e1ba086040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:55.410960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b6fa0-9960-4075-99cf-06e1ba086040 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:55.428324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1177/2347] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:41:55.433372 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76126304-1f24-4b4a-a839-62b6fc4baf47 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:55.448509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76126304-1f24-4b4a-a839-62b6fc4baf47 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:55.454357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129265e-a5c5-428b-bf63-a44ed260aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:55.455141 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129265e-a5c5-428b-bf63-a44ed260aff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:55.455714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129265e-a5c5-428b-bf63-a44ed260aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:55.455999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129265e-a5c5-428b-bf63-a44ed260aff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:55.456747 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129265e-a5c5-428b-bf63-a44ed260aff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:55.458463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129265e-a5c5-428b-bf63-a44ed260aff0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:55.469852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1171/2348] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:41:55.474366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6fa0-9960-4075-99cf-06e1ba086040 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:55.485721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b6fa0-9960-4075-99cf-06e1ba086040 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:55.490678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c1c34-4e89-408a-afe9-89ad0b7c21b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:55.491343 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c1c34-4e89-408a-afe9-89ad0b7c21b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:55.491620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c1c34-4e89-408a-afe9-89ad0b7c21b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:55.491886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c1c34-4e89-408a-afe9-89ad0b7c21b9 admin admin] PATH_INFO: `/v3/projects/5078c7eec0a145efad4a710b88a8f57c/users/418adb6ed5284c398d86dffa19b3d16f/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:55.510728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c1c34-4e89-408a-afe9-89ad0b7c21b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5078c7eec0a145efad4a710b88a8f57c, user_id=418adb6ed5284c398d86dffa19b3d16f, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:55.513396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c1c34-4e89-408a-afe9-89ad0b7c21b9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:55.668258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1178/2349] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:55 2022] PUT /identity/v3/projects/5078c7eec0a145efad4a710b88a8f57c/users/418adb6ed5284c398d86dffa19b3d16f/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:55.675001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd57059-cedc-4a13-925d-de3c37b8d0e7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:55.675300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd57059-cedc-4a13-925d-de3c37b8d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:55.675577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd57059-cedc-4a13-925d-de3c37b8d0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:55.702523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1bd57059-cedc-4a13-925d-de3c37b8d0e7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:55.705246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1bd57059-cedc-4a13-925d-de3c37b8d0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:55.791192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1172/2350] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:55.815958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c1c34-4e89-408a-afe9-89ad0b7c21b9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:55.819319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-272c1c34-4e89-408a-afe9-89ad0b7c21b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:55.890098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c1c34-4e89-408a-afe9-89ad0b7c21b9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:55.894783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890a58-049c-46cf-98da-0ef5830bb060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:55.895424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890a58-049c-46cf-98da-0ef5830bb060 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:55.895729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890a58-049c-46cf-98da-0ef5830bb060 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:55.895947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f890a58-049c-46cf-98da-0ef5830bb060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:55.909055 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f890a58-049c-46cf-98da-0ef5830bb060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:55.912931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f890a58-049c-46cf-98da-0ef5830bb060 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:55.925669 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1179/2351] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:41:55.973220 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd57059-cedc-4a13-925d-de3c37b8d0e7 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:55.976473 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1bd57059-cedc-4a13-925d-de3c37b8d0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:55.993729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd57059-cedc-4a13-925d-de3c37b8d0e7 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:55.998850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:55.999704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:56.004737 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:56.004737 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] PATH_INFO: `/v3/projects/951245f9b286421388b31a1d66700f74` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:56.004737 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] RBAC: Authorizing `identity:delete_project(project_id=951245f9b286421388b31a1d66700f74)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:56.004737 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:56.216337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '951245f9b286421388b31a1d66700f74', 'request_id': 'req-6faac638-a8d8-4df9-a8a3-a61c82d5822b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:56.223777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '951245f9b286421388b31a1d66700f74', 'request_id': 'req-6faac638-a8d8-4df9-a8a3-a61c82d5822b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:56.229562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '951245f9b286421388b31a1d66700f74', 'request_id': 'req-6faac638-a8d8-4df9-a8a3-a61c82d5822b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:56.350112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:56.360893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] The token cache is being invalidate because project 951245f9b286421388b31a1d66700f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:41:56.361339 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:56.361970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:56.368184 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890a58-049c-46cf-98da-0ef5830bb060 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:56.373429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1173/2352] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:41:55 2022] DELETE /identity/v3/projects/951245f9b286421388b31a1d66700f74 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:56.380348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f890a58-049c-46cf-98da-0ef5830bb060 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:56.453356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:56.454026 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:56.454309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:56.454583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] PATH_INFO: `/v3/users/e24789a88d204ec8ac0cebe1184f1d32` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:56.455772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24789a88d204ec8ac0cebe1184f1d32)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:56.457895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:56.695018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:56.706635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24789a88d204ec8ac0cebe1184f1d32'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:56.715434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24789a88d204ec8ac0cebe1184f1d32'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:56.717083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24789a88d204ec8ac0cebe1184f1d32'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:56.782702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:56.784496 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:56.818818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24789a88d204ec8ac0cebe1184f1d32'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:56.842434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24789a88d204ec8ac0cebe1184f1d32'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:56.871766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1180/2353] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:41:56 2022] DELETE /identity/v3/users/e24789a88d204ec8ac0cebe1184f1d32 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:41:56.894991 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faac638-a8d8-4df9-a8a3-a61c82d5822b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:57.005860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5059c8-595d-4b03-8401-664c4c1ab2e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:57.006688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5059c8-595d-4b03-8401-664c4c1ab2e9 service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:57.007119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5059c8-595d-4b03-8401-664c4c1ab2e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:57.007500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5059c8-595d-4b03-8401-664c4c1ab2e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:57.009523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0c5059c8-595d-4b03-8401-664c4c1ab2e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:57.026873 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5059c8-595d-4b03-8401-664c4c1ab2e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:57.028505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5059c8-595d-4b03-8401-664c4c1ab2e9 service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:57.048465 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1174/2354] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:41:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:41:57.603161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:57.604961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:57.741238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4e3be-3ad0-4fb0-b4a7-36ca61222037 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:57.747341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:57.747997 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:57.748277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:57.748552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] PATH_INFO: `/v3/projects/c9e5c8ac800f48a59d0dbd8147d9e9ac` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:57.751069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e5c8ac800f48a59d0dbd8147d9e9ac)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:57.753257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:57.798386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830f5be-30ae-44e7-8f27-d06f81b8902a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:57.798386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830f5be-30ae-44e7-8f27-d06f81b8902a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:57.798386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830f5be-30ae-44e7-8f27-d06f81b8902a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:57.831894 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e830f5be-30ae-44e7-8f27-d06f81b8902a None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:57.833245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e830f5be-30ae-44e7-8f27-d06f81b8902a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:57.910969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1175/2355] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:41:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:57.991068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e5c8ac800f48a59d0dbd8147d9e9ac', 'request_id': 'req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:58.007527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e5c8ac800f48a59d0dbd8147d9e9ac', 'request_id': 'req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:58.155475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830f5be-30ae-44e7-8f27-d06f81b8902a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:58.157310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e830f5be-30ae-44e7-8f27-d06f81b8902a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:58.173775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e5c8ac800f48a59d0dbd8147d9e9ac', 'request_id': 'req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:58.197668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] The token cache is being invalidate because project c9e5c8ac800f48a59d0dbd8147d9e9ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:41:58.198186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:58.198928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7b51c522-4a8e-4d0a-95bb-d8fd6c26ef95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:41:58.200625 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1181/2356] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:41:57 2022] DELETE /identity/v3/projects/c9e5c8ac800f48a59d0dbd8147d9e9ac => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:58.207986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9767bb-32fa-4f9e-a25c-c1126e6e2725 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:58.208275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9767bb-32fa-4f9e-a25c-c1126e6e2725 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:58.208823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9767bb-32fa-4f9e-a25c-c1126e6e2725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:58.237330 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:58.246822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ba9767bb-32fa-4f9e-a25c-c1126e6e2725 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:58.248554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ba9767bb-32fa-4f9e-a25c-c1126e6e2725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:58.313456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830f5be-30ae-44e7-8f27-d06f81b8902a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:58.334106 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1182/2357] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:41:58.341227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd553-a33c-49e5-87df-6a2e1581d939 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:58.341678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd553-a33c-49e5-87df-6a2e1581d939 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:58.342014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fd553-a33c-49e5-87df-6a2e1581d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:58.390928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-321fd553-a33c-49e5-87df-6a2e1581d939 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:58.393137 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-321fd553-a33c-49e5-87df-6a2e1581d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:58.413603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1183/2358] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:58.416866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:58.422683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fd553-a33c-49e5-87df-6a2e1581d939 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:58.438549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fd553-a33c-49e5-87df-6a2e1581d939 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:58.448501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ec521-baa6-4542-be57-b33fe4133c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:58.450367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ec521-baa6-4542-be57-b33fe4133c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:58.450869 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba20f7b-4a84-48c2-a636-218b0a449aeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:58.451427 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ec521-baa6-4542-be57-b33fe4133c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:58.451768 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba20f7b-4a84-48c2-a636-218b0a449aeb service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:58.451768 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba20f7b-4a84-48c2-a636-218b0a449aeb service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:58.452199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba20f7b-4a84-48c2-a636-218b0a449aeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:58.453413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ec521-baa6-4542-be57-b33fe4133c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:58.454942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5ba20f7b-4a84-48c2-a636-218b0a449aeb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:58.455336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ec521-baa6-4542-be57-b33fe4133c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:41:58.456066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ec521-baa6-4542-be57-b33fe4133c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:58.458774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ec521-baa6-4542-be57-b33fe4133c3b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:58.479046 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1184/2359] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:41:58.481340 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ec521-baa6-4542-be57-b33fe4133c3b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:58.495372 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ec521-baa6-4542-be57-b33fe4133c3b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:58.504943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6208c-9f5c-4c51-96ac-8148889579a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:58.505908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6208c-9f5c-4c51-96ac-8148889579a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:58.506445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6208c-9f5c-4c51-96ac-8148889579a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:58.506868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6208c-9f5c-4c51-96ac-8148889579a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:58.507663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6208c-9f5c-4c51-96ac-8148889579a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:58.510157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6208c-9f5c-4c51-96ac-8148889579a3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:58.576582 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba20f7b-4a84-48c2-a636-218b0a449aeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:58.580119 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba20f7b-4a84-48c2-a636-218b0a449aeb service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:58.604651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1176/2360] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:41:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 16:41:58.657689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1185/2361] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:58 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:58.662234 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba20f7b-4a84-48c2-a636-218b0a449aeb service swift] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:58.676407 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba20f7b-4a84-48c2-a636-218b0a449aeb service swift] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:58.812967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781b2f1-9e26-4722-bf8b-249bd9de941d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:58.814588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b2f1-9e26-4722-bf8b-249bd9de941d admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:58.815147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b2f1-9e26-4722-bf8b-249bd9de941d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:58.815626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781b2f1-9e26-4722-bf8b-249bd9de941d admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:58.817926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781b2f1-9e26-4722-bf8b-249bd9de941d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:58.821787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781b2f1-9e26-4722-bf8b-249bd9de941d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:58.957134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1177/2362] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:58 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:58.961160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6208c-9f5c-4c51-96ac-8148889579a3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:58.986250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6208c-9f5c-4c51-96ac-8148889579a3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:59.002438 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449c804-9b79-4d31-bb76-abffa4d91b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:59.004385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c804-9b79-4d31-bb76-abffa4d91b9a admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:59.005060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c804-9b79-4d31-bb76-abffa4d91b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:59.006296 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449c804-9b79-4d31-bb76-abffa4d91b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:59.007363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449c804-9b79-4d31-bb76-abffa4d91b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:59.009595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449c804-9b79-4d31-bb76-abffa4d91b9a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:59.032586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1186/2363] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:41:59.041346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781b2f1-9e26-4722-bf8b-249bd9de941d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:59.043326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:59.056363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781b2f1-9e26-4722-bf8b-249bd9de941d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:59.079796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf9776-b7bf-4fdc-a7af-1a0f3091dd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:59.080815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9776-b7bf-4fdc-a7af-1a0f3091dd4f admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:59.081255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9776-b7bf-4fdc-a7af-1a0f3091dd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:59.081558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf9776-b7bf-4fdc-a7af-1a0f3091dd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:59.085958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf9776-b7bf-4fdc-a7af-1a0f3091dd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:59.091619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf9776-b7bf-4fdc-a7af-1a0f3091dd4f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:59.126929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1178/2364] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:41:59.128250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449c804-9b79-4d31-bb76-abffa4d91b9a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:59.143553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449c804-9b79-4d31-bb76-abffa4d91b9a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:59.166033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acffea-800d-4c1c-8c46-68d43667f804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:59.167181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acffea-800d-4c1c-8c46-68d43667f804 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:59.170085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acffea-800d-4c1c-8c46-68d43667f804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:59.171179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acffea-800d-4c1c-8c46-68d43667f804 admin admin] PATH_INFO: `/v3/projects/c4e6c6901ad444d3b012cc85d77d990a/users/fe82a8bfc0524bc8b0588e330136f660/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:59.215487 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acffea-800d-4c1c-8c46-68d43667f804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e6c6901ad444d3b012cc85d77d990a, user_id=fe82a8bfc0524bc8b0588e330136f660, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:59.221246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21acffea-800d-4c1c-8c46-68d43667f804 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:59.371279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1187/2365] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:41:59 2022] PUT /identity/v3/projects/c4e6c6901ad444d3b012cc85d77d990a/users/fe82a8bfc0524bc8b0588e330136f660/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:41:59.386471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670fd25-33e8-40b7-8537-b5ff3b451bc1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:59.387061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670fd25-33e8-40b7-8537-b5ff3b451bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:59.387910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670fd25-33e8-40b7-8537-b5ff3b451bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:59.468685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7670fd25-33e8-40b7-8537-b5ff3b451bc1 None None] MFA Rules not processed for user `fe82a8bfc0524bc8b0588e330136f660`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:41:59.470183 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7670fd25-33e8-40b7-8537-b5ff3b451bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:41:59.624098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1179/2366] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:41:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:41:59.630241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acffea-800d-4c1c-8c46-68d43667f804 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:59.751045 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acffea-800d-4c1c-8c46-68d43667f804 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:41:59.758000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70589a21-a555-4c2e-9033-51a4a23755ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:41:59.759041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589a21-a555-4c2e-9033-51a4a23755ed admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:41:59.759505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589a21-a555-4c2e-9033-51a4a23755ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:41:59.759926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70589a21-a555-4c2e-9033-51a4a23755ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:41:59.760776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70589a21-a555-4c2e-9033-51a4a23755ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:41:59.767902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70589a21-a555-4c2e-9033-51a4a23755ed admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:41:59.920179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1188/2367] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:41:59 2022] POST /identity/v3/projects => generated 379 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:41:59.924551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670fd25-33e8-40b7-8537-b5ff3b451bc1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:41:59.966995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670fd25-33e8-40b7-8537-b5ff3b451bc1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:00.157586 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030786d-a6d6-408d-a22b-a49a2b2ca7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:00.158179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030786d-a6d6-408d-a22b-a49a2b2ca7da admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:00.158470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030786d-a6d6-408d-a22b-a49a2b2ca7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:00.158765 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030786d-a6d6-408d-a22b-a49a2b2ca7da admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:00.159415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030786d-a6d6-408d-a22b-a49a2b2ca7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:00.161389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030786d-a6d6-408d-a22b-a49a2b2ca7da admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:00.389267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1180/2368] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:41:59 2022] POST /identity/v3/users => generated 296 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:00.393994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70589a21-a555-4c2e-9033-51a4a23755ed admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:00.412077 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70589a21-a555-4c2e-9033-51a4a23755ed admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:00.417860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1f3db-7eda-4068-b546-452392d3106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:00.418654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f3db-7eda-4068-b546-452392d3106b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:00.419224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f3db-7eda-4068-b546-452392d3106b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:00.419538 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1f3db-7eda-4068-b546-452392d3106b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:00.420239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1f3db-7eda-4068-b546-452392d3106b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:00.423899 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1f3db-7eda-4068-b546-452392d3106b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:00.443082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1189/2369] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:00.449071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030786d-a6d6-408d-a22b-a49a2b2ca7da admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:00.469131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030786d-a6d6-408d-a22b-a49a2b2ca7da admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:00.474344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8159e1-82e8-4b03-8428-4759ad7604ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:00.475177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8159e1-82e8-4b03-8428-4759ad7604ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:00.475593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8159e1-82e8-4b03-8428-4759ad7604ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:00.475940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8159e1-82e8-4b03-8428-4759ad7604ed admin admin] PATH_INFO: `/v3/projects/64c30c42980a40d6b423eb70286cb7cb/users/9caeaf7283c94827b6c151fdfeaba785/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:00.496161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8159e1-82e8-4b03-8428-4759ad7604ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c30c42980a40d6b423eb70286cb7cb, user_id=9caeaf7283c94827b6c151fdfeaba785, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:00.499915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8159e1-82e8-4b03-8428-4759ad7604ed admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:00.683726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1181/2370] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:00 2022] PUT /identity/v3/projects/64c30c42980a40d6b423eb70286cb7cb/users/9caeaf7283c94827b6c151fdfeaba785/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:00.690185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1f3db-7eda-4068-b546-452392d3106b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:00.703294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1f3db-7eda-4068-b546-452392d3106b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:00.829412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a85326-1b5c-48a1-bc79-5dbc386c2152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:00.831377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a85326-1b5c-48a1-bc79-5dbc386c2152 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:00.832363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a85326-1b5c-48a1-bc79-5dbc386c2152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:00.832884 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a85326-1b5c-48a1-bc79-5dbc386c2152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:00.834706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a85326-1b5c-48a1-bc79-5dbc386c2152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:00.839467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a85326-1b5c-48a1-bc79-5dbc386c2152 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:00.863620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1190/2371] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:00.864083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8159e1-82e8-4b03-8428-4759ad7604ed admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:00.885288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8159e1-82e8-4b03-8428-4759ad7604ed admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:00.911557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8161e-0392-4641-850c-eac434ff7227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:00.912276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8161e-0392-4641-850c-eac434ff7227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:00.912566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8161e-0392-4641-850c-eac434ff7227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:00.925122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8161e-0392-4641-850c-eac434ff7227 admin admin] PATH_INFO: `/v3/projects/64c30c42980a40d6b423eb70286cb7cb/users/9caeaf7283c94827b6c151fdfeaba785/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:00.930956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8161e-0392-4641-850c-eac434ff7227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64c30c42980a40d6b423eb70286cb7cb, user_id=9caeaf7283c94827b6c151fdfeaba785, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:00.934533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8161e-0392-4641-850c-eac434ff7227 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:00.979326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1182/2372] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:00 2022] PUT /identity/v3/projects/64c30c42980a40d6b423eb70286cb7cb/users/9caeaf7283c94827b6c151fdfeaba785/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:00.991134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6c307-19b5-44ee-b13d-81fd07b71b24 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:00.991424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6c307-19b5-44ee-b13d-81fd07b71b24 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:00.991702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6c307-19b5-44ee-b13d-81fd07b71b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:01.095833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-eaf6c307-19b5-44ee-b13d-81fd07b71b24 None None] MFA Rules not processed for user `9caeaf7283c94827b6c151fdfeaba785`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:01.097281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-eaf6c307-19b5-44ee-b13d-81fd07b71b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:01.333697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:01.361772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1191/2373] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:01.378709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8161e-0392-4641-850c-eac434ff7227 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:01.380874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-55e8161e-0392-4641-850c-eac434ff7227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:01.490990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:01.554415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8161e-0392-4641-850c-eac434ff7227 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:01.567249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde37ae3-933c-4716-a23e-1c48480d8001 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:01.567827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde37ae3-933c-4716-a23e-1c48480d8001 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:01.568117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde37ae3-933c-4716-a23e-1c48480d8001 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:01.568397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde37ae3-933c-4716-a23e-1c48480d8001 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:01.696468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde37ae3-933c-4716-a23e-1c48480d8001 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:01.698697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde37ae3-933c-4716-a23e-1c48480d8001 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:01.729695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1183/2374] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:03.879636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6c307-19b5-44ee-b13d-81fd07b71b24 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:03.891894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6c307-19b5-44ee-b13d-81fd07b71b24 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:03.895701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832e702-7611-4428-94da-f7ffc4c90514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:03.898064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832e702-7611-4428-94da-f7ffc4c90514 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:03.902348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832e702-7611-4428-94da-f7ffc4c90514 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:03.903391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832e702-7611-4428-94da-f7ffc4c90514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:03.928367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832e702-7611-4428-94da-f7ffc4c90514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:03.931752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2832e702-7611-4428-94da-f7ffc4c90514 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:03.968027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1192/2375] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:06.626413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbdafa-afc8-4a4c-876d-0fdc3b5ef595 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:06.627077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbdafa-afc8-4a4c-876d-0fdc3b5ef595 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:06.627353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbdafa-afc8-4a4c-876d-0fdc3b5ef595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:06.719510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1bdbdafa-afc8-4a4c-876d-0fdc3b5ef595 None None] MFA Rules not processed for user `418adb6ed5284c398d86dffa19b3d16f`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:06.721963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1bdbdafa-afc8-4a4c-876d-0fdc3b5ef595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:06.862827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1184/2376] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:06.867756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832e702-7611-4428-94da-f7ffc4c90514 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:06.876373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2832e702-7611-4428-94da-f7ffc4c90514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:07.022148 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2832e702-7611-4428-94da-f7ffc4c90514 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:07.063819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46458265-a409-4b60-964a-562b2080c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:07.064473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46458265-a409-4b60-964a-562b2080c648 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:07.066403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46458265-a409-4b60-964a-562b2080c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:07.066403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46458265-a409-4b60-964a-562b2080c648 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:07.066403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46458265-a409-4b60-964a-562b2080c648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:07.067670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46458265-a409-4b60-964a-562b2080c648 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:07.329036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbdafa-afc8-4a4c-876d-0fdc3b5ef595 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:07.332027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1193/2377] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:06 2022] POST /identity/v3/projects => generated 383 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:07.350318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdbdafa-afc8-4a4c-876d-0fdc3b5ef595 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:07.533822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9d62-bbe7-4923-a4cc-3357b59bb1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:07.534601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9d62-bbe7-4923-a4cc-3357b59bb1f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:07.534960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9d62-bbe7-4923-a4cc-3357b59bb1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:07.535267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab9d62-bbe7-4923-a4cc-3357b59bb1f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:07.536230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab9d62-bbe7-4923-a4cc-3357b59bb1f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:07.538632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ab9d62-bbe7-4923-a4cc-3357b59bb1f9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:07.662571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1185/2378] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:07 2022] POST /identity/v3/users => generated 298 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:07.666331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46458265-a409-4b60-964a-562b2080c648 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:07.680969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46458265-a409-4b60-964a-562b2080c648 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:07.698179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5638f6-7d59-4bc8-a634-e325ce868e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:07.698179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5638f6-7d59-4bc8-a634-e325ce868e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:07.698179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5638f6-7d59-4bc8-a634-e325ce868e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:07.698179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5638f6-7d59-4bc8-a634-e325ce868e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:07.698757 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5638f6-7d59-4bc8-a634-e325ce868e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:07.701806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5638f6-7d59-4bc8-a634-e325ce868e7f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:07.722887 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1194/2379] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:07.732613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9d62-bbe7-4923-a4cc-3357b59bb1f9 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:07.749342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab9d62-bbe7-4923-a4cc-3357b59bb1f9 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:07.755642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325d002-2fc6-4d81-8ff9-3838d62ab31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:07.756505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325d002-2fc6-4d81-8ff9-3838d62ab31f admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:07.756792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325d002-2fc6-4d81-8ff9-3838d62ab31f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:07.757065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5325d002-2fc6-4d81-8ff9-3838d62ab31f admin admin] PATH_INFO: `/v3/projects/f6337db2eb6e4620955206218ac5b5c2/users/74b1bcdf6d764bb9824cbb2b538a1f5c/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:07.761751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:07.785532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325d002-2fc6-4d81-8ff9-3838d62ab31f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6337db2eb6e4620955206218ac5b5c2, user_id=74b1bcdf6d764bb9824cbb2b538a1f5c, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:07.789285 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5325d002-2fc6-4d81-8ff9-3838d62ab31f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:07.911949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1186/2380] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:07 2022] PUT /identity/v3/projects/f6337db2eb6e4620955206218ac5b5c2/users/74b1bcdf6d764bb9824cbb2b538a1f5c/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:07.918990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5638f6-7d59-4bc8-a634-e325ce868e7f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:07.946308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5638f6-7d59-4bc8-a634-e325ce868e7f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:08.032781 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:08.112674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5e84-70a0-481d-a09c-b2fa9b062435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:08.115298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5e84-70a0-481d-a09c-b2fa9b062435 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:08.115298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5e84-70a0-481d-a09c-b2fa9b062435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:08.115298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d5e84-70a0-481d-a09c-b2fa9b062435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:08.115298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5e84-70a0-481d-a09c-b2fa9b062435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:08.117380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d5e84-70a0-481d-a09c-b2fa9b062435 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:08.149713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1195/2381] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:08.149953 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325d002-2fc6-4d81-8ff9-3838d62ab31f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:08.169386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5325d002-2fc6-4d81-8ff9-3838d62ab31f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:08.171635 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969492bf-37fb-453b-a097-ab4c753ca47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:08.172760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969492bf-37fb-453b-a097-ab4c753ca47c admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:08.177953 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969492bf-37fb-453b-a097-ab4c753ca47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:08.177953 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969492bf-37fb-453b-a097-ab4c753ca47c admin admin] PATH_INFO: `/v3/projects/f6337db2eb6e4620955206218ac5b5c2/users/74b1bcdf6d764bb9824cbb2b538a1f5c/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:08.177953 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969492bf-37fb-453b-a097-ab4c753ca47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6337db2eb6e4620955206218ac5b5c2, user_id=74b1bcdf6d764bb9824cbb2b538a1f5c, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:08.180168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969492bf-37fb-453b-a097-ab4c753ca47c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:08.209513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1187/2382] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:08 2022] PUT /identity/v3/projects/f6337db2eb6e4620955206218ac5b5c2/users/74b1bcdf6d764bb9824cbb2b538a1f5c/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:09.725754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5e84-70a0-481d-a09c-b2fa9b062435 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:09.742055 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d5e84-70a0-481d-a09c-b2fa9b062435 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:09.872212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:09.873036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:09.873418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:09.873784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] PATH_INFO: `/v3/users/fe82a8bfc0524bc8b0588e330136f660` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:09.875513 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe82a8bfc0524bc8b0588e330136f660)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:09.879084 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:10.228812 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe82a8bfc0524bc8b0588e330136f660'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:10.261274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe82a8bfc0524bc8b0588e330136f660'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:10.261274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe82a8bfc0524bc8b0588e330136f660'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:10.393857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe82a8bfc0524bc8b0588e330136f660'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:10.447732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe82a8bfc0524bc8b0588e330136f660'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:10.466265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1196/2383] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:09 2022] DELETE /identity/v3/users/fe82a8bfc0524bc8b0588e330136f660 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:10.473275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638256f-20d3-4549-9c01-dc33c56cd619 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:10.476168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638256f-20d3-4549-9c01-dc33c56cd619 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:10.477493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638256f-20d3-4549-9c01-dc33c56cd619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:10.526343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c638256f-20d3-4549-9c01-dc33c56cd619 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:10.527001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c638256f-20d3-4549-9c01-dc33c56cd619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:10.773075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1188/2384] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:10.781968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:10.787773 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:11.146916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:11.205526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3196bc-7c3e-4a0c-9a79-ce2e139ed638 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:11.210371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcb770-2e35-4b22-9ede-dfec18f27024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:11.211374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcb770-2e35-4b22-9ede-dfec18f27024 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:11.211811 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcb770-2e35-4b22-9ede-dfec18f27024 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:11.212538 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcb770-2e35-4b22-9ede-dfec18f27024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:11.255344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcb770-2e35-4b22-9ede-dfec18f27024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:11.266938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcb770-2e35-4b22-9ede-dfec18f27024 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:11.282520 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1197/2385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:12.149626 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638256f-20d3-4549-9c01-dc33c56cd619 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:12.151606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c638256f-20d3-4549-9c01-dc33c56cd619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:12.171890 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638256f-20d3-4549-9c01-dc33c56cd619 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:12.177554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:12.179688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:12.190477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:12.194432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] PATH_INFO: `/v3/projects/c4e6c6901ad444d3b012cc85d77d990a` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:12.198431 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e6c6901ad444d3b012cc85d77d990a)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:12.208897 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:12.406950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e6c6901ad444d3b012cc85d77d990a', 'request_id': 'req-d41c5f40-046a-4e01-b553-7b79abada6ce'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:12.422890 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e6c6901ad444d3b012cc85d77d990a', 'request_id': 'req-d41c5f40-046a-4e01-b553-7b79abada6ce'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:12.446729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e6c6901ad444d3b012cc85d77d990a', 'request_id': 'req-d41c5f40-046a-4e01-b553-7b79abada6ce'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:12.563123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] The token cache is being invalidate because project c4e6c6901ad444d3b012cc85d77d990a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:12.563562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:12.565601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:12.576185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1189/2386] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:12 2022] DELETE /identity/v3/projects/c4e6c6901ad444d3b012cc85d77d990a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:12.581111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcb770-2e35-4b22-9ede-dfec18f27024 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:12.597478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcb770-2e35-4b22-9ede-dfec18f27024 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:12.871578 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5cc1e-ad19-4926-b9c4-a176b45bd027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:12.872818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5cc1e-ad19-4926-b9c4-a176b45bd027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:12.873300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5cc1e-ad19-4926-b9c4-a176b45bd027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:12.874416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5cc1e-ad19-4926-b9c4-a176b45bd027 admin admin] PATH_INFO: `/v3/users/9caeaf7283c94827b6c151fdfeaba785` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:12.876495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5cc1e-ad19-4926-b9c4-a176b45bd027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9caeaf7283c94827b6c151fdfeaba785)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:12.896711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5cc1e-ad19-4926-b9c4-a176b45bd027 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:13.237061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6cc5cc1e-ad19-4926-b9c4-a176b45bd027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9caeaf7283c94827b6c151fdfeaba785'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:13.259046 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6cc5cc1e-ad19-4926-b9c4-a176b45bd027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9caeaf7283c94827b6c151fdfeaba785'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:13.260141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6cc5cc1e-ad19-4926-b9c4-a176b45bd027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9caeaf7283c94827b6c151fdfeaba785'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:13.353661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6cc5cc1e-ad19-4926-b9c4-a176b45bd027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9caeaf7283c94827b6c151fdfeaba785'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:13.382905 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6cc5cc1e-ad19-4926-b9c4-a176b45bd027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9caeaf7283c94827b6c151fdfeaba785'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:13.413243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1198/2387] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:12 2022] DELETE /identity/v3/users/9caeaf7283c94827b6c151fdfeaba785 => generated 0 bytes in 830 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:14.228683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:14.231852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:14.271405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c5f40-046a-4e01-b553-7b79abada6ce admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:14.426313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:14.441797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:14.441797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:14.441797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:14.441797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] PATH_INFO: `/v3/projects/64c30c42980a40d6b423eb70286cb7cb` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:14.442506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64c30c42980a40d6b423eb70286cb7cb)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:14.444546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:14.580764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64c30c42980a40d6b423eb70286cb7cb', 'request_id': 'req-fa1956d1-add2-4585-8b27-6342f80284a9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:14.596729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64c30c42980a40d6b423eb70286cb7cb', 'request_id': 'req-fa1956d1-add2-4585-8b27-6342f80284a9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:14.612034 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64c30c42980a40d6b423eb70286cb7cb', 'request_id': 'req-fa1956d1-add2-4585-8b27-6342f80284a9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:14.745577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] The token cache is being invalidate because project 64c30c42980a40d6b423eb70286cb7cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:14.746244 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:14.749543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fa1956d1-add2-4585-8b27-6342f80284a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:14.755605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1190/2388] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:14 2022] DELETE /identity/v3/projects/64c30c42980a40d6b423eb70286cb7cb => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:14.761665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee35f1-7b3f-472c-8a0a-3685ebe6392d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:14.762462 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee35f1-7b3f-472c-8a0a-3685ebe6392d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:14.762462 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee35f1-7b3f-472c-8a0a-3685ebe6392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:14.812852 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-78ee35f1-7b3f-472c-8a0a-3685ebe6392d None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:14.816534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-78ee35f1-7b3f-472c-8a0a-3685ebe6392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:15.005792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1199/2389] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:15.007774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2fa3b-1fc2-4771-9ad5-b4dbc2fae3c2 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:15.008115 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2fa3b-1fc2-4771-9ad5-b4dbc2fae3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:15.008547 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2fa3b-1fc2-4771-9ad5-b4dbc2fae3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:15.058123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-dac2fa3b-1fc2-4771-9ad5-b4dbc2fae3c2 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:15.059396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-dac2fa3b-1fc2-4771-9ad5-b4dbc2fae3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:15.094172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1191/2390] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:15.099605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee35f1-7b3f-472c-8a0a-3685ebe6392d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:15.110420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:15.117839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee35f1-7b3f-472c-8a0a-3685ebe6392d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:15.134006 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f4b67-935d-4a68-bac7-2dcf379bbe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:15.134824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f4b67-935d-4a68-bac7-2dcf379bbe87 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:15.135109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f4b67-935d-4a68-bac7-2dcf379bbe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:15.135384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f4b67-935d-4a68-bac7-2dcf379bbe87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:15.136054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f4b67-935d-4a68-bac7-2dcf379bbe87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:15.136425 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f4b67-935d-4a68-bac7-2dcf379bbe87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:15.149912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f4b67-935d-4a68-bac7-2dcf379bbe87 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:15.175220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1200/2391] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:15.179848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2fa3b-1fc2-4771-9ad5-b4dbc2fae3c2 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:15.194924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2fa3b-1fc2-4771-9ad5-b4dbc2fae3c2 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:15.220984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1cf93-011e-4c5c-9cd1-ef8cfff92b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:15.221631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1cf93-011e-4c5c-9cd1-ef8cfff92b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:15.225205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1cf93-011e-4c5c-9cd1-ef8cfff92b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:15.225597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1cf93-011e-4c5c-9cd1-ef8cfff92b46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:15.226294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1cf93-011e-4c5c-9cd1-ef8cfff92b46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:15.228245 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1cf93-011e-4c5c-9cd1-ef8cfff92b46 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:15.405782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1192/2392] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:15 2022] POST /identity/v3/projects => generated 399 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:15.410142 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f4b67-935d-4a68-bac7-2dcf379bbe87 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:15.429764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f4b67-935d-4a68-bac7-2dcf379bbe87 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:15.555368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b27969-4565-45da-a535-9bdb5abf3a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:15.556141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b27969-4565-45da-a535-9bdb5abf3a70 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:15.556687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b27969-4565-45da-a535-9bdb5abf3a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:15.557109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b27969-4565-45da-a535-9bdb5abf3a70 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:15.558220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b27969-4565-45da-a535-9bdb5abf3a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:15.564371 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b27969-4565-45da-a535-9bdb5abf3a70 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:15.676995 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1201/2393] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:15 2022] POST /identity/v3/users => generated 300 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:15.683682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1cf93-011e-4c5c-9cd1-ef8cfff92b46 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:15.703567 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1cf93-011e-4c5c-9cd1-ef8cfff92b46 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:15.732885 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2679d-c2fc-4db6-852f-5fe6a2b433b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:15.735178 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2679d-c2fc-4db6-852f-5fe6a2b433b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:15.735595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2679d-c2fc-4db6-852f-5fe6a2b433b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:15.736580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2679d-c2fc-4db6-852f-5fe6a2b433b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:15.738849 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2679d-c2fc-4db6-852f-5fe6a2b433b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:15.741363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2679d-c2fc-4db6-852f-5fe6a2b433b0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:15.760985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1193/2394] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:15.769272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b27969-4565-45da-a535-9bdb5abf3a70 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:15.801688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b27969-4565-45da-a535-9bdb5abf3a70 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:15.817390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585ae66-bcd5-4161-88c5-878b30191243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:15.817390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585ae66-bcd5-4161-88c5-878b30191243 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:15.817390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585ae66-bcd5-4161-88c5-878b30191243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:15.817390 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585ae66-bcd5-4161-88c5-878b30191243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:15.818082 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585ae66-bcd5-4161-88c5-878b30191243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:15.818527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585ae66-bcd5-4161-88c5-878b30191243 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:15.853357 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2679d-c2fc-4db6-852f-5fe6a2b433b0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:15.853852 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1202/2395] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:15.871180 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2679d-c2fc-4db6-852f-5fe6a2b433b0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:15.908065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212cc65-2303-40ad-9f8d-78af3df7ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:15.911646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212cc65-2303-40ad-9f8d-78af3df7ecce admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:15.912219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212cc65-2303-40ad-9f8d-78af3df7ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:15.912703 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212cc65-2303-40ad-9f8d-78af3df7ecce admin admin] PATH_INFO: `/v3/projects/9cc56a4d950c47d5826fcf8152cf5cb5/users/f38bb81735df4e47be67e8ace92d3772/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:15.974361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212cc65-2303-40ad-9f8d-78af3df7ecce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc56a4d950c47d5826fcf8152cf5cb5, user_id=f38bb81735df4e47be67e8ace92d3772, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:15.985096 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212cc65-2303-40ad-9f8d-78af3df7ecce admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:16.141520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1194/2396] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:15 2022] PUT /identity/v3/projects/9cc56a4d950c47d5826fcf8152cf5cb5/users/f38bb81735df4e47be67e8ace92d3772/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:16.152585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f8c73-89b2-4e89-b714-3ad85541fdd2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:16.153242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f8c73-89b2-4e89-b714-3ad85541fdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:16.153758 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f8c73-89b2-4e89-b714-3ad85541fdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:16.285246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-675f8c73-89b2-4e89-b714-3ad85541fdd2 None None] MFA Rules not processed for user `f38bb81735df4e47be67e8ace92d3772`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:16.287393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-675f8c73-89b2-4e89-b714-3ad85541fdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:16.565598 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1203/2397] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:16.566770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212cc65-2303-40ad-9f8d-78af3df7ecce admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:16.713328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212cc65-2303-40ad-9f8d-78af3df7ecce admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:16.736444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4cc9a-e766-4277-84d7-542533635be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:16.737097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cc9a-e766-4277-84d7-542533635be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:16.737386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cc9a-e766-4277-84d7-542533635be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:16.737661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cc9a-e766-4277-84d7-542533635be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:16.738371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4cc9a-e766-4277-84d7-542533635be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:16.751413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4cc9a-e766-4277-84d7-542533635be9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:16.888969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1195/2398] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:16 2022] POST /identity/v3/projects => generated 399 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:16.898672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f8c73-89b2-4e89-b714-3ad85541fdd2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:16.919796 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f8c73-89b2-4e89-b714-3ad85541fdd2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:17.094398 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858f36c-506e-4989-8e7f-17746c5dd0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:17.094398 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858f36c-506e-4989-8e7f-17746c5dd0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:17.094398 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858f36c-506e-4989-8e7f-17746c5dd0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:17.094849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858f36c-506e-4989-8e7f-17746c5dd0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:17.095197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858f36c-506e-4989-8e7f-17746c5dd0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:17.115219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858f36c-506e-4989-8e7f-17746c5dd0c5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:17.123282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:17.208018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1204/2399] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:16 2022] POST /identity/v3/users => generated 306 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:17.211083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4cc9a-e766-4277-84d7-542533635be9 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:17.233572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:17.241630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4cc9a-e766-4277-84d7-542533635be9 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:17.250525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77071cf4-43f7-4fc8-a7f0-bb6c0c6da620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:17.251736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77071cf4-43f7-4fc8-a7f0-bb6c0c6da620 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:17.252174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77071cf4-43f7-4fc8-a7f0-bb6c0c6da620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:17.252646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77071cf4-43f7-4fc8-a7f0-bb6c0c6da620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:17.257754 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77071cf4-43f7-4fc8-a7f0-bb6c0c6da620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:17.258417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77071cf4-43f7-4fc8-a7f0-bb6c0c6da620 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:17.280301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858f36c-506e-4989-8e7f-17746c5dd0c5 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:17.285380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1196/2400] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:17.319512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858f36c-506e-4989-8e7f-17746c5dd0c5 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:17.361453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc0749-c012-4e4e-a7f8-c215ddc6648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:17.362984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc0749-c012-4e4e-a7f8-c215ddc6648e admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:17.366268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc0749-c012-4e4e-a7f8-c215ddc6648e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:17.371499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc0749-c012-4e4e-a7f8-c215ddc6648e admin admin] PATH_INFO: `/v3/projects/d15c2eb8b10d47c7a71bcba84bca52b7/users/bf47bad32db74ab8893e617b40c18389/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:17.458029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc0749-c012-4e4e-a7f8-c215ddc6648e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15c2eb8b10d47c7a71bcba84bca52b7, user_id=bf47bad32db74ab8893e617b40c18389, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:17.465336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc0749-c012-4e4e-a7f8-c215ddc6648e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:17.586551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1205/2401] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:17 2022] PUT /identity/v3/projects/d15c2eb8b10d47c7a71bcba84bca52b7/users/bf47bad32db74ab8893e617b40c18389/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:17.591294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77071cf4-43f7-4fc8-a7f0-bb6c0c6da620 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:17.636132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77071cf4-43f7-4fc8-a7f0-bb6c0c6da620 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:17.792903 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f343008-f2be-4f7e-8cf4-6649451c8082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:17.793660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f343008-f2be-4f7e-8cf4-6649451c8082 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:17.793963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f343008-f2be-4f7e-8cf4-6649451c8082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:17.794234 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f343008-f2be-4f7e-8cf4-6649451c8082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:17.794994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f343008-f2be-4f7e-8cf4-6649451c8082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:17.803558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f343008-f2be-4f7e-8cf4-6649451c8082 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:17.838210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1197/2402] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:17.840282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc0749-c012-4e4e-a7f8-c215ddc6648e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:17.862232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc0749-c012-4e4e-a7f8-c215ddc6648e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:17.882877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165580d0-5246-4829-8310-9b78aaa84d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:17.883614 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165580d0-5246-4829-8310-9b78aaa84d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:17.883857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165580d0-5246-4829-8310-9b78aaa84d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:17.884269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165580d0-5246-4829-8310-9b78aaa84d42 admin admin] PATH_INFO: `/v3/projects/d15c2eb8b10d47c7a71bcba84bca52b7/users/bf47bad32db74ab8893e617b40c18389/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:17.897595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165580d0-5246-4829-8310-9b78aaa84d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15c2eb8b10d47c7a71bcba84bca52b7, user_id=bf47bad32db74ab8893e617b40c18389, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:17.900644 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165580d0-5246-4829-8310-9b78aaa84d42 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:17.951400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1206/2403] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:17 2022] PUT /identity/v3/projects/d15c2eb8b10d47c7a71bcba84bca52b7/users/bf47bad32db74ab8893e617b40c18389/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:17.968860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b50a0-9232-43f8-95b7-513369966e47 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:17.968860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b50a0-9232-43f8-95b7-513369966e47 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:17.969206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b50a0-9232-43f8-95b7-513369966e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:18.053779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-638b50a0-9232-43f8-95b7-513369966e47 None None] MFA Rules not processed for user `bf47bad32db74ab8893e617b40c18389`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:18.055615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-638b50a0-9232-43f8-95b7-513369966e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:18.322092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1198/2404] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:18.343223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165580d0-5246-4829-8310-9b78aaa84d42 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:18.345756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-165580d0-5246-4829-8310-9b78aaa84d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:18.493437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165580d0-5246-4829-8310-9b78aaa84d42 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:18.500194 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d9e4a-c074-4750-871c-18e796f4a30a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:18.500868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d9e4a-c074-4750-871c-18e796f4a30a service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:18.501399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d9e4a-c074-4750-871c-18e796f4a30a service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:18.501982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d9e4a-c074-4750-871c-18e796f4a30a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:18.518706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d9e4a-c074-4750-871c-18e796f4a30a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:18.524286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d9e4a-c074-4750-871c-18e796f4a30a service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:18.548483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1207/2405] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:18 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:18.916500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b50a0-9232-43f8-95b7-513369966e47 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:18.961923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b50a0-9232-43f8-95b7-513369966e47 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:18.970479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9ee18-e81b-45eb-bed1-29a326d9a207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:18.971132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9ee18-e81b-45eb-bed1-29a326d9a207 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:18.971411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9ee18-e81b-45eb-bed1-29a326d9a207 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:18.971690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9ee18-e81b-45eb-bed1-29a326d9a207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:19.084465 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9ee18-e81b-45eb-bed1-29a326d9a207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:19.085859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9ee18-e81b-45eb-bed1-29a326d9a207 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:19.103760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1199/2406] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:19.722695 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30527625-53a9-40d2-b7cc-10fc6dc9387c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:19.724629 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30527625-53a9-40d2-b7cc-10fc6dc9387c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:19.724629 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30527625-53a9-40d2-b7cc-10fc6dc9387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:19.798484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-30527625-53a9-40d2-b7cc-10fc6dc9387c None None] MFA Rules not processed for user `74b1bcdf6d764bb9824cbb2b538a1f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:19.800120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-30527625-53a9-40d2-b7cc-10fc6dc9387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:19.925692 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1208/2407] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:19.940519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9ee18-e81b-45eb-bed1-29a326d9a207 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:19.942387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-afa9ee18-e81b-45eb-bed1-29a326d9a207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:19.964503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:20.058269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9ee18-e81b-45eb-bed1-29a326d9a207 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:20.094715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd3391-63ed-462a-97b6-c0a9f503053e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a16e6246fb4693b044bf939bce8244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:20.096113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd3391-63ed-462a-97b6-c0a9f503053e service glance] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:20.098350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd3391-63ed-462a-97b6-c0a9f503053e service glance] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:20.099333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd3391-63ed-462a-97b6-c0a9f503053e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:20.104778 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d6dd3391-63ed-462a-97b6-c0a9f503053e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:20.207944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd3391-63ed-462a-97b6-c0a9f503053e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:20.209674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd3391-63ed-462a-97b6-c0a9f503053e service glance] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:20.251013 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1200/2408] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:20.671640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbffc62-efec-4b56-bd2e-1d207c5d741a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:20.671923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbffc62-efec-4b56-bd2e-1d207c5d741a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:20.677427 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbffc62-efec-4b56-bd2e-1d207c5d741a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:20.701315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5dbffc62-efec-4b56-bd2e-1d207c5d741a None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:20.708596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5dbffc62-efec-4b56-bd2e-1d207c5d741a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:20.780108 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:20.812244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1209/2409] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:20.839929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd3391-63ed-462a-97b6-c0a9f503053e service glance] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:20.842767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d6dd3391-63ed-462a-97b6-c0a9f503053e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:21.037744 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd3391-63ed-462a-97b6-c0a9f503053e service glance] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:21.054335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85933783-9a59-42b9-bc6a-2bdebca8d6ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:21.055555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85933783-9a59-42b9-bc6a-2bdebca8d6ba service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:21.057395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85933783-9a59-42b9-bc6a-2bdebca8d6ba service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:21.058853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85933783-9a59-42b9-bc6a-2bdebca8d6ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:21.103295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85933783-9a59-42b9-bc6a-2bdebca8d6ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:21.114294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85933783-9a59-42b9-bc6a-2bdebca8d6ba service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:21.135494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1201/2410] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:42:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:25.944027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbffc62-efec-4b56-bd2e-1d207c5d741a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:26.103943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbffc62-efec-4b56-bd2e-1d207c5d741a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:26.110557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:26.111312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:26.111587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:26.112044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] PATH_INFO: `/v3/users/f38bb81735df4e47be67e8ace92d3772` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:26.113570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f38bb81735df4e47be67e8ace92d3772)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:26.116155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:26.887235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f38bb81735df4e47be67e8ace92d3772'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.895465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f38bb81735df4e47be67e8ace92d3772'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:26.899320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f38bb81735df4e47be67e8ace92d3772'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:27.059050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f38bb81735df4e47be67e8ace92d3772'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:27.080518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f38bb81735df4e47be67e8ace92d3772'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:27.087931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1210/2411] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:25 2022] DELETE /identity/v3/users/f38bb81735df4e47be67e8ace92d3772 => generated 0 bytes in 1144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:27.093797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5940aa-b6dd-4897-a4a8-c5d1fff74453 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.094863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5940aa-b6dd-4897-a4a8-c5d1fff74453 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.095336 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5940aa-b6dd-4897-a4a8-c5d1fff74453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.136689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-6b5940aa-b6dd-4897-a4a8-c5d1fff74453 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:27.138366 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6b5940aa-b6dd-4897-a4a8-c5d1fff74453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:27.223726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:27.243677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1202/2412] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:27.263527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:27.263527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:27.437277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d000357-4318-4e52-923f-f6c09556d39c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:27.442784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ff40d-2d57-4311-a0b7-cc6ad8357c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:27.443412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ff40d-2d57-4311-a0b7-cc6ad8357c2e service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:27.443694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ff40d-2d57-4311-a0b7-cc6ad8357c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:27.443970 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ff40d-2d57-4311-a0b7-cc6ad8357c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:27.461744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ff40d-2d57-4311-a0b7-cc6ad8357c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:27.463867 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ff40d-2d57-4311-a0b7-cc6ad8357c2e service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:27.477065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1211/2413] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:28.131591 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5940aa-b6dd-4897-a4a8-c5d1fff74453 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.131591 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6b5940aa-b6dd-4897-a4a8-c5d1fff74453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:28.157038 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5940aa-b6dd-4897-a4a8-c5d1fff74453 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:28.173313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.177795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.178632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.179089 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] PATH_INFO: `/v3/projects/9cc56a4d950c47d5826fcf8152cf5cb5` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.180682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc56a4d950c47d5826fcf8152cf5cb5)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.183090 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:28.416700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc56a4d950c47d5826fcf8152cf5cb5', 'request_id': 'req-5eedda6d-4e4b-4b56-80b5-843998ea1953'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.428037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc56a4d950c47d5826fcf8152cf5cb5', 'request_id': 'req-5eedda6d-4e4b-4b56-80b5-843998ea1953'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.437697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc56a4d950c47d5826fcf8152cf5cb5', 'request_id': 'req-5eedda6d-4e4b-4b56-80b5-843998ea1953'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.611595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] The token cache is being invalidate because project 9cc56a4d950c47d5826fcf8152cf5cb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:28.620405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.620405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:28.620405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1203/2414] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:28 2022] DELETE /identity/v3/projects/9cc56a4d950c47d5826fcf8152cf5cb5 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:28.621188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ff40d-2d57-4311-a0b7-cc6ad8357c2e service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:28.638695 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ff40d-2d57-4311-a0b7-cc6ad8357c2e service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:28.649509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:28.728232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070f329-2857-4f08-a176-16456eb9e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:28.728869 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070f329-2857-4f08-a176-16456eb9e4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:28.729198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070f329-2857-4f08-a176-16456eb9e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:28.729471 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070f329-2857-4f08-a176-16456eb9e4ff admin admin] PATH_INFO: `/v3/users/bf47bad32db74ab8893e617b40c18389` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:28.730703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070f329-2857-4f08-a176-16456eb9e4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf47bad32db74ab8893e617b40c18389)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:28.733666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070f329-2857-4f08-a176-16456eb9e4ff admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:29.025353 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d070f329-2857-4f08-a176-16456eb9e4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf47bad32db74ab8893e617b40c18389'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:29.043797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d070f329-2857-4f08-a176-16456eb9e4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf47bad32db74ab8893e617b40c18389'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:29.043797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d070f329-2857-4f08-a176-16456eb9e4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf47bad32db74ab8893e617b40c18389'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:29.191367 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d070f329-2857-4f08-a176-16456eb9e4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf47bad32db74ab8893e617b40c18389'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:29.251391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d070f329-2857-4f08-a176-16456eb9e4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf47bad32db74ab8893e617b40c18389'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:29.272506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1212/2415] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:28 2022] DELETE /identity/v3/users/bf47bad32db74ab8893e617b40c18389 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:29.984634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:29.986379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:30.030351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedda6d-4e4b-4b56-80b5-843998ea1953 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:30.195940 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:30.196614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:30.197043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:30.197320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] PATH_INFO: `/v3/projects/d15c2eb8b10d47c7a71bcba84bca52b7` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:30.198521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15c2eb8b10d47c7a71bcba84bca52b7)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:30.200552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:30.796483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15c2eb8b10d47c7a71bcba84bca52b7', 'request_id': 'req-7ddabc96-9358-4256-9620-fbae32ead2fe'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.808671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15c2eb8b10d47c7a71bcba84bca52b7', 'request_id': 'req-7ddabc96-9358-4256-9620-fbae32ead2fe'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.818637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15c2eb8b10d47c7a71bcba84bca52b7', 'request_id': 'req-7ddabc96-9358-4256-9620-fbae32ead2fe'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.935014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] The token cache is being invalidate because project d15c2eb8b10d47c7a71bcba84bca52b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:30.935665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.938531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7ddabc96-9358-4256-9620-fbae32ead2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:30.941497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1204/2416] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:29 2022] DELETE /identity/v3/projects/d15c2eb8b10d47c7a71bcba84bca52b7 => generated 0 bytes in 958 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:30.948023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b515e-c8bd-4391-8286-31a4dd7a8e83 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:30.949177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b515e-c8bd-4391-8286-31a4dd7a8e83 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:30.949677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b515e-c8bd-4391-8286-31a4dd7a8e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:30.985258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e92b515e-c8bd-4391-8286-31a4dd7a8e83 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:30.987529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e92b515e-c8bd-4391-8286-31a4dd7a8e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:31.125935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1213/2417] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:31.134133 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3749e-90d3-4a92-8e86-32c841b98fb7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.134712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3749e-90d3-4a92-8e86-32c841b98fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.134844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3749e-90d3-4a92-8e86-32c841b98fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.163824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c5f3749e-90d3-4a92-8e86-32c841b98fb7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:31.165158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c5f3749e-90d3-4a92-8e86-32c841b98fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:31.179945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1205/2418] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:31.181057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b515e-c8bd-4391-8286-31a4dd7a8e83 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.196138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b515e-c8bd-4391-8286-31a4dd7a8e83 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.203253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433cf2-afda-4e94-9a61-338e09d58f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.204204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433cf2-afda-4e94-9a61-338e09d58f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.204558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433cf2-afda-4e94-9a61-338e09d58f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.204905 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433cf2-afda-4e94-9a61-338e09d58f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.205642 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46433cf2-afda-4e94-9a61-338e09d58f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:31.206052 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46433cf2-afda-4e94-9a61-338e09d58f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.207762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46433cf2-afda-4e94-9a61-338e09d58f1e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:31.230198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3749e-90d3-4a92-8e86-32c841b98fb7 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.236575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1214/2419] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:31.236886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:31.247071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3749e-90d3-4a92-8e86-32c841b98fb7 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.255359 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37c839-7ab2-47a9-b56c-84b69705c5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.256299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37c839-7ab2-47a9-b56c-84b69705c5b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.256758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37c839-7ab2-47a9-b56c-84b69705c5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.257016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37c839-7ab2-47a9-b56c-84b69705c5b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.257677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37c839-7ab2-47a9-b56c-84b69705c5b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.263297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37c839-7ab2-47a9-b56c-84b69705c5b3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:31.376272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1206/2420] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:31 2022] POST /identity/v3/projects => generated 407 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:31.380865 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433cf2-afda-4e94-9a61-338e09d58f1e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.395640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433cf2-afda-4e94-9a61-338e09d58f1e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.410260 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:31.503263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd563ce-508c-4634-a605-69856b195e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.504470 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd563ce-508c-4634-a605-69856b195e08 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.504831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd563ce-508c-4634-a605-69856b195e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.505180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd563ce-508c-4634-a605-69856b195e08 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.506153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd563ce-508c-4634-a605-69856b195e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.508705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd563ce-508c-4634-a605-69856b195e08 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:31.676753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1215/2421] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:31 2022] POST /identity/v3/users => generated 304 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:31.679415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37c839-7ab2-47a9-b56c-84b69705c5b3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.693181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37c839-7ab2-47a9-b56c-84b69705c5b3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.712706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3584e1-aeb6-4972-90db-f792500081e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.713794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3584e1-aeb6-4972-90db-f792500081e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.714290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3584e1-aeb6-4972-90db-f792500081e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.714682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3584e1-aeb6-4972-90db-f792500081e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.715413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3584e1-aeb6-4972-90db-f792500081e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.717615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3584e1-aeb6-4972-90db-f792500081e8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:31.738956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1207/2422] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:31.739818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd563ce-508c-4634-a605-69856b195e08 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.753703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd563ce-508c-4634-a605-69856b195e08 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.760546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2e912-b318-4d54-ad9a-86cb41ad4417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.761474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e912-b318-4d54-ad9a-86cb41ad4417 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.761859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e912-b318-4d54-ad9a-86cb41ad4417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.762381 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e912-b318-4d54-ad9a-86cb41ad4417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.763144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2e912-b318-4d54-ad9a-86cb41ad4417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.766218 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2e912-b318-4d54-ad9a-86cb41ad4417 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:31.782336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1216/2423] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:31.786514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3584e1-aeb6-4972-90db-f792500081e8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:31.805296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3584e1-aeb6-4972-90db-f792500081e8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:31.816208 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d327f2-2a2d-49e2-9314-873560ad3c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:31.817065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d327f2-2a2d-49e2-9314-873560ad3c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:31.817450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d327f2-2a2d-49e2-9314-873560ad3c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:31.817851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d327f2-2a2d-49e2-9314-873560ad3c4b admin admin] PATH_INFO: `/v3/projects/0650151a66104857aab909d235c0384a/users/adf1ff245237453b8ab112c4be7a7b6b/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:31.861090 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d327f2-2a2d-49e2-9314-873560ad3c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0650151a66104857aab909d235c0384a, user_id=adf1ff245237453b8ab112c4be7a7b6b, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:31.864786 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d327f2-2a2d-49e2-9314-873560ad3c4b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:32.006668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1208/2424] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:31 2022] PUT /identity/v3/projects/0650151a66104857aab909d235c0384a/users/adf1ff245237453b8ab112c4be7a7b6b/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:32.019624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6e78b-309e-4103-8ebd-ed7bbfa231e3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.026359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6e78b-309e-4103-8ebd-ed7bbfa231e3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.027405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6e78b-309e-4103-8ebd-ed7bbfa231e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.111956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-14d6e78b-309e-4103-8ebd-ed7bbfa231e3 None None] MFA Rules not processed for user `adf1ff245237453b8ab112c4be7a7b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:32.113489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-14d6e78b-309e-4103-8ebd-ed7bbfa231e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:32.234241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d327f2-2a2d-49e2-9314-873560ad3c4b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:32.241513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-81d327f2-2a2d-49e2-9314-873560ad3c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:32.302359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1217/2425] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:32.309000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6e78b-309e-4103-8ebd-ed7bbfa231e3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:32.358729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d327f2-2a2d-49e2-9314-873560ad3c4b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:32.375904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821181f5-1f9e-4773-a8d5-3cc03ebc127f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:32.377002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821181f5-1f9e-4773-a8d5-3cc03ebc127f service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.377516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821181f5-1f9e-4773-a8d5-3cc03ebc127f service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.378058 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821181f5-1f9e-4773-a8d5-3cc03ebc127f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.384215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-821181f5-1f9e-4773-a8d5-3cc03ebc127f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:32.419040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6e78b-309e-4103-8ebd-ed7bbfa231e3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:32.427696 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d0673-1005-4327-ab00-6cce8e82b94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:32.431281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0673-1005-4327-ab00-6cce8e82b94e admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.431658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0673-1005-4327-ab00-6cce8e82b94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.432130 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d0673-1005-4327-ab00-6cce8e82b94e admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.432887 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d0673-1005-4327-ab00-6cce8e82b94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:32.434996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d0673-1005-4327-ab00-6cce8e82b94e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:32.516025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821181f5-1f9e-4773-a8d5-3cc03ebc127f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:32.517706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821181f5-1f9e-4773-a8d5-3cc03ebc127f service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:32.532316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1209/2426] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:32.578093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1218/2427] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:32 2022] POST /identity/v3/projects => generated 409 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:32.579308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821181f5-1f9e-4773-a8d5-3cc03ebc127f service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:32.596427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821181f5-1f9e-4773-a8d5-3cc03ebc127f service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:32.733324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:32.740910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7f0be-65b6-4c4d-91e2-635250f5a011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:32.742231 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7f0be-65b6-4c4d-91e2-635250f5a011 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.742231 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7f0be-65b6-4c4d-91e2-635250f5a011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.742447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7f0be-65b6-4c4d-91e2-635250f5a011 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.743105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7f0be-65b6-4c4d-91e2-635250f5a011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:32.745582 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7f0be-65b6-4c4d-91e2-635250f5a011 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:32.917203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1210/2428] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:32 2022] POST /identity/v3/users => generated 311 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:32.921062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d0673-1005-4327-ab00-6cce8e82b94e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:32.946873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d0673-1005-4327-ab00-6cce8e82b94e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:32.989304 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e436b8-b7fb-476d-89bb-dcec3f991a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:32.992157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e436b8-b7fb-476d-89bb-dcec3f991a60 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:32.992503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e436b8-b7fb-476d-89bb-dcec3f991a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:32.992784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e436b8-b7fb-476d-89bb-dcec3f991a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:32.993459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e436b8-b7fb-476d-89bb-dcec3f991a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:33.002764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e436b8-b7fb-476d-89bb-dcec3f991a60 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:33.005581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:33.026662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1219/2429] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:33.028238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7f0be-65b6-4c4d-91e2-635250f5a011 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:33.044937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7f0be-65b6-4c4d-91e2-635250f5a011 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:33.053381 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741f721-10db-42a3-b1a3-0dcff7d7121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:33.055020 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741f721-10db-42a3-b1a3-0dcff7d7121f admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:33.055339 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741f721-10db-42a3-b1a3-0dcff7d7121f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:33.056114 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741f721-10db-42a3-b1a3-0dcff7d7121f admin admin] PATH_INFO: `/v3/projects/8edfeb04f39848ae83e2080756fb25a2/users/75784a0c1769451c87037d95e021b898/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:33.083610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741f721-10db-42a3-b1a3-0dcff7d7121f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8edfeb04f39848ae83e2080756fb25a2, user_id=75784a0c1769451c87037d95e021b898, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:33.089164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741f721-10db-42a3-b1a3-0dcff7d7121f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:33.277297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1211/2430] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:33 2022] PUT /identity/v3/projects/8edfeb04f39848ae83e2080756fb25a2/users/75784a0c1769451c87037d95e021b898/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:33.281984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e436b8-b7fb-476d-89bb-dcec3f991a60 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:33.299130 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e436b8-b7fb-476d-89bb-dcec3f991a60 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:33.383864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934ab1a-8cc6-4b1d-90af-cd8a6917d81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:33.384487 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934ab1a-8cc6-4b1d-90af-cd8a6917d81b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:33.384764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934ab1a-8cc6-4b1d-90af-cd8a6917d81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:33.385093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934ab1a-8cc6-4b1d-90af-cd8a6917d81b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:33.385731 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934ab1a-8cc6-4b1d-90af-cd8a6917d81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:33.387484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934ab1a-8cc6-4b1d-90af-cd8a6917d81b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:33.402652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1220/2431] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:33.407095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741f721-10db-42a3-b1a3-0dcff7d7121f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:33.419040 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741f721-10db-42a3-b1a3-0dcff7d7121f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:33.426448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949c168-477b-4977-a9cb-93dd64d98619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:33.434206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949c168-477b-4977-a9cb-93dd64d98619 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:33.434206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949c168-477b-4977-a9cb-93dd64d98619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:33.434206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949c168-477b-4977-a9cb-93dd64d98619 admin admin] PATH_INFO: `/v3/projects/8edfeb04f39848ae83e2080756fb25a2/users/75784a0c1769451c87037d95e021b898/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:33.434206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949c168-477b-4977-a9cb-93dd64d98619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8edfeb04f39848ae83e2080756fb25a2, user_id=75784a0c1769451c87037d95e021b898, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:33.434206 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949c168-477b-4977-a9cb-93dd64d98619 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:33.445504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1212/2432] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:33 2022] PUT /identity/v3/projects/8edfeb04f39848ae83e2080756fb25a2/users/75784a0c1769451c87037d95e021b898/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:33.456651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d680d2-b355-4917-a427-48b41cda6cdb None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:33.457215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d680d2-b355-4917-a427-48b41cda6cdb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:33.457491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d680d2-b355-4917-a427-48b41cda6cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:33.501791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-83d680d2-b355-4917-a427-48b41cda6cdb None None] MFA Rules not processed for user `75784a0c1769451c87037d95e021b898`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:33.503424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-83d680d2-b355-4917-a427-48b41cda6cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:33.629775 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1221/2433] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:33.642938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949c168-477b-4977-a9cb-93dd64d98619 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:33.645356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2949c168-477b-4977-a9cb-93dd64d98619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:33.737241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949c168-477b-4977-a9cb-93dd64d98619 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:33.745660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6798bdf-0b27-4fe6-bc35-788abeda8822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:33.747113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798bdf-0b27-4fe6-bc35-788abeda8822 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:33.749019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798bdf-0b27-4fe6-bc35-788abeda8822 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:33.749019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798bdf-0b27-4fe6-bc35-788abeda8822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:33.764942 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6798bdf-0b27-4fe6-bc35-788abeda8822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:33.766481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6798bdf-0b27-4fe6-bc35-788abeda8822 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:33.781110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501fe1a-12e5-42f1-97ff-11ece95c4faf None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:33.781750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501fe1a-12e5-42f1-97ff-11ece95c4faf None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:33.782455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501fe1a-12e5-42f1-97ff-11ece95c4faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:33.786443 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1213/2434] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:33 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:33.812322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6501fe1a-12e5-42f1-97ff-11ece95c4faf None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:33.813753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6501fe1a-12e5-42f1-97ff-11ece95c4faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:33.920983 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1222/2435] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:33.953491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6798bdf-0b27-4fe6-bc35-788abeda8822 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:33.955716 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d6798bdf-0b27-4fe6-bc35-788abeda8822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:34.087887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6798bdf-0b27-4fe6-bc35-788abeda8822 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:34.105745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db627bc6-dd0f-4fa5-828f-27f12311cd2a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:34.106597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db627bc6-dd0f-4fa5-828f-27f12311cd2a service swift] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:34.106597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db627bc6-dd0f-4fa5-828f-27f12311cd2a service swift] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:34.106792 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db627bc6-dd0f-4fa5-828f-27f12311cd2a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:34.118566 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db627bc6-dd0f-4fa5-828f-27f12311cd2a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:34.120325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db627bc6-dd0f-4fa5-828f-27f12311cd2a service swift] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:34.140048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1214/2436] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:42:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:34.477824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501fe1a-12e5-42f1-97ff-11ece95c4faf None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:34.500237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501fe1a-12e5-42f1-97ff-11ece95c4faf None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:34.513647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d857314-112f-487a-92cd-4f5440021ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:34.519991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d857314-112f-487a-92cd-4f5440021ffc service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:34.521376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d857314-112f-487a-92cd-4f5440021ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:34.522412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d857314-112f-487a-92cd-4f5440021ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:34.574631 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:34.671122 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d857314-112f-487a-92cd-4f5440021ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:34.673992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d857314-112f-487a-92cd-4f5440021ffc service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:34.704450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1223/2437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:34 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:38.022486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023022ee-ecbf-433d-b5e6-ad8f2c71faac None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:38.023434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023022ee-ecbf-433d-b5e6-ad8f2c71faac None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:38.023772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023022ee-ecbf-433d-b5e6-ad8f2c71faac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:38.116842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-023022ee-ecbf-433d-b5e6-ad8f2c71faac None None] MFA Rules not processed for user `418adb6ed5284c398d86dffa19b3d16f`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:38.125993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-023022ee-ecbf-433d-b5e6-ad8f2c71faac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:38.217530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:38.260918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1215/2438] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:38.951245 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d857314-112f-487a-92cd-4f5440021ffc service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:38.954791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5d857314-112f-487a-92cd-4f5440021ffc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:39.144899 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d857314-112f-487a-92cd-4f5440021ffc service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:39.160378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55a495-013f-4f56-b28a-eea5b8cd0507 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d15478ca864f49aae2301e2328fe23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:39.165636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a495-013f-4f56-b28a-eea5b8cd0507 service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:39.165636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a495-013f-4f56-b28a-eea5b8cd0507 service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:39.165636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a495-013f-4f56-b28a-eea5b8cd0507 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:39.172553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fa55a495-013f-4f56-b28a-eea5b8cd0507 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:39.209205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55a495-013f-4f56-b28a-eea5b8cd0507 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:39.211244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55a495-013f-4f56-b28a-eea5b8cd0507 service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:39.225979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1224/2439] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:39.365027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023022ee-ecbf-433d-b5e6-ad8f2c71faac None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:39.366657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-023022ee-ecbf-433d-b5e6-ad8f2c71faac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:39.457517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023022ee-ecbf-433d-b5e6-ad8f2c71faac None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:39.462263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bb2f4-54c1-4624-a573-fd8786c799b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:39.462901 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb2f4-54c1-4624-a573-fd8786c799b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:39.463172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb2f4-54c1-4624-a573-fd8786c799b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:39.463615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bb2f4-54c1-4624-a573-fd8786c799b5 admin admin] PATH_INFO: `/v3/users/c33b81f98c4e4e919d60f408ad24e594` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:39.464753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb2f4-54c1-4624-a573-fd8786c799b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33b81f98c4e4e919d60f408ad24e594)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:39.466880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bb2f4-54c1-4624-a573-fd8786c799b5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:39.773810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c00bb2f4-54c1-4624-a573-fd8786c799b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33b81f98c4e4e919d60f408ad24e594'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.785355 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c00bb2f4-54c1-4624-a573-fd8786c799b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33b81f98c4e4e919d60f408ad24e594'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.786229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c00bb2f4-54c1-4624-a573-fd8786c799b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33b81f98c4e4e919d60f408ad24e594'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.964494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c00bb2f4-54c1-4624-a573-fd8786c799b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33b81f98c4e4e919d60f408ad24e594'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:39.965368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c00bb2f4-54c1-4624-a573-fd8786c799b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33b81f98c4e4e919d60f408ad24e594'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:40.049629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1216/2440] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:39 2022] DELETE /identity/v3/users/c33b81f98c4e4e919d60f408ad24e594 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:41.433222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55a495-013f-4f56-b28a-eea5b8cd0507 service placement] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:41.446608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55a495-013f-4f56-b28a-eea5b8cd0507 service placement] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:41.615177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:41.615177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:41.615177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:41.615177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] PATH_INFO: `/v3/projects/c1880b0226ac4d6fb1407e2242609f8a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:41.616300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1880b0226ac4d6fb1407e2242609f8a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:41.616300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:41.845768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1880b0226ac4d6fb1407e2242609f8a', 'request_id': 'req-5b68a226-c70a-4238-b726-ade106f8dfee'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:41.853941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:41.867400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1880b0226ac4d6fb1407e2242609f8a', 'request_id': 'req-5b68a226-c70a-4238-b726-ade106f8dfee'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:42.046154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1880b0226ac4d6fb1407e2242609f8a', 'request_id': 'req-5b68a226-c70a-4238-b726-ade106f8dfee'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:42.062664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] The token cache is being invalidate because project c1880b0226ac4d6fb1407e2242609f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:42.063241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:42.064106 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5b68a226-c70a-4238-b726-ade106f8dfee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:42.066029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1225/2441] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:41 2022] DELETE /identity/v3/projects/c1880b0226ac4d6fb1407e2242609f8a => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:42.071335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f7e87-5bb0-4f11-8c81-eb260ccb3d18 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.072008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f7e87-5bb0-4f11-8c81-eb260ccb3d18 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.072295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f7e87-5bb0-4f11-8c81-eb260ccb3d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.131906 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a50f7e87-5bb0-4f11-8c81-eb260ccb3d18 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:42.133620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a50f7e87-5bb0-4f11-8c81-eb260ccb3d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:42.241572 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1217/2442] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:42.251836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d3e6f-e94a-4bd2-9a62-36f99ee246dc None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.257015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d3e6f-e94a-4bd2-9a62-36f99ee246dc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.257015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d3e6f-e94a-4bd2-9a62-36f99ee246dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.300388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ab5d3e6f-e94a-4bd2-9a62-36f99ee246dc None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:42.301804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ab5d3e6f-e94a-4bd2-9a62-36f99ee246dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:42.325222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1226/2443] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:42.326923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f7e87-5bb0-4f11-8c81-eb260ccb3d18 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.339047 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f7e87-5bb0-4f11-8c81-eb260ccb3d18 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.355198 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ab469-b4b5-4840-8538-48fefb47db1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.355924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ab469-b4b5-4840-8538-48fefb47db1d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.356248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ab469-b4b5-4840-8538-48fefb47db1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.356561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ab469-b4b5-4840-8538-48fefb47db1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.357995 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ab469-b4b5-4840-8538-48fefb47db1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:42.358596 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ab469-b4b5-4840-8538-48fefb47db1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.360373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ab469-b4b5-4840-8538-48fefb47db1d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.362515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:42.377927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1218/2444] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:42.386643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d3e6f-e94a-4bd2-9a62-36f99ee246dc None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.397449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d3e6f-e94a-4bd2-9a62-36f99ee246dc None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.404227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44c4e8-5379-4b24-9833-60f17a9f0468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.405732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44c4e8-5379-4b24-9833-60f17a9f0468 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.405732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44c4e8-5379-4b24-9833-60f17a9f0468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.418213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44c4e8-5379-4b24-9833-60f17a9f0468 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.419050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44c4e8-5379-4b24-9833-60f17a9f0468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.421591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44c4e8-5379-4b24-9833-60f17a9f0468 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.571345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1227/2445] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:42 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:42.573139 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ab469-b4b5-4840-8538-48fefb47db1d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.590455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ab469-b4b5-4840-8538-48fefb47db1d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.674713 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36b123-991b-4487-ad12-8c0d93e15fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.675398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b123-991b-4487-ad12-8c0d93e15fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.675789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b123-991b-4487-ad12-8c0d93e15fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.676068 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b123-991b-4487-ad12-8c0d93e15fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.676918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36b123-991b-4487-ad12-8c0d93e15fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.679242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36b123-991b-4487-ad12-8c0d93e15fa8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.790309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1219/2446] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:42 2022] POST /identity/v3/users => generated 303 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:42.792110 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44c4e8-5379-4b24-9833-60f17a9f0468 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.811958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44c4e8-5379-4b24-9833-60f17a9f0468 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.828120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269bb78-d104-433d-bfa1-59f3be2bf7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.829039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269bb78-d104-433d-bfa1-59f3be2bf7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.829324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269bb78-d104-433d-bfa1-59f3be2bf7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.829596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269bb78-d104-433d-bfa1-59f3be2bf7c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.830982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269bb78-d104-433d-bfa1-59f3be2bf7c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.832682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269bb78-d104-433d-bfa1-59f3be2bf7c9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.847534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1228/2447] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:42.852043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36b123-991b-4487-ad12-8c0d93e15fa8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.866845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36b123-991b-4487-ad12-8c0d93e15fa8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.881992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f5655-6d89-4029-8e2b-71cfcda0e645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.882628 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f5655-6d89-4029-8e2b-71cfcda0e645 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.882911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f5655-6d89-4029-8e2b-71cfcda0e645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.883276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f5655-6d89-4029-8e2b-71cfcda0e645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.884153 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f5655-6d89-4029-8e2b-71cfcda0e645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.886016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f5655-6d89-4029-8e2b-71cfcda0e645 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:42.913262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1220/2448] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:42.916580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269bb78-d104-433d-bfa1-59f3be2bf7c9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:42.928469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269bb78-d104-433d-bfa1-59f3be2bf7c9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:42.933971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef6b4e-aea4-458b-a51a-399df17d2d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:42.942894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef6b4e-aea4-458b-a51a-399df17d2d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:42.943131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef6b4e-aea4-458b-a51a-399df17d2d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:42.943412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef6b4e-aea4-458b-a51a-399df17d2d79 admin admin] PATH_INFO: `/v3/projects/c95fe58da2224ab186c708010bbec6fd/users/c74ad8b7769c412b823f80e7bd27a968/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:42.975697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef6b4e-aea4-458b-a51a-399df17d2d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c95fe58da2224ab186c708010bbec6fd, user_id=c74ad8b7769c412b823f80e7bd27a968, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:42.975697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef6b4e-aea4-458b-a51a-399df17d2d79 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:43.054945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1229/2449] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:42 2022] PUT /identity/v3/projects/c95fe58da2224ab186c708010bbec6fd/users/c74ad8b7769c412b823f80e7bd27a968/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:43.060963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e324a67-ff1a-40cf-a92c-15a4868e87e9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:43.061291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e324a67-ff1a-40cf-a92c-15a4868e87e9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:43.061590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e324a67-ff1a-40cf-a92c-15a4868e87e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:43.093440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1e324a67-ff1a-40cf-a92c-15a4868e87e9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:43.094732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1e324a67-ff1a-40cf-a92c-15a4868e87e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:43.194207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1221/2450] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:43.204993 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef6b4e-aea4-458b-a51a-399df17d2d79 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:43.207376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cfef6b4e-aea4-458b-a51a-399df17d2d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:43.290051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef6b4e-aea4-458b-a51a-399df17d2d79 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:43.293994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79521cb-b410-4e01-b3be-04dea4fbad99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:43.294658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79521cb-b410-4e01-b3be-04dea4fbad99 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:43.295704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79521cb-b410-4e01-b3be-04dea4fbad99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:43.296360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79521cb-b410-4e01-b3be-04dea4fbad99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:43.319549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79521cb-b410-4e01-b3be-04dea4fbad99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:43.324290 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79521cb-b410-4e01-b3be-04dea4fbad99 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:43.332171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1230/2451] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:45.663230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0e5e4-3892-4571-8c75-b546b0f5c75b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.669123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0e5e4-3892-4571-8c75-b546b0f5c75b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.669123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0e5e4-3892-4571-8c75-b546b0f5c75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.689368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79521cb-b410-4e01-b3be-04dea4fbad99 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:45.691903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a79521cb-b410-4e01-b3be-04dea4fbad99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:45.701695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e6f0e5e4-3892-4571-8c75-b546b0f5c75b None None] MFA Rules not processed for user `c74ad8b7769c412b823f80e7bd27a968`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:45.703299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e6f0e5e4-3892-4571-8c75-b546b0f5c75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:45.705746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79521cb-b410-4e01-b3be-04dea4fbad99 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:45.711259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cdd3f-4b4b-4640-88a9-e5710e5a0dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:45.711911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cdd3f-4b4b-4640-88a9-e5710e5a0dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.712191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cdd3f-4b4b-4640-88a9-e5710e5a0dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.712465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cdd3f-4b4b-4640-88a9-e5710e5a0dd0 admin admin] PATH_INFO: `/v3/users/adf1ff245237453b8ab112c4be7a7b6b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.713663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cdd3f-4b4b-4640-88a9-e5710e5a0dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf1ff245237453b8ab112c4be7a7b6b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:45.716550 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cdd3f-4b4b-4640-88a9-e5710e5a0dd0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:45.786488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1222/2452] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:45.797757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0e5e4-3892-4571-8c75-b546b0f5c75b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:45.803785 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:45.810203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0e5e4-3892-4571-8c75-b546b0f5c75b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:45.816546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ea255-5efb-4032-a646-e737eb09592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:45.817165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ea255-5efb-4032-a646-e737eb09592d admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:45.817450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ea255-5efb-4032-a646-e737eb09592d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:45.817835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ea255-5efb-4032-a646-e737eb09592d admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:45.818546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ea255-5efb-4032-a646-e737eb09592d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:45.820462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ea255-5efb-4032-a646-e737eb09592d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:45.947520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1223/2453] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:45 2022] POST /identity/v3/projects => generated 403 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:45.954877 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ea255-5efb-4032-a646-e737eb09592d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:45.996710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-968cdd3f-4b4b-4640-88a9-e5710e5a0dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf1ff245237453b8ab112c4be7a7b6b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:46.006982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-968cdd3f-4b4b-4640-88a9-e5710e5a0dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf1ff245237453b8ab112c4be7a7b6b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:46.008029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-968cdd3f-4b4b-4640-88a9-e5710e5a0dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf1ff245237453b8ab112c4be7a7b6b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:46.037371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ea255-5efb-4032-a646-e737eb09592d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.042747 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffe2d9-72d8-4208-b479-a6a956cf3a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.043522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffe2d9-72d8-4208-b479-a6a956cf3a97 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.043762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffe2d9-72d8-4208-b479-a6a956cf3a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.044053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffe2d9-72d8-4208-b479-a6a956cf3a97 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.045023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffe2d9-72d8-4208-b479-a6a956cf3a97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.047170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffe2d9-72d8-4208-b479-a6a956cf3a97 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.101569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-968cdd3f-4b4b-4640-88a9-e5710e5a0dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf1ff245237453b8ab112c4be7a7b6b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:46.113568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:46.127722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-968cdd3f-4b4b-4640-88a9-e5710e5a0dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf1ff245237453b8ab112c4be7a7b6b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:46.142916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1231/2454] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:45 2022] DELETE /identity/v3/users/adf1ff245237453b8ab112c4be7a7b6b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:46.147632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a575-ee47-421a-bf46-4aca1f406ed4 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.147916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a575-ee47-421a-bf46-4aca1f406ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.148221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215a575-ee47-421a-bf46-4aca1f406ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.174661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-7215a575-ee47-421a-bf46-4aca1f406ed4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:46.175885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7215a575-ee47-421a-bf46-4aca1f406ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:46.205637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1224/2455] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:45 2022] POST /identity/v3/users => generated 308 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:46.210483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffe2d9-72d8-4208-b479-a6a956cf3a97 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.212483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-30ffe2d9-72d8-4208-b479-a6a956cf3a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:46.230269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffe2d9-72d8-4208-b479-a6a956cf3a97 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.251947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1232/2456] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:46.263098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215a575-ee47-421a-bf46-4aca1f406ed4 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.265711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7215a575-ee47-421a-bf46-4aca1f406ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:46.316538 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffd9db-dcd3-4189-b630-4e7ca4cdf925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.317170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffd9db-dcd3-4189-b630-4e7ca4cdf925 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.317446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffd9db-dcd3-4189-b630-4e7ca4cdf925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.317718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ffd9db-dcd3-4189-b630-4e7ca4cdf925 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.318476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffd9db-dcd3-4189-b630-4e7ca4cdf925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.320108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ffd9db-dcd3-4189-b630-4e7ca4cdf925 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.333384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1225/2457] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:46.338553 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffd9db-dcd3-4189-b630-4e7ca4cdf925 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.349666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215a575-ee47-421a-bf46-4aca1f406ed4 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.352866 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ffd9db-dcd3-4189-b630-4e7ca4cdf925 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.353574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a8e1e-b7b1-4e26-b5bc-b5301fa9247e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.354219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a8e1e-b7b1-4e26-b5bc-b5301fa9247e service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.354502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a8e1e-b7b1-4e26-b5bc-b5301fa9247e service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.354787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a8e1e-b7b1-4e26-b5bc-b5301fa9247e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.358333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f2cd7-4a4d-4f7c-9f97-90733df66c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.359027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f2cd7-4a4d-4f7c-9f97-90733df66c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.359302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f2cd7-4a4d-4f7c-9f97-90733df66c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.359564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f2cd7-4a4d-4f7c-9f97-90733df66c05 admin admin] PATH_INFO: `/v3/projects/9c502f3ea65a47ddad51738fe5a2d83d/users/916fa3b1cee649d9abca6d7e088edf23/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.365858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a8e1e-b7b1-4e26-b5bc-b5301fa9247e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.367665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a8e1e-b7b1-4e26-b5bc-b5301fa9247e service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.380917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f2cd7-4a4d-4f7c-9f97-90733df66c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c502f3ea65a47ddad51738fe5a2d83d, user_id=916fa3b1cee649d9abca6d7e088edf23, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.381206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1233/2458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:46.385411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6f2cd7-4a4d-4f7c-9f97-90733df66c05 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.541399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1226/2459] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:46 2022] PUT /identity/v3/projects/9c502f3ea65a47ddad51738fe5a2d83d/users/916fa3b1cee649d9abca6d7e088edf23/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:46.546382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a8e1e-b7b1-4e26-b5bc-b5301fa9247e service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.559033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a8e1e-b7b1-4e26-b5bc-b5301fa9247e service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.630877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de08add-540e-441e-a234-108b0069f245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.631570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08add-540e-441e-a234-108b0069f245 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.631777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08add-540e-441e-a234-108b0069f245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.632167 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de08add-540e-441e-a234-108b0069f245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.632745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de08add-540e-441e-a234-108b0069f245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.634413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de08add-540e-441e-a234-108b0069f245 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.650668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1234/2460] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:46.651908 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f2cd7-4a4d-4f7c-9f97-90733df66c05 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:46.668433 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f2cd7-4a4d-4f7c-9f97-90733df66c05 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:46.676551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0b73-53fb-448d-ba4a-24025f47c104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:46.677645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0b73-53fb-448d-ba4a-24025f47c104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:46.678215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0b73-53fb-448d-ba4a-24025f47c104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:46.678725 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc0b73-53fb-448d-ba4a-24025f47c104 admin admin] PATH_INFO: `/v3/projects/9c502f3ea65a47ddad51738fe5a2d83d/users/916fa3b1cee649d9abca6d7e088edf23/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:46.683207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc0b73-53fb-448d-ba4a-24025f47c104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c502f3ea65a47ddad51738fe5a2d83d, user_id=916fa3b1cee649d9abca6d7e088edf23, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:46.687674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc0b73-53fb-448d-ba4a-24025f47c104 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:46.714328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1227/2461] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:46 2022] PUT /identity/v3/projects/9c502f3ea65a47ddad51738fe5a2d83d/users/916fa3b1cee649d9abca6d7e088edf23/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:47.089742 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de08add-540e-441e-a234-108b0069f245 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:47.094987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-4de08add-540e-441e-a234-108b0069f245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:47.180885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de08add-540e-441e-a234-108b0069f245 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:47.246293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:47.292574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:47.293782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:47.294217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:47.294757 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] PATH_INFO: `/v3/projects/0650151a66104857aab909d235c0384a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:47.296922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0650151a66104857aab909d235c0384a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:47.299102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:47.484809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0650151a66104857aab909d235c0384a', 'request_id': 'req-1bba309f-9e90-4656-93b9-6a0694f27e8c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:47.496745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0650151a66104857aab909d235c0384a', 'request_id': 'req-1bba309f-9e90-4656-93b9-6a0694f27e8c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:47.610393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0650151a66104857aab909d235c0384a', 'request_id': 'req-1bba309f-9e90-4656-93b9-6a0694f27e8c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:47.622058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] The token cache is being invalidate because project 0650151a66104857aab909d235c0384a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:47.623516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:47.623516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:47.625265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1235/2462] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:47 2022] DELETE /identity/v3/projects/0650151a66104857aab909d235c0384a => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:47.630837 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0b73-53fb-448d-ba4a-24025f47c104 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:47.633608 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-34bc0b73-53fb-448d-ba4a-24025f47c104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:47.660080 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc0b73-53fb-448d-ba4a-24025f47c104 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:47.694326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:47.730783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4c404-e5c4-4a28-b218-b31ef8a1ada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:47.731326 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4c404-e5c4-4a28-b218-b31ef8a1ada9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:47.731606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4c404-e5c4-4a28-b218-b31ef8a1ada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:47.731878 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4c404-e5c4-4a28-b218-b31ef8a1ada9 admin admin] PATH_INFO: `/v3/users/75784a0c1769451c87037d95e021b898` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:47.733538 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4c404-e5c4-4a28-b218-b31ef8a1ada9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75784a0c1769451c87037d95e021b898)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:47.735766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4c404-e5c4-4a28-b218-b31ef8a1ada9 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:47.986701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-13e4c404-e5c4-4a28-b218-b31ef8a1ada9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75784a0c1769451c87037d95e021b898'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.001328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-13e4c404-e5c4-4a28-b218-b31ef8a1ada9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75784a0c1769451c87037d95e021b898'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.002389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-13e4c404-e5c4-4a28-b218-b31ef8a1ada9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75784a0c1769451c87037d95e021b898'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.091029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-13e4c404-e5c4-4a28-b218-b31ef8a1ada9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75784a0c1769451c87037d95e021b898'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.091751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-13e4c404-e5c4-4a28-b218-b31ef8a1ada9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75784a0c1769451c87037d95e021b898'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:48.116523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1228/2463] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:47 2022] DELETE /identity/v3/users/75784a0c1769451c87037d95e021b898 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:48.655056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:48.668249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba309f-9e90-4656-93b9-6a0694f27e8c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:48.739955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bb53b-58bf-4b09-9014-4f4d1056c297 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:48.739955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bb53b-58bf-4b09-9014-4f4d1056c297 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:48.739955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bb53b-58bf-4b09-9014-4f4d1056c297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:48.799157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:48.800320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:48.800821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:48.801224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] PATH_INFO: `/v3/projects/8edfeb04f39848ae83e2080756fb25a2` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:48.802540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8edfeb04f39848ae83e2080756fb25a2)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:48.807749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-cd1bb53b-58bf-4b09-9014-4f4d1056c297 None None] MFA Rules not processed for user `916fa3b1cee649d9abca6d7e088edf23`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:48.807749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cd1bb53b-58bf-4b09-9014-4f4d1056c297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:48.808000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:48.923997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1229/2464] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:48 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:49.014163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8edfeb04f39848ae83e2080756fb25a2', 'request_id': 'req-f9793abe-7972-482f-9b9c-1582e7ff19c3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:49.029292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8edfeb04f39848ae83e2080756fb25a2', 'request_id': 'req-f9793abe-7972-482f-9b9c-1582e7ff19c3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:49.101407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8edfeb04f39848ae83e2080756fb25a2', 'request_id': 'req-f9793abe-7972-482f-9b9c-1582e7ff19c3'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:49.104597 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:49.134119 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] The token cache is being invalidate because project 8edfeb04f39848ae83e2080756fb25a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:49.134841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:49.136053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f9793abe-7972-482f-9b9c-1582e7ff19c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:49.141279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1236/2465] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:48 2022] DELETE /identity/v3/projects/8edfeb04f39848ae83e2080756fb25a2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:49.151532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1642-af93-4db8-925c-ce0f02e89af1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.157306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1642-af93-4db8-925c-ce0f02e89af1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.157306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac1642-af93-4db8-925c-ce0f02e89af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.184830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-30ac1642-af93-4db8-925c-ce0f02e89af1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:49.187638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-30ac1642-af93-4db8-925c-ce0f02e89af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:49.266228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1230/2466] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:49.277117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b880d6-6443-418a-900e-f5a52d92f258 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.277553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b880d6-6443-418a-900e-f5a52d92f258 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.283813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b880d6-6443-418a-900e-f5a52d92f258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.304790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b1b880d6-6443-418a-900e-f5a52d92f258 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:49.306206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b1b880d6-6443-418a-900e-f5a52d92f258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:49.315912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1237/2467] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:49.320645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac1642-af93-4db8-925c-ce0f02e89af1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:49.330703 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:49.335249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac1642-af93-4db8-925c-ce0f02e89af1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:49.342277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21981d-5d92-4a91-9098-a5ce57e11e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:49.343121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21981d-5d92-4a91-9098-a5ce57e11e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.343405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21981d-5d92-4a91-9098-a5ce57e11e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.344176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21981d-5d92-4a91-9098-a5ce57e11e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.344590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21981d-5d92-4a91-9098-a5ce57e11e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:49.344891 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21981d-5d92-4a91-9098-a5ce57e11e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:49.346839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21981d-5d92-4a91-9098-a5ce57e11e35 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:49.364229 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1231/2468] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:49.369251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b880d6-6443-418a-900e-f5a52d92f258 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:49.385240 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b880d6-6443-418a-900e-f5a52d92f258 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:49.392139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7b970-8164-4e11-8b2d-27ff22eae32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:49.392934 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7b970-8164-4e11-8b2d-27ff22eae32c admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.393221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7b970-8164-4e11-8b2d-27ff22eae32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.393491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7b970-8164-4e11-8b2d-27ff22eae32c admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.394182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7b970-8164-4e11-8b2d-27ff22eae32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:49.396605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7b970-8164-4e11-8b2d-27ff22eae32c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:49.633546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1238/2469] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:49 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:49.642763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21981d-5d92-4a91-9098-a5ce57e11e35 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:49.659263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21981d-5d92-4a91-9098-a5ce57e11e35 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:49.737918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25add068-c3c1-4265-924b-84dde73198cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:49.738552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25add068-c3c1-4265-924b-84dde73198cd admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.739069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25add068-c3c1-4265-924b-84dde73198cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.739403 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25add068-c3c1-4265-924b-84dde73198cd admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.740046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25add068-c3c1-4265-924b-84dde73198cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:49.743124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25add068-c3c1-4265-924b-84dde73198cd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:49.858380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1232/2470] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:49 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:49.861251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7b970-8164-4e11-8b2d-27ff22eae32c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:49.878666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7b970-8164-4e11-8b2d-27ff22eae32c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:49.895456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091be2fa-4a05-4760-ad55-5512aa900240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:49.896514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091be2fa-4a05-4760-ad55-5512aa900240 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:49.897005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091be2fa-4a05-4760-ad55-5512aa900240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:49.897579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091be2fa-4a05-4760-ad55-5512aa900240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:49.898554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091be2fa-4a05-4760-ad55-5512aa900240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:49.902514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091be2fa-4a05-4760-ad55-5512aa900240 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:49.927920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1239/2471] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:49.935962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25add068-c3c1-4265-924b-84dde73198cd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:49.971225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25add068-c3c1-4265-924b-84dde73198cd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:49.987419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d830716-0a20-424a-b9f5-ab2bc21c70cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:50.000426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830716-0a20-424a-b9f5-ab2bc21c70cf admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:50.004666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830716-0a20-424a-b9f5-ab2bc21c70cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:50.004666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d830716-0a20-424a-b9f5-ab2bc21c70cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:50.004666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d830716-0a20-424a-b9f5-ab2bc21c70cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:50.009800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d830716-0a20-424a-b9f5-ab2bc21c70cf admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:50.040801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1233/2472] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:50.044974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091be2fa-4a05-4760-ad55-5512aa900240 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:50.059329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091be2fa-4a05-4760-ad55-5512aa900240 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:50.078647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f74a4-1b9f-46f6-b92a-b52d4d260859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:50.079672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f74a4-1b9f-46f6-b92a-b52d4d260859 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:50.081492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f74a4-1b9f-46f6-b92a-b52d4d260859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:50.082042 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f74a4-1b9f-46f6-b92a-b52d4d260859 admin admin] PATH_INFO: `/v3/projects/81a770db9e2e4251b451568fbbd15318/users/0427f88632124b3ba01b9250955ff6c8/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:50.149296 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f74a4-1b9f-46f6-b92a-b52d4d260859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a770db9e2e4251b451568fbbd15318, user_id=0427f88632124b3ba01b9250955ff6c8, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:50.152918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f74a4-1b9f-46f6-b92a-b52d4d260859 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:50.326793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eaa83-3e54-4aaf-8fdb-e0fcad618209 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:50.327326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1240/2473] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:50 2022] PUT /identity/v3/projects/81a770db9e2e4251b451568fbbd15318/users/0427f88632124b3ba01b9250955ff6c8/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:50.327623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eaa83-3e54-4aaf-8fdb-e0fcad618209 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:50.327623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eaa83-3e54-4aaf-8fdb-e0fcad618209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:50.385255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0e5eaa83-3e54-4aaf-8fdb-e0fcad618209 None None] MFA Rules not processed for user `0427f88632124b3ba01b9250955ff6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:50.386462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0e5eaa83-3e54-4aaf-8fdb-e0fcad618209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:50.521646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1234/2474] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:50.527454 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f74a4-1b9f-46f6-b92a-b52d4d260859 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:50.734895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f74a4-1b9f-46f6-b92a-b52d4d260859 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:50.753793 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a84a67-e73a-41ce-9484-0c14adfd4d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:50.762721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a84a67-e73a-41ce-9484-0c14adfd4d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:50.765081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a84a67-e73a-41ce-9484-0c14adfd4d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:50.765399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a84a67-e73a-41ce-9484-0c14adfd4d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:50.767857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a84a67-e73a-41ce-9484-0c14adfd4d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:50.772074 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a84a67-e73a-41ce-9484-0c14adfd4d7d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:50.815132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8a072-de8e-4044-9dcc-69145fa2e8bf None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:50.815601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8a072-de8e-4044-9dcc-69145fa2e8bf None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:50.821272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8a072-de8e-4044-9dcc-69145fa2e8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:50.843109 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5fe8a072-de8e-4044-9dcc-69145fa2e8bf None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:50.844167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5fe8a072-de8e-4044-9dcc-69145fa2e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:50.981226 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1241/2475] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:50 2022] POST /identity/v3/projects => generated 375 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:50.984711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a84a67-e73a-41ce-9484-0c14adfd4d7d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:51.047794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1235/2476] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Sep 1 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:51.063081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8a072-de8e-4044-9dcc-69145fa2e8bf None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:51.068315 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5fe8a072-de8e-4044-9dcc-69145fa2e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:51.107295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8a072-de8e-4044-9dcc-69145fa2e8bf None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:51.142570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a84a67-e73a-41ce-9484-0c14adfd4d7d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:51.158736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9d07-a832-4323-8380-33d408a338fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:51.160728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9d07-a832-4323-8380-33d408a338fe admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:51.161050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9d07-a832-4323-8380-33d408a338fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:51.161332 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb9d07-a832-4323-8380-33d408a338fe admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:51.162024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb9d07-a832-4323-8380-33d408a338fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:51.167828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb9d07-a832-4323-8380-33d408a338fe admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:51.218542 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aef08a-2c4e-435d-a061-1ebe6f9158f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:51.219561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef08a-2c4e-435d-a061-1ebe6f9158f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:51.219974 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef08a-2c4e-435d-a061-1ebe6f9158f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:51.220469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aef08a-2c4e-435d-a061-1ebe6f9158f0 admin admin] PATH_INFO: `/v3/users/c74ad8b7769c412b823f80e7bd27a968` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:51.222458 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aef08a-2c4e-435d-a061-1ebe6f9158f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c74ad8b7769c412b823f80e7bd27a968)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:51.225811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aef08a-2c4e-435d-a061-1ebe6f9158f0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:51.290417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1242/2477] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:50 2022] POST /identity/v3/users => generated 288 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:51.290417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9d07-a832-4323-8380-33d408a338fe admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:51.299912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-eceb9d07-a832-4323-8380-33d408a338fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:51.420718 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb9d07-a832-4323-8380-33d408a338fe admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:51.427108 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07752f5f-fc1e-4aa1-bf70-4afca758c263 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:51.428017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07752f5f-fc1e-4aa1-bf70-4afca758c263 service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:51.428328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07752f5f-fc1e-4aa1-bf70-4afca758c263 service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:51.428575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07752f5f-fc1e-4aa1-bf70-4afca758c263 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:51.562857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07752f5f-fc1e-4aa1-bf70-4afca758c263 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:51.566216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07752f5f-fc1e-4aa1-bf70-4afca758c263 service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:51.578125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1243/2478] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:42:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:51.579235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07752f5f-fc1e-4aa1-bf70-4afca758c263 service swift] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:51.595554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07752f5f-fc1e-4aa1-bf70-4afca758c263 service swift] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:51.599300 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-48aef08a-2c4e-435d-a061-1ebe6f9158f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c74ad8b7769c412b823f80e7bd27a968'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.601327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5151c-8af0-4411-b9bc-7972de19bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:51.602051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5151c-8af0-4411-b9bc-7972de19bfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:51.602342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5151c-8af0-4411-b9bc-7972de19bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:51.602629 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5151c-8af0-4411-b9bc-7972de19bfb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:51.603334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5151c-8af0-4411-b9bc-7972de19bfb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:51.605580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5151c-8af0-4411-b9bc-7972de19bfb9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:51.626821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1244/2479] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:51.627808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5151c-8af0-4411-b9bc-7972de19bfb9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:51.627992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-48aef08a-2c4e-435d-a061-1ebe6f9158f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c74ad8b7769c412b823f80e7bd27a968'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.630408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-48aef08a-2c4e-435d-a061-1ebe6f9158f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c74ad8b7769c412b823f80e7bd27a968'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.640183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5151c-8af0-4411-b9bc-7972de19bfb9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:51.645487 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8727cb6-5194-4c43-b1b0-576d3ba828cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:51.646576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8727cb6-5194-4c43-b1b0-576d3ba828cc admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:51.647052 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8727cb6-5194-4c43-b1b0-576d3ba828cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:51.648222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8727cb6-5194-4c43-b1b0-576d3ba828cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:51.648989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8727cb6-5194-4c43-b1b0-576d3ba828cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:51.651619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8727cb6-5194-4c43-b1b0-576d3ba828cc admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:51.673560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1245/2480] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:51.690800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8727cb6-5194-4c43-b1b0-576d3ba828cc admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:51.712221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8727cb6-5194-4c43-b1b0-576d3ba828cc admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:51.729696 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4710067-ff9f-485e-aa0d-f763021f0906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:51.730684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4710067-ff9f-485e-aa0d-f763021f0906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:51.731109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4710067-ff9f-485e-aa0d-f763021f0906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:51.731547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4710067-ff9f-485e-aa0d-f763021f0906 admin admin] PATH_INFO: `/v3/projects/20651428229d412685b671227c08927b/users/d585a46893ee477abc1b50516ca4e74f/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:51.735660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-48aef08a-2c4e-435d-a061-1ebe6f9158f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c74ad8b7769c412b823f80e7bd27a968'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.736601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-48aef08a-2c4e-435d-a061-1ebe6f9158f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c74ad8b7769c412b823f80e7bd27a968'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:51.755567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4710067-ff9f-485e-aa0d-f763021f0906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20651428229d412685b671227c08927b, user_id=d585a46893ee477abc1b50516ca4e74f, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:51.758891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4710067-ff9f-485e-aa0d-f763021f0906 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:51.771016 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1236/2481] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:51 2022] DELETE /identity/v3/users/c74ad8b7769c412b823f80e7bd27a968 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:51.947349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1246/2482] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:51 2022] PUT /identity/v3/projects/20651428229d412685b671227c08927b/users/d585a46893ee477abc1b50516ca4e74f/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:51.962389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afda0f-477e-488a-adf6-20c057e60917 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:51.962842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afda0f-477e-488a-adf6-20c057e60917 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:51.962948 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afda0f-477e-488a-adf6-20c057e60917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:52.019659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-65afda0f-477e-488a-adf6-20c057e60917 None None] MFA Rules not processed for user `d585a46893ee477abc1b50516ca4e74f`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:52.023296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-65afda0f-477e-488a-adf6-20c057e60917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:52.254144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=93,keystone:DELETE=1,keystone:INSERT=6 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:52.275987 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4710067-ff9f-485e-aa0d-f763021f0906 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:52.278238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d4710067-ff9f-485e-aa0d-f763021f0906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:52.320002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1237/2483] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:52.324450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afda0f-477e-488a-adf6-20c057e60917 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:52.326506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-65afda0f-477e-488a-adf6-20c057e60917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:52.524154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4710067-ff9f-485e-aa0d-f763021f0906 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:52.562410 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:52.564254 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:52.564565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:52.564839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] PATH_INFO: `/v3/projects/c95fe58da2224ab186c708010bbec6fd` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:52.573403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c95fe58da2224ab186c708010bbec6fd)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:52.579459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:52.606501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afda0f-477e-488a-adf6-20c057e60917 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:52.671914 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf6d95-849b-43ea-8c43-fa449606e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:52.673952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf6d95-849b-43ea-8c43-fa449606e252 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:52.673952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf6d95-849b-43ea-8c43-fa449606e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:52.679304 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf6d95-849b-43ea-8c43-fa449606e252 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:52.682688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf6d95-849b-43ea-8c43-fa449606e252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:52.691272 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf6d95-849b-43ea-8c43-fa449606e252 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:52.813723 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:52.843246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c95fe58da2224ab186c708010bbec6fd', 'request_id': 'req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.856481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c95fe58da2224ab186c708010bbec6fd', 'request_id': 'req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:52.968340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1238/2484] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:52 2022] POST /identity/v3/projects => generated 375 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:52.970427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf6d95-849b-43ea-8c43-fa449606e252 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.032756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c95fe58da2224ab186c708010bbec6fd', 'request_id': 'req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.053975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] The token cache is being invalidate because project c95fe58da2224ab186c708010bbec6fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:53.054194 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.056164 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.061172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1247/2485] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:52 2022] DELETE /identity/v3/projects/c95fe58da2224ab186c708010bbec6fd => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:53.065530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.067797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:53.136496 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf6d95-849b-43ea-8c43-fa449606e252 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:53.150041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7cee7-8e15-487a-abd0-2c736bccfac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:53.150681 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7cee7-8e15-487a-abd0-2c736bccfac6 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.150966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7cee7-8e15-487a-abd0-2c736bccfac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.151241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7cee7-8e15-487a-abd0-2c736bccfac6 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.151893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7cee7-8e15-487a-abd0-2c736bccfac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:53.154167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7cee7-8e15-487a-abd0-2c736bccfac6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:53.250602 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39662c0a-d9a2-4e58-9d7b-0859eb06f2e8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:53.262890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:53.265766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.266288 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.266727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] PATH_INFO: `/v3/users/916fa3b1cee649d9abca6d7e088edf23` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.270043 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=916fa3b1cee649d9abca6d7e088edf23)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:53.273629 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:53.713373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1239/2486] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:52 2022] POST /identity/v3/users => generated 294 bytes in 744 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:53.718049 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7cee7-8e15-487a-abd0-2c736bccfac6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.722446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-63b7cee7-8e15-487a-abd0-2c736bccfac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:53.752247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7cee7-8e15-487a-abd0-2c736bccfac6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:53.762093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fca4d-26fc-48c5-8528-1e4346ddc3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:53.763484 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fca4d-26fc-48c5-8528-1e4346ddc3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.764025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fca4d-26fc-48c5-8528-1e4346ddc3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.764472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fca4d-26fc-48c5-8528-1e4346ddc3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.765614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fca4d-26fc-48c5-8528-1e4346ddc3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:53.766181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916fa3b1cee649d9abca6d7e088edf23'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.770249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fca4d-26fc-48c5-8528-1e4346ddc3e4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:53.785601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1240/2487] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:53.786173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916fa3b1cee649d9abca6d7e088edf23'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.789612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fca4d-26fc-48c5-8528-1e4346ddc3e4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.789847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916fa3b1cee649d9abca6d7e088edf23'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.803425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fca4d-26fc-48c5-8528-1e4346ddc3e4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:53.808364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f56934-4b4a-45ef-b85c-fc9f80c08fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:53.809065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f56934-4b4a-45ef-b85c-fc9f80c08fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:53.809345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f56934-4b4a-45ef-b85c-fc9f80c08fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:53.809622 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f56934-4b4a-45ef-b85c-fc9f80c08fc5 admin admin] PATH_INFO: `/v3/projects/97acdb33113b4448acb9f2111dd24215/users/fd5f3e3679824574be9bb5f8fc283359/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:53.830523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f56934-4b4a-45ef-b85c-fc9f80c08fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97acdb33113b4448acb9f2111dd24215, user_id=fd5f3e3679824574be9bb5f8fc283359, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:53.833640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f56934-4b4a-45ef-b85c-fc9f80c08fc5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:53.902145 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916fa3b1cee649d9abca6d7e088edf23'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.932109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916fa3b1cee649d9abca6d7e088edf23'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:53.944928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1248/2488] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:42:53 2022] DELETE /identity/v3/users/916fa3b1cee649d9abca6d7e088edf23 => generated 0 bytes in 879 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:53.958368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1241/2489] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:53 2022] PUT /identity/v3/projects/97acdb33113b4448acb9f2111dd24215/users/fd5f3e3679824574be9bb5f8fc283359/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:53.965821 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:53.973693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:54.135070 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7d4cb-0a98-47b4-b906-079515051dad admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:54.148986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b12f8-c231-44a2-bddd-b8a24792e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:54.149782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b12f8-c231-44a2-bddd-b8a24792e2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.151362 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b12f8-c231-44a2-bddd-b8a24792e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.151879 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b12f8-c231-44a2-bddd-b8a24792e2a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.153057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b12f8-c231-44a2-bddd-b8a24792e2a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:54.156411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b12f8-c231-44a2-bddd-b8a24792e2a8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:54.179020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1249/2490] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:54.191501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f56934-4b4a-45ef-b85c-fc9f80c08fc5 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:54.328098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f56934-4b4a-45ef-b85c-fc9f80c08fc5 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:54.336992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174b1d0-02b0-4cf3-95b6-a8def1136980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:54.338100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174b1d0-02b0-4cf3-95b6-a8def1136980 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.338620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174b1d0-02b0-4cf3-95b6-a8def1136980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.339117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174b1d0-02b0-4cf3-95b6-a8def1136980 admin admin] PATH_INFO: `/v3/projects/97acdb33113b4448acb9f2111dd24215/users/fd5f3e3679824574be9bb5f8fc283359/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.342924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174b1d0-02b0-4cf3-95b6-a8def1136980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97acdb33113b4448acb9f2111dd24215, user_id=fd5f3e3679824574be9bb5f8fc283359, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:54.346279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174b1d0-02b0-4cf3-95b6-a8def1136980 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:54.363021 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1242/2491] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:54 2022] PUT /identity/v3/projects/97acdb33113b4448acb9f2111dd24215/users/fd5f3e3679824574be9bb5f8fc283359/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:54.374022 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaec4b-b997-4e10-b96d-be7c4f8ec9fe None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.374652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaec4b-b997-4e10-b96d-be7c4f8ec9fe None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.374652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaec4b-b997-4e10-b96d-be7c4f8ec9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.431407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1bfaec4b-b997-4e10-b96d-be7c4f8ec9fe None None] MFA Rules not processed for user `fd5f3e3679824574be9bb5f8fc283359`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:54.434081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174b1d0-02b0-4cf3-95b6-a8def1136980 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:54.436194 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c174b1d0-02b0-4cf3-95b6-a8def1136980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:54.436915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1bfaec4b-b997-4e10-b96d-be7c4f8ec9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:54.609148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174b1d0-02b0-4cf3-95b6-a8def1136980 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:54.625456 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:54.631916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1250/2492] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:54.632149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.632149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.632149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] PATH_INFO: `/v3/projects/9c502f3ea65a47ddad51738fe5a2d83d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.633225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c502f3ea65a47ddad51738fe5a2d83d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:54.635351 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:54.641748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaec4b-b997-4e10-b96d-be7c4f8ec9fe None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:54.643258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1bfaec4b-b997-4e10-b96d-be7c4f8ec9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:54.769958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaec4b-b997-4e10-b96d-be7c4f8ec9fe None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:54.775504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec000f65-2c93-4513-91b9-e7e917d159cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:54.776179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec000f65-2c93-4513-91b9-e7e917d159cb service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:54.776459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec000f65-2c93-4513-91b9-e7e917d159cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:54.776733 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec000f65-2c93-4513-91b9-e7e917d159cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:54.781231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ec000f65-2c93-4513-91b9-e7e917d159cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:54.854062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c502f3ea65a47ddad51738fe5a2d83d', 'request_id': 'req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:54.864517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c502f3ea65a47ddad51738fe5a2d83d', 'request_id': 'req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:54.874926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c502f3ea65a47ddad51738fe5a2d83d', 'request_id': 'req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:54.908860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec000f65-2c93-4513-91b9-e7e917d159cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:54.916141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec000f65-2c93-4513-91b9-e7e917d159cb service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:54.941528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1251/2493] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:42:55.028162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] The token cache is being invalidate because project 9c502f3ea65a47ddad51738fe5a2d83d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:42:55.029600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:55.030510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-a1cf6292-ca5f-49c6-aa07-5a9fc72709cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:42:55.033508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1243/2494] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:42:54 2022] DELETE /identity/v3/projects/9c502f3ea65a47ddad51738fe5a2d83d => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:55.038361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa79e-513c-4525-8972-b7c6fcd50684 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.038927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa79e-513c-4525-8972-b7c6fcd50684 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.039220 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fa79e-513c-4525-8972-b7c6fcd50684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.073403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-099fa79e-513c-4525-8972-b7c6fcd50684 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:55.074574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-099fa79e-513c-4525-8972-b7c6fcd50684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:55.203819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1252/2495] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:55.212140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2b29-abf3-42f9-8205-040cbcaf3b77 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.212773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2b29-abf3-42f9-8205-040cbcaf3b77 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.212934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2b29-abf3-42f9-8205-040cbcaf3b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.252401 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-50cf2b29-abf3-42f9-8205-040cbcaf3b77 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:55.254055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-50cf2b29-abf3-42f9-8205-040cbcaf3b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:55.277863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fa79e-513c-4525-8972-b7c6fcd50684 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:55.282031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1244/2496] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:42:55.288846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fa79e-513c-4525-8972-b7c6fcd50684 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:55.294052 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4e22d-dd8d-4d68-8e9e-da956f5b8d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:55.295452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4e22d-dd8d-4d68-8e9e-da956f5b8d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.295732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4e22d-dd8d-4d68-8e9e-da956f5b8d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.295993 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4e22d-dd8d-4d68-8e9e-da956f5b8d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.296664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4e22d-dd8d-4d68-8e9e-da956f5b8d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:42:55.296973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4e22d-dd8d-4d68-8e9e-da956f5b8d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:55.298727 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4e22d-dd8d-4d68-8e9e-da956f5b8d85 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:55.317924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1253/2497] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:42:55.320286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf2b29-abf3-42f9-8205-040cbcaf3b77 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:55.331627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf2b29-abf3-42f9-8205-040cbcaf3b77 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:55.341828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673e39-1977-4f3a-815c-d0076900391b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:55.342604 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673e39-1977-4f3a-815c-d0076900391b admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:55.343927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673e39-1977-4f3a-815c-d0076900391b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:55.344439 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673e39-1977-4f3a-815c-d0076900391b admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:55.345947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8673e39-1977-4f3a-815c-d0076900391b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:55.348875 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8673e39-1977-4f3a-815c-d0076900391b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:56.010064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298dd30-1f41-4aa6-99c8-768b00bc546a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:56.010662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298dd30-1f41-4aa6-99c8-768b00bc546a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:56.010829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298dd30-1f41-4aa6-99c8-768b00bc546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:56.033333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e298dd30-1f41-4aa6-99c8-768b00bc546a None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:56.034740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e298dd30-1f41-4aa6-99c8-768b00bc546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:56.117647 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1245/2498] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:55 2022] POST /identity/v3/projects => generated 379 bytes in 798 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:42:56.121428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673e39-1977-4f3a-815c-d0076900391b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:56.140690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1254/2499] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 1 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:56.169078 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298dd30-1f41-4aa6-99c8-768b00bc546a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:56.172979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e298dd30-1f41-4aa6-99c8-768b00bc546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:56.241645 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673e39-1977-4f3a-815c-d0076900391b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:56.248379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb44639-1b04-41a6-95fa-5031877d74f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:56.249138 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb44639-1b04-41a6-95fa-5031877d74f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:56.249497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb44639-1b04-41a6-95fa-5031877d74f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:56.249850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb44639-1b04-41a6-95fa-5031877d74f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:56.250733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb44639-1b04-41a6-95fa-5031877d74f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:56.252698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb44639-1b04-41a6-95fa-5031877d74f6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:56.291776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298dd30-1f41-4aa6-99c8-768b00bc546a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:56.387706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076525ab-35e2-45fb-832f-621cede1ac8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:56.388623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076525ab-35e2-45fb-832f-621cede1ac8d service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:56.389143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1246/2500] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:56 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:56.389301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076525ab-35e2-45fb-832f-621cede1ac8d service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:56.389575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076525ab-35e2-45fb-832f-621cede1ac8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:56.394533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb44639-1b04-41a6-95fa-5031877d74f6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:56.424896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb44639-1b04-41a6-95fa-5031877d74f6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:56.430509 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:56.443095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea55c6-76c1-4a7d-be37-c61a3fba51cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:56.451190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea55c6-76c1-4a7d-be37-c61a3fba51cd admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:56.451190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea55c6-76c1-4a7d-be37-c61a3fba51cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:56.451190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea55c6-76c1-4a7d-be37-c61a3fba51cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:56.451190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea55c6-76c1-4a7d-be37-c61a3fba51cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:56.451190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea55c6-76c1-4a7d-be37-c61a3fba51cd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:56.459573 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1247/2501] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:42:56.463893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea55c6-76c1-4a7d-be37-c61a3fba51cd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:56.477459 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea55c6-76c1-4a7d-be37-c61a3fba51cd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:56.488328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7961e1a-289c-4600-b8c5-1dc3d1a1e355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:56.489426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7961e1a-289c-4600-b8c5-1dc3d1a1e355 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:56.495237 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7961e1a-289c-4600-b8c5-1dc3d1a1e355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:56.496223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7961e1a-289c-4600-b8c5-1dc3d1a1e355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:56.497537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7961e1a-289c-4600-b8c5-1dc3d1a1e355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:56.499331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7961e1a-289c-4600-b8c5-1dc3d1a1e355 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:56.512865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1248/2502] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:56.518996 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7961e1a-289c-4600-b8c5-1dc3d1a1e355 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:56.523622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076525ab-35e2-45fb-832f-621cede1ac8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:56.525562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076525ab-35e2-45fb-832f-621cede1ac8d service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:56.533344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7961e1a-289c-4600-b8c5-1dc3d1a1e355 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:56.540063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d945d9e-723e-47c5-8741-f4d6b90110b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:56.540614 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1255/2503] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:42:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:56.541519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945d9e-723e-47c5-8741-f4d6b90110b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:56.542057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945d9e-723e-47c5-8741-f4d6b90110b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:56.542739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d945d9e-723e-47c5-8741-f4d6b90110b4 admin admin] PATH_INFO: `/v3/projects/869216ef3b3e4557bd37b3e4cefeb875/users/39a5a43f51574219815064c1a0d6a5fb/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:56.567254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d945d9e-723e-47c5-8741-f4d6b90110b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869216ef3b3e4557bd37b3e4cefeb875, user_id=39a5a43f51574219815064c1a0d6a5fb, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:56.569975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d945d9e-723e-47c5-8741-f4d6b90110b4 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:56.727651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1249/2504] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:56 2022] PUT /identity/v3/projects/869216ef3b3e4557bd37b3e4cefeb875/users/39a5a43f51574219815064c1a0d6a5fb/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:42:56.742608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17c8b-3d48-497c-aea5-aa552978499c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:56.742916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17c8b-3d48-497c-aea5-aa552978499c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:56.743401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a17c8b-3d48-497c-aea5-aa552978499c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:56.784203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f5a17c8b-3d48-497c-aea5-aa552978499c None None] MFA Rules not processed for user `39a5a43f51574219815064c1a0d6a5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:56.785572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f5a17c8b-3d48-497c-aea5-aa552978499c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:56.872904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:56.955528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1256/2505] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:56.960720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d945d9e-723e-47c5-8741-f4d6b90110b4 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:57.088262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d945d9e-723e-47c5-8741-f4d6b90110b4 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:57.098313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f4330-1266-4c0b-8676-58e453a01a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:57.099212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f4330-1266-4c0b-8676-58e453a01a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:57.099697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f4330-1266-4c0b-8676-58e453a01a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:57.100131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f4330-1266-4c0b-8676-58e453a01a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:57.101097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f4330-1266-4c0b-8676-58e453a01a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:57.103646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f4330-1266-4c0b-8676-58e453a01a35 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:57.312411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1250/2506] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:42:56 2022] POST /identity/v3/projects => generated 379 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:57.316613 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a17c8b-3d48-497c-aea5-aa552978499c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:57.331852 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a17c8b-3d48-497c-aea5-aa552978499c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:57.449950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58f08a-dda3-4b34-ac3a-16a974da0827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:57.450601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58f08a-dda3-4b34-ac3a-16a974da0827 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:57.451047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58f08a-dda3-4b34-ac3a-16a974da0827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:57.451401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58f08a-dda3-4b34-ac3a-16a974da0827 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:57.452170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58f08a-dda3-4b34-ac3a-16a974da0827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:57.454943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58f08a-dda3-4b34-ac3a-16a974da0827 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:57.629127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1257/2507] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:42:57 2022] POST /identity/v3/users => generated 296 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:42:57.634858 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f4330-1266-4c0b-8676-58e453a01a35 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:57.649369 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f4330-1266-4c0b-8676-58e453a01a35 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:57.667333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bcbb0-e00b-4b88-b29c-da70fe726ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:57.667333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bcbb0-e00b-4b88-b29c-da70fe726ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:57.667333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bcbb0-e00b-4b88-b29c-da70fe726ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:57.667333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bcbb0-e00b-4b88-b29c-da70fe726ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:57.668051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bcbb0-e00b-4b88-b29c-da70fe726ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:57.670877 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bcbb0-e00b-4b88-b29c-da70fe726ab1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:57.689584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1251/2508] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:57.702900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58f08a-dda3-4b34-ac3a-16a974da0827 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:57.731204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58f08a-dda3-4b34-ac3a-16a974da0827 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:57.737706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ed1ae-4a00-45ef-be20-9e638d5c1547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:57.738465 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed1ae-4a00-45ef-be20-9e638d5c1547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:57.738752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed1ae-4a00-45ef-be20-9e638d5c1547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:57.739590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ed1ae-4a00-45ef-be20-9e638d5c1547 admin admin] PATH_INFO: `/v3/projects/5153345f8b344d5c9c05d4e508ff1036/users/dce4548e92e941368281a2dfeb1497ee/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:57.789389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ed1ae-4a00-45ef-be20-9e638d5c1547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5153345f8b344d5c9c05d4e508ff1036, user_id=dce4548e92e941368281a2dfeb1497ee, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:57.799648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ed1ae-4a00-45ef-be20-9e638d5c1547 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:57.924019 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1258/2509] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:57 2022] PUT /identity/v3/projects/5153345f8b344d5c9c05d4e508ff1036/users/dce4548e92e941368281a2dfeb1497ee/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:57.929320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bcbb0-e00b-4b88-b29c-da70fe726ab1 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:57.954770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bcbb0-e00b-4b88-b29c-da70fe726ab1 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:58.180735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59184c69-a29f-4e14-850e-cf868a91d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:58.181348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59184c69-a29f-4e14-850e-cf868a91d957 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:58.181620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59184c69-a29f-4e14-850e-cf868a91d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:58.182093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59184c69-a29f-4e14-850e-cf868a91d957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:58.182768 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59184c69-a29f-4e14-850e-cf868a91d957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:58.184337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59184c69-a29f-4e14-850e-cf868a91d957 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:58.206944 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1252/2510] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:42:58.212306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ed1ae-4a00-45ef-be20-9e638d5c1547 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:58.224142 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ed1ae-4a00-45ef-be20-9e638d5c1547 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:58.228877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cf4ff-1f75-47cc-bf2a-2f53a79f77e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:58.229573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cf4ff-1f75-47cc-bf2a-2f53a79f77e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:58.229853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cf4ff-1f75-47cc-bf2a-2f53a79f77e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:58.230156 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cf4ff-1f75-47cc-bf2a-2f53a79f77e7 admin admin] PATH_INFO: `/v3/projects/5153345f8b344d5c9c05d4e508ff1036/users/dce4548e92e941368281a2dfeb1497ee/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:58.233004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cf4ff-1f75-47cc-bf2a-2f53a79f77e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5153345f8b344d5c9c05d4e508ff1036, user_id=dce4548e92e941368281a2dfeb1497ee, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:58.236029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cf4ff-1f75-47cc-bf2a-2f53a79f77e7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:58.247062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1259/2511] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:42:58 2022] PUT /identity/v3/projects/5153345f8b344d5c9c05d4e508ff1036/users/dce4548e92e941368281a2dfeb1497ee/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:42:58.258569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03960fa-624c-48d8-8188-7c0b40e352d5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:58.258863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03960fa-624c-48d8-8188-7c0b40e352d5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:58.259140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03960fa-624c-48d8-8188-7c0b40e352d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:58.295413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c03960fa-624c-48d8-8188-7c0b40e352d5 None None] MFA Rules not processed for user `dce4548e92e941368281a2dfeb1497ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:42:58.297103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c03960fa-624c-48d8-8188-7c0b40e352d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:58.384335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1253/2512] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:42:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:42:59.619127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cf4ff-1f75-47cc-bf2a-2f53a79f77e7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:59.622576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-614cf4ff-1f75-47cc-bf2a-2f53a79f77e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:59.795707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cf4ff-1f75-47cc-bf2a-2f53a79f77e7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:59.799681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55113437-7580-4356-8242-673df46c4213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:59.800662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55113437-7580-4356-8242-673df46c4213 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:59.800662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55113437-7580-4356-8242-673df46c4213 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:59.800857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55113437-7580-4356-8242-673df46c4213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:59.816034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55113437-7580-4356-8242-673df46c4213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:42:59.818755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55113437-7580-4356-8242-673df46c4213 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:42:59.830875 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1260/2513] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:42:59.847501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:59.935882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03960fa-624c-48d8-8188-7c0b40e352d5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:42:59.938696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c03960fa-624c-48d8-8188-7c0b40e352d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:42:59.957615 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03960fa-624c-48d8-8188-7c0b40e352d5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:42:59.963994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194355d2-0d65-4aad-b2ff-e507a1f0cfdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:42:59.965100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194355d2-0d65-4aad-b2ff-e507a1f0cfdc service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:42:59.966019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194355d2-0d65-4aad-b2ff-e507a1f0cfdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:42:59.967346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194355d2-0d65-4aad-b2ff-e507a1f0cfdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:42:59.970417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-194355d2-0d65-4aad-b2ff-e507a1f0cfdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:00.008222 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:00.120781 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194355d2-0d65-4aad-b2ff-e507a1f0cfdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:00.120781 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194355d2-0d65-4aad-b2ff-e507a1f0cfdc service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:00.124276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55113437-7580-4356-8242-673df46c4213 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:00.132937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1254/2514] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:42:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:00.153346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55113437-7580-4356-8242-673df46c4213 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:00.163929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b18663-96a5-464a-93b1-96127c030aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:00.166546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b18663-96a5-464a-93b1-96127c030aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:00.166546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b18663-96a5-464a-93b1-96127c030aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:00.166546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b18663-96a5-464a-93b1-96127c030aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:00.277953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b18663-96a5-464a-93b1-96127c030aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:00.281605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b18663-96a5-464a-93b1-96127c030aa3 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:00.295478 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1261/2515] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:01.861177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:02.362230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:02.865003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194355d2-0d65-4aad-b2ff-e507a1f0cfdc service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:02.879224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194355d2-0d65-4aad-b2ff-e507a1f0cfdc service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:02.885424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a77ed-be88-4aa1-a3af-7d65390daf98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:02.886397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a77ed-be88-4aa1-a3af-7d65390daf98 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:02.886830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a77ed-be88-4aa1-a3af-7d65390daf98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:02.887405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a77ed-be88-4aa1-a3af-7d65390daf98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:02.896134 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c72a77ed-be88-4aa1-a3af-7d65390daf98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:02.932434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b18663-96a5-464a-93b1-96127c030aa3 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:02.933953 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-89b18663-96a5-464a-93b1-96127c030aa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:03.022207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a77ed-be88-4aa1-a3af-7d65390daf98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:03.024774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a77ed-be88-4aa1-a3af-7d65390daf98 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:03.038683 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1255/2516] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:03.061587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b18663-96a5-464a-93b1-96127c030aa3 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:03.068195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb124b7-a6b2-41a6-93b1-0cd2ba76a253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:03.068195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb124b7-a6b2-41a6-93b1-0cd2ba76a253 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:03.068195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb124b7-a6b2-41a6-93b1-0cd2ba76a253 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:03.068195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb124b7-a6b2-41a6-93b1-0cd2ba76a253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:03.069676 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-fdb124b7-a6b2-41a6-93b1-0cd2ba76a253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:03.210837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb124b7-a6b2-41a6-93b1-0cd2ba76a253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:03.214887 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb124b7-a6b2-41a6-93b1-0cd2ba76a253 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:03.238258 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1262/2517] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:03.436700 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:04.361966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:04.716173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:05.390189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:07.171059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:07.473321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a77ed-be88-4aa1-a3af-7d65390daf98 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:07.474800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c72a77ed-be88-4aa1-a3af-7d65390daf98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:07.490632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a77ed-be88-4aa1-a3af-7d65390daf98 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:07.495569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e2547-4fe0-496b-be9b-528f6875f8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:07.496317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e2547-4fe0-496b-be9b-528f6875f8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:07.496636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e2547-4fe0-496b-be9b-528f6875f8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:07.496938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e2547-4fe0-496b-be9b-528f6875f8dd admin admin] PATH_INFO: `/v3/users/b1628c4903b34a219d19e01bf73e0b03` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:07.498718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e2547-4fe0-496b-be9b-528f6875f8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1628c4903b34a219d19e01bf73e0b03)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:07.500674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e2547-4fe0-496b-be9b-528f6875f8dd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:07.890444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1e4e2547-4fe0-496b-be9b-528f6875f8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1628c4903b34a219d19e01bf73e0b03'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.897545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1e4e2547-4fe0-496b-be9b-528f6875f8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1628c4903b34a219d19e01bf73e0b03'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.898286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1e4e2547-4fe0-496b-be9b-528f6875f8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1628c4903b34a219d19e01bf73e0b03'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.978413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1e4e2547-4fe0-496b-be9b-528f6875f8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1628c4903b34a219d19e01bf73e0b03'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.979046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1e4e2547-4fe0-496b-be9b-528f6875f8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1628c4903b34a219d19e01bf73e0b03'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:07.998151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1256/2518] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:07 2022] DELETE /identity/v3/users/b1628c4903b34a219d19e01bf73e0b03 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:08.370271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb124b7-a6b2-41a6-93b1-0cd2ba76a253 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:08.382829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb124b7-a6b2-41a6-93b1-0cd2ba76a253 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:08.475805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:08.476849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:08.477318 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:08.477803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] PATH_INFO: `/v3/projects/2bf0446d7ff94fa880e5a8d868a9e0d4` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:08.479921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf0446d7ff94fa880e5a8d868a9e0d4)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:08.483722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:08.645047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf0446d7ff94fa880e5a8d868a9e0d4', 'request_id': 'req-298d1f7d-f774-4ddb-9a31-4594b012e64f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.653532 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf0446d7ff94fa880e5a8d868a9e0d4', 'request_id': 'req-298d1f7d-f774-4ddb-9a31-4594b012e64f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.798416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf0446d7ff94fa880e5a8d868a9e0d4', 'request_id': 'req-298d1f7d-f774-4ddb-9a31-4594b012e64f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.823670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] The token cache is being invalidate because project 2bf0446d7ff94fa880e5a8d868a9e0d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:08.824005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.824636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-298d1f7d-f774-4ddb-9a31-4594b012e64f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:08.826994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1263/2519] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:08 2022] DELETE /identity/v3/projects/2bf0446d7ff94fa880e5a8d868a9e0d4 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:08.837514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622220b-3993-46b9-83f9-e06aa5962b9c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:08.837965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622220b-3993-46b9-83f9-e06aa5962b9c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:08.838154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622220b-3993-46b9-83f9-e06aa5962b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:08.860733 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-7622220b-3993-46b9-83f9-e06aa5962b9c None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:08.863424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7622220b-3993-46b9-83f9-e06aa5962b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:08.944025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1257/2520] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:08.952649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8781-dc0a-4b7c-a2f0-7163d44dc1b2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:08.952958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8781-dc0a-4b7c-a2f0-7163d44dc1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:08.953323 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c8781-dc0a-4b7c-a2f0-7163d44dc1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:08.978950 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-077c8781-dc0a-4b7c-a2f0-7163d44dc1b2 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:08.980259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-077c8781-dc0a-4b7c-a2f0-7163d44dc1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:08.990790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1264/2521] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:09.000712 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622220b-3993-46b9-83f9-e06aa5962b9c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.030252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622220b-3993-46b9-83f9-e06aa5962b9c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.035604 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477a3d-0d88-46f1-8ddc-1280f8ef712a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.036204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477a3d-0d88-46f1-8ddc-1280f8ef712a admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.036485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477a3d-0d88-46f1-8ddc-1280f8ef712a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.036760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1477a3d-0d88-46f1-8ddc-1280f8ef712a admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.037486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1477a3d-0d88-46f1-8ddc-1280f8ef712a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:09.037790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1477a3d-0d88-46f1-8ddc-1280f8ef712a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.039581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1477a3d-0d88-46f1-8ddc-1280f8ef712a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.057987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1258/2522] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:09.063051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c8781-dc0a-4b7c-a2f0-7163d44dc1b2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.073637 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c8781-dc0a-4b7c-a2f0-7163d44dc1b2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.079300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e465c4a-d9c5-4639-b3da-67e668941759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.079924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465c4a-d9c5-4639-b3da-67e668941759 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.080203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465c4a-d9c5-4639-b3da-67e668941759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.080474 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e465c4a-d9c5-4639-b3da-67e668941759 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.081126 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e465c4a-d9c5-4639-b3da-67e668941759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.083063 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e465c4a-d9c5-4639-b3da-67e668941759 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.105919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:09.226264 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1265/2523] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:09 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:09.230812 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477a3d-0d88-46f1-8ddc-1280f8ef712a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.242534 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1477a3d-0d88-46f1-8ddc-1280f8ef712a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.293492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:09.311052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe217e0-c139-42c2-9e84-506a1dbb2823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.311706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe217e0-c139-42c2-9e84-506a1dbb2823 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.311988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe217e0-c139-42c2-9e84-506a1dbb2823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.312259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe217e0-c139-42c2-9e84-506a1dbb2823 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.312905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe217e0-c139-42c2-9e84-506a1dbb2823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.314848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe217e0-c139-42c2-9e84-506a1dbb2823 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.521468 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1259/2524] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:09 2022] POST /identity/v3/users => generated 283 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:09.523412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e465c4a-d9c5-4639-b3da-67e668941759 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.534935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e465c4a-d9c5-4639-b3da-67e668941759 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.539583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649047a-703f-48a2-9fd3-2709af7e312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.540191 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649047a-703f-48a2-9fd3-2709af7e312c admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.540469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649047a-703f-48a2-9fd3-2709af7e312c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.540740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649047a-703f-48a2-9fd3-2709af7e312c admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.541379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649047a-703f-48a2-9fd3-2709af7e312c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.543149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649047a-703f-48a2-9fd3-2709af7e312c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.554978 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1266/2525] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:09.559450 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe217e0-c139-42c2-9e84-506a1dbb2823 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.580913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe217e0-c139-42c2-9e84-506a1dbb2823 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.587968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a71f8-b602-4238-88e3-ab249111c7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.588705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a71f8-b602-4238-88e3-ab249111c7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.589152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a71f8-b602-4238-88e3-ab249111c7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.589515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a71f8-b602-4238-88e3-ab249111c7c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.590435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a71f8-b602-4238-88e3-ab249111c7c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.592383 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a71f8-b602-4238-88e3-ab249111c7c2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.604420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1260/2526] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:09.609382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649047a-703f-48a2-9fd3-2709af7e312c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.620004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649047a-703f-48a2-9fd3-2709af7e312c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.625891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57402644-d70c-4e60-b31c-2ffb52cbd6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.626556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57402644-d70c-4e60-b31c-2ffb52cbd6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.626839 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57402644-d70c-4e60-b31c-2ffb52cbd6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.627185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57402644-d70c-4e60-b31c-2ffb52cbd6ee admin admin] PATH_INFO: `/v3/projects/8c11717233d743d7b6cdaf2924743f9d/users/012cc6666e4d46e992d466b4c47c18ff/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.643097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57402644-d70c-4e60-b31c-2ffb52cbd6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c11717233d743d7b6cdaf2924743f9d, user_id=012cc6666e4d46e992d466b4c47c18ff, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.645840 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57402644-d70c-4e60-b31c-2ffb52cbd6ee admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.767104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1267/2527] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:09 2022] PUT /identity/v3/projects/8c11717233d743d7b6cdaf2924743f9d/users/012cc6666e4d46e992d466b4c47c18ff/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:09.777404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e18f3-53a2-426a-914a-99a08a55da35 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.777654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e18f3-53a2-426a-914a-99a08a55da35 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.777896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e18f3-53a2-426a-914a-99a08a55da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.807938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9a3e18f3-53a2-426a-914a-99a08a55da35 None None] MFA Rules not processed for user `012cc6666e4d46e992d466b4c47c18ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:09.809154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9a3e18f3-53a2-426a-914a-99a08a55da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:09.874799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1261/2528] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:09.886405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57402644-d70c-4e60-b31c-2ffb52cbd6ee admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:09.888195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-57402644-d70c-4e60-b31c-2ffb52cbd6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:09.947469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57402644-d70c-4e60-b31c-2ffb52cbd6ee admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:09.951565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69c095-80e3-4830-a186-508a5c705eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:09.952180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c095-80e3-4830-a186-508a5c705eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:09.952460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c095-80e3-4830-a186-508a5c705eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:09.952734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69c095-80e3-4830-a186-508a5c705eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:09.964310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69c095-80e3-4830-a186-508a5c705eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:09.964310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a69c095-80e3-4830-a186-508a5c705eb1 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:09.974540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1268/2529] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:10.210978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e18f3-53a2-426a-914a-99a08a55da35 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:10.212599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9a3e18f3-53a2-426a-914a-99a08a55da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:10.291316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e18f3-53a2-426a-914a-99a08a55da35 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:10.296147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:10.296791 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:10.297071 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:10.297347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] PATH_INFO: `/v3/users/0427f88632124b3ba01b9250955ff6c8` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:10.298603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0427f88632124b3ba01b9250955ff6c8)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:10.300465 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:10.659974 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0427f88632124b3ba01b9250955ff6c8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:10.667064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0427f88632124b3ba01b9250955ff6c8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:10.667967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0427f88632124b3ba01b9250955ff6c8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:10.792959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0427f88632124b3ba01b9250955ff6c8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:10.792959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0427f88632124b3ba01b9250955ff6c8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:10.813967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1262/2530] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:10 2022] DELETE /identity/v3/users/0427f88632124b3ba01b9250955ff6c8 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:10.818493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e57ea6-edd5-4d2e-8879-1e2694a109f6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:10.819026 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e57ea6-edd5-4d2e-8879-1e2694a109f6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:10.819162 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e57ea6-edd5-4d2e-8879-1e2694a109f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:10.840870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-13e57ea6-edd5-4d2e-8879-1e2694a109f6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:10.842177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-13e57ea6-edd5-4d2e-8879-1e2694a109f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:10.907512 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1269/2531] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:10.917673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:10.919706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:10.980499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b91d5-8342-4633-93d9-4f6c6d527604 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:10.985048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de45ab6-02b3-4f6f-ac1d-29d88c8fcd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:10.985661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45ab6-02b3-4f6f-ac1d-29d88c8fcd05 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:10.985969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45ab6-02b3-4f6f-ac1d-29d88c8fcd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:10.986247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de45ab6-02b3-4f6f-ac1d-29d88c8fcd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:10.996331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de45ab6-02b3-4f6f-ac1d-29d88c8fcd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:10.998580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de45ab6-02b3-4f6f-ac1d-29d88c8fcd05 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:11.009648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1263/2532] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:11.702890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e57ea6-edd5-4d2e-8879-1e2694a109f6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:11.707878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-13e57ea6-edd5-4d2e-8879-1e2694a109f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:11.719391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e57ea6-edd5-4d2e-8879-1e2694a109f6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:11.724335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:11.725249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:11.725529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:11.725803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] PATH_INFO: `/v3/projects/81a770db9e2e4251b451568fbbd15318` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:11.727034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a770db9e2e4251b451568fbbd15318)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:11.729531 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:12.082778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a770db9e2e4251b451568fbbd15318', 'request_id': 'req-6d4060c2-d716-4b34-8c77-97c198e62ed4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.092907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a770db9e2e4251b451568fbbd15318', 'request_id': 'req-6d4060c2-d716-4b34-8c77-97c198e62ed4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.214952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a770db9e2e4251b451568fbbd15318', 'request_id': 'req-6d4060c2-d716-4b34-8c77-97c198e62ed4'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.227656 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] The token cache is being invalidate because project 81a770db9e2e4251b451568fbbd15318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:12.227945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.228639 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.230272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1270/2533] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:11 2022] DELETE /identity/v3/projects/81a770db9e2e4251b451568fbbd15318 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:12.235673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de45ab6-02b3-4f6f-ac1d-29d88c8fcd05 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:12.246277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de45ab6-02b3-4f6f-ac1d-29d88c8fcd05 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:12.307701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aade63c-7696-473e-baa2-3a207e8e3d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:12.308337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aade63c-7696-473e-baa2-3a207e8e3d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:12.308619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aade63c-7696-473e-baa2-3a207e8e3d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:12.309063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aade63c-7696-473e-baa2-3a207e8e3d36 admin admin] PATH_INFO: `/v3/users/d585a46893ee477abc1b50516ca4e74f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:12.310982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aade63c-7696-473e-baa2-3a207e8e3d36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d585a46893ee477abc1b50516ca4e74f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:12.312997 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aade63c-7696-473e-baa2-3a207e8e3d36 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:12.321754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:12.344144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:12.346299 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:12.360502 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4060c2-d716-4b34-8c77-97c198e62ed4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:12.366800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:12.368935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:12.368935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:12.368935 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] PATH_INFO: `/v3/users/39a5a43f51574219815064c1a0d6a5fb` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:12.369389 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39a5a43f51574219815064c1a0d6a5fb)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:12.371437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:12.712458 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8aade63c-7696-473e-baa2-3a207e8e3d36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd585a46893ee477abc1b50516ca4e74f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.720255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8aade63c-7696-473e-baa2-3a207e8e3d36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd585a46893ee477abc1b50516ca4e74f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.721033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8aade63c-7696-473e-baa2-3a207e8e3d36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd585a46893ee477abc1b50516ca4e74f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.751000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39a5a43f51574219815064c1a0d6a5fb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.759257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39a5a43f51574219815064c1a0d6a5fb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.760298 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39a5a43f51574219815064c1a0d6a5fb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.853094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8aade63c-7696-473e-baa2-3a207e8e3d36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd585a46893ee477abc1b50516ca4e74f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.853651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8aade63c-7696-473e-baa2-3a207e8e3d36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd585a46893ee477abc1b50516ca4e74f'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.880008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1264/2534] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:12 2022] DELETE /identity/v3/users/d585a46893ee477abc1b50516ca4e74f => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:12.947111 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39a5a43f51574219815064c1a0d6a5fb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.947976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:12.962711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39a5a43f51574219815064c1a0d6a5fb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:12.973927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1271/2535] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:12 2022] DELETE /identity/v3/users/39a5a43f51574219815064c1a0d6a5fb => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:12.976316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28d89-8be5-4d47-848e-c22c8bda8c87 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:12.977239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28d89-8be5-4d47-848e-c22c8bda8c87 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:12.977525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b28d89-8be5-4d47-848e-c22c8bda8c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:13.000350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-03b28d89-8be5-4d47-848e-c22c8bda8c87 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:13.001718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-03b28d89-8be5-4d47-848e-c22c8bda8c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:13.067370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1265/2536] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:13.078004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:13.079444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:13.163441 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bfee2f-3d9e-4d8e-a75d-a7fa46226695 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:13.167739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760e84b-913a-491c-ad2f-4a9efa3daca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:13.168846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e84b-913a-491c-ad2f-4a9efa3daca6 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:13.168846 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e84b-913a-491c-ad2f-4a9efa3daca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:13.180999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760e84b-913a-491c-ad2f-4a9efa3daca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:13.192295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760e84b-913a-491c-ad2f-4a9efa3daca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:13.194059 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760e84b-913a-491c-ad2f-4a9efa3daca6 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:13.212153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1272/2537] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:13.464318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b28d89-8be5-4d47-848e-c22c8bda8c87 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:13.467380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-03b28d89-8be5-4d47-848e-c22c8bda8c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:13.479964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b28d89-8be5-4d47-848e-c22c8bda8c87 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:13.485630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:13.486936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:13.487224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:13.487499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] PATH_INFO: `/v3/projects/20651428229d412685b671227c08927b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:13.488739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] RBAC: Authorizing `identity:delete_project(project_id=20651428229d412685b671227c08927b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:13.491163 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:13.636655 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20651428229d412685b671227c08927b', 'request_id': 'req-210d0576-5aa1-45d4-93a3-beb83ac481df'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:13.645436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20651428229d412685b671227c08927b', 'request_id': 'req-210d0576-5aa1-45d4-93a3-beb83ac481df'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:13.652163 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20651428229d412685b671227c08927b', 'request_id': 'req-210d0576-5aa1-45d4-93a3-beb83ac481df'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:13.826515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] The token cache is being invalidate because project 20651428229d412685b671227c08927b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:13.826515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:13.826515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:13.831191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1266/2538] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:13 2022] DELETE /identity/v3/projects/20651428229d412685b671227c08927b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:13.834665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760e84b-913a-491c-ad2f-4a9efa3daca6 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:13.848670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760e84b-913a-491c-ad2f-4a9efa3daca6 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:13.936931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:13.937948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:13.938236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:13.938519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] PATH_INFO: `/v3/users/fd5f3e3679824574be9bb5f8fc283359` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:13.939842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5f3e3679824574be9bb5f8fc283359)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:13.941805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:14.144541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:14.145864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:14.166657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d0576-5aa1-45d4-93a3-beb83ac481df admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:14.174512 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:14.175359 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:14.175736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:14.176039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] PATH_INFO: `/v3/projects/869216ef3b3e4557bd37b3e4cefeb875` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:14.177380 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=869216ef3b3e4557bd37b3e4cefeb875)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:14.179548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:14.258579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5f3e3679824574be9bb5f8fc283359'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.267364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5f3e3679824574be9bb5f8fc283359'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.268147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5f3e3679824574be9bb5f8fc283359'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.329814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869216ef3b3e4557bd37b3e4cefeb875', 'request_id': 'req-84cb455b-5acf-44a5-b997-cd720b43d3ea'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.338096 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869216ef3b3e4557bd37b3e4cefeb875', 'request_id': 'req-84cb455b-5acf-44a5-b997-cd720b43d3ea'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.345059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869216ef3b3e4557bd37b3e4cefeb875', 'request_id': 'req-84cb455b-5acf-44a5-b997-cd720b43d3ea'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.361981 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5f3e3679824574be9bb5f8fc283359'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.379393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5f3e3679824574be9bb5f8fc283359'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.386104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1273/2539] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:13 2022] DELETE /identity/v3/users/fd5f3e3679824574be9bb5f8fc283359 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:14.474900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] The token cache is being invalidate because project 869216ef3b3e4557bd37b3e4cefeb875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:14.475551 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.475887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.477658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1267/2540] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:14 2022] DELETE /identity/v3/projects/869216ef3b3e4557bd37b3e4cefeb875 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:14.482546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:14.484138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:14.565476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff58a0-5d58-4e8a-82e0-ce32dc8e8873 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:14.570196 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:14.571067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:14.571302 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:14.571538 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] PATH_INFO: `/v3/users/dce4548e92e941368281a2dfeb1497ee` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:14.572704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce4548e92e941368281a2dfeb1497ee)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:14.574693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:14.969001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce4548e92e941368281a2dfeb1497ee'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.976417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce4548e92e941368281a2dfeb1497ee'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:14.977129 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce4548e92e941368281a2dfeb1497ee'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.024158 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:15.025347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:15.084305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce4548e92e941368281a2dfeb1497ee'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.109079 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce4548e92e941368281a2dfeb1497ee'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.116836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1274/2541] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:14 2022] DELETE /identity/v3/users/dce4548e92e941368281a2dfeb1497ee => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:15.163131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb455b-5acf-44a5-b997-cd720b43d3ea admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:15.250264 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:15.251000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:15.251278 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:15.251563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] PATH_INFO: `/v3/projects/97acdb33113b4448acb9f2111dd24215` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:15.252757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97acdb33113b4448acb9f2111dd24215)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:15.255006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:15.502803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97acdb33113b4448acb9f2111dd24215', 'request_id': 'req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.509770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97acdb33113b4448acb9f2111dd24215', 'request_id': 'req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.516200 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97acdb33113b4448acb9f2111dd24215', 'request_id': 'req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.530053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:15.572324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:15.574109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:15.592274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294ab5d-7636-4db9-900e-cc3dc41d043d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:15.607396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] The token cache is being invalidate because project 97acdb33113b4448acb9f2111dd24215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:15.607661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.608455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1be6a2ba-875b-4f7a-b1fb-7ca1ae059091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:15.610246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1268/2542] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:15 2022] DELETE /identity/v3/projects/97acdb33113b4448acb9f2111dd24215 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:15.616386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc237-3d1e-4e50-88a3-44d139dfb345 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:15.616669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc237-3d1e-4e50-88a3-44d139dfb345 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:15.617136 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fc237-3d1e-4e50-88a3-44d139dfb345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:15.646449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0d0fc237-3d1e-4e50-88a3-44d139dfb345 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:15.647692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0d0fc237-3d1e-4e50-88a3-44d139dfb345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:15.673627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:15.674227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:15.674506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:15.674830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] PATH_INFO: `/v3/projects/5153345f8b344d5c9c05d4e508ff1036` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:15.676012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5153345f8b344d5c9c05d4e508ff1036)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:15.678197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:15.716971 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1269/2543] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:15.724864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8b3eb-ce7e-46c5-9c2f-9752782b5eeb None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:15.725148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8b3eb-ce7e-46c5-9c2f-9752782b5eeb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:15.725451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8b3eb-ce7e-46c5-9c2f-9752782b5eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:15.746563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-69d8b3eb-ce7e-46c5-9c2f-9752782b5eeb None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:15.747925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-69d8b3eb-ce7e-46c5-9c2f-9752782b5eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:15.762293 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1270/2544] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:15.768064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8b3eb-ce7e-46c5-9c2f-9752782b5eeb None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:15.779718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8b3eb-ce7e-46c5-9c2f-9752782b5eeb None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:15.785618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a4cc6-3e7d-436d-975c-ae617916b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:15.786506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a4cc6-3e7d-436d-975c-ae617916b30d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:15.787111 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a4cc6-3e7d-436d-975c-ae617916b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:15.787390 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a4cc6-3e7d-436d-975c-ae617916b30d admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:15.788041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a4cc6-3e7d-436d-975c-ae617916b30d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:15.788355 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a4cc6-3e7d-436d-975c-ae617916b30d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:15.790127 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a4cc6-3e7d-436d-975c-ae617916b30d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:15.803455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1271/2545] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:15.807699 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a4cc6-3e7d-436d-975c-ae617916b30d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:15.818025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a4cc6-3e7d-436d-975c-ae617916b30d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:15.823088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255111cb-c471-4eeb-b60a-1f0e1e6419cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:15.836341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255111cb-c471-4eeb-b60a-1f0e1e6419cb admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:15.836341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255111cb-c471-4eeb-b60a-1f0e1e6419cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:15.836341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255111cb-c471-4eeb-b60a-1f0e1e6419cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:15.836341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255111cb-c471-4eeb-b60a-1f0e1e6419cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:15.836341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255111cb-c471-4eeb-b60a-1f0e1e6419cb admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:15.988349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5153345f8b344d5c9c05d4e508ff1036', 'request_id': 'req-ee2687a4-0549-4137-87e3-eacd1bfea0f5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:16.006477 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5153345f8b344d5c9c05d4e508ff1036', 'request_id': 'req-ee2687a4-0549-4137-87e3-eacd1bfea0f5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:16.039826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1272/2546] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:15 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:16.041184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255111cb-c471-4eeb-b60a-1f0e1e6419cb admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.085698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5153345f8b344d5c9c05d4e508ff1036', 'request_id': 'req-ee2687a4-0549-4137-87e3-eacd1bfea0f5'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:16.098059 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] The token cache is being invalidate because project 5153345f8b344d5c9c05d4e508ff1036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:16.098472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:16.099115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-ee2687a4-0549-4137-87e3-eacd1bfea0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:16.101029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1275/2547] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:15 2022] DELETE /identity/v3/projects/5153345f8b344d5c9c05d4e508ff1036 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:16.106114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391de5-e258-4e72-85d3-f1e9d5e9df5e None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.106399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391de5-e258-4e72-85d3-f1e9d5e9df5e None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.107982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391de5-e258-4e72-85d3-f1e9d5e9df5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.121386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255111cb-c471-4eeb-b60a-1f0e1e6419cb admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.132019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef550f9-90d1-4c48-b2ef-4edcec3aadd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.133349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-63391de5-e258-4e72-85d3-f1e9d5e9df5e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:16.138614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef550f9-90d1-4c48-b2ef-4edcec3aadd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.138614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef550f9-90d1-4c48-b2ef-4edcec3aadd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.138614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef550f9-90d1-4c48-b2ef-4edcec3aadd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.139248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-63391de5-e258-4e72-85d3-f1e9d5e9df5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:16.139354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef550f9-90d1-4c48-b2ef-4edcec3aadd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:16.140057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef550f9-90d1-4c48-b2ef-4edcec3aadd8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:16.159916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1276/2548] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:16.169281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ef9b5-399c-4388-a4d2-e368fec9af54 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.169834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ef9b5-399c-4388-a4d2-e368fec9af54 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.170221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ef9b5-399c-4388-a4d2-e368fec9af54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.194036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e98ef9b5-399c-4388-a4d2-e368fec9af54 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:16.195419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e98ef9b5-399c-4388-a4d2-e368fec9af54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:16.205657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:16.212262 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1277/2549] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:16.217280 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ef9b5-399c-4388-a4d2-e368fec9af54 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.226816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ef9b5-399c-4388-a4d2-e368fec9af54 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.231778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ec840-45da-415e-8628-57c3b45dad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.232910 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ec840-45da-415e-8628-57c3b45dad6b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.233200 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ec840-45da-415e-8628-57c3b45dad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.233461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ec840-45da-415e-8628-57c3b45dad6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.234256 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ec840-45da-415e-8628-57c3b45dad6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:16.234490 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ec840-45da-415e-8628-57c3b45dad6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:16.236274 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ec840-45da-415e-8628-57c3b45dad6b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:16.256427 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1278/2550] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:43:16.259098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ec840-45da-415e-8628-57c3b45dad6b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.261865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1273/2551] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:16 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:16.266661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef550f9-90d1-4c48-b2ef-4edcec3aadd8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.268884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7ef550f9-90d1-4c48-b2ef-4edcec3aadd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:16.272989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ec840-45da-415e-8628-57c3b45dad6b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.279459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a16b5-2b47-4fb3-83c5-b76e5c0ccb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.280582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a16b5-2b47-4fb3-83c5-b76e5c0ccb54 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.280857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a16b5-2b47-4fb3-83c5-b76e5c0ccb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.281268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a16b5-2b47-4fb3-83c5-b76e5c0ccb54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.282181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a16b5-2b47-4fb3-83c5-b76e5c0ccb54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:16.284146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a16b5-2b47-4fb3-83c5-b76e5c0ccb54 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:16.288104 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef550f9-90d1-4c48-b2ef-4edcec3aadd8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.292210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495aa83-e487-47d3-b92a-8d9c5fcccd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.292838 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495aa83-e487-47d3-b92a-8d9c5fcccd7c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.293121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495aa83-e487-47d3-b92a-8d9c5fcccd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.293396 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495aa83-e487-47d3-b92a-8d9c5fcccd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.294082 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495aa83-e487-47d3-b92a-8d9c5fcccd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:16.296365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5495aa83-e487-47d3-b92a-8d9c5fcccd7c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:16.311140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1274/2552] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:16.314101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495aa83-e487-47d3-b92a-8d9c5fcccd7c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.324931 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495aa83-e487-47d3-b92a-8d9c5fcccd7c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.330766 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413eab7b-b7de-4a36-85be-7838e2ccad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.331384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413eab7b-b7de-4a36-85be-7838e2ccad11 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.331770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413eab7b-b7de-4a36-85be-7838e2ccad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.331981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413eab7b-b7de-4a36-85be-7838e2ccad11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.332609 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413eab7b-b7de-4a36-85be-7838e2ccad11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:16.334425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413eab7b-b7de-4a36-85be-7838e2ccad11 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:16.349400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1275/2553] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:16.353859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413eab7b-b7de-4a36-85be-7838e2ccad11 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.359599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1279/2554] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:16 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:16.363849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a16b5-2b47-4fb3-83c5-b76e5c0ccb54 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.368303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413eab7b-b7de-4a36-85be-7838e2ccad11 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.430975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce22cc-28b8-489f-986e-d882e9074ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.432076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce22cc-28b8-489f-986e-d882e9074ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.432575 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce22cc-28b8-489f-986e-d882e9074ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.433050 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce22cc-28b8-489f-986e-d882e9074ef5 admin admin] PATH_INFO: `/v3/projects/9c471eca857d4896b50067569974914d/users/e28f1235bdf2421c9be0f08028256aec/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.447091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a16b5-2b47-4fb3-83c5-b76e5c0ccb54 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.449212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce22cc-28b8-489f-986e-d882e9074ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c471eca857d4896b50067569974914d, user_id=e28f1235bdf2421c9be0f08028256aec, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:16.452567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47677fd-ac64-4b16-98b5-0614756646ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.452887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce22cc-28b8-489f-986e-d882e9074ef5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:16.453173 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47677fd-ac64-4b16-98b5-0614756646ca admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.453450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47677fd-ac64-4b16-98b5-0614756646ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.453719 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47677fd-ac64-4b16-98b5-0614756646ca admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.454420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47677fd-ac64-4b16-98b5-0614756646ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:16.456322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47677fd-ac64-4b16-98b5-0614756646ca admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:16.608857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1280/2555] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:16 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:16.609365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1276/2556] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:16 2022] PUT /identity/v3/projects/9c471eca857d4896b50067569974914d/users/e28f1235bdf2421c9be0f08028256aec/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:16.613007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47677fd-ac64-4b16-98b5-0614756646ca admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.620534 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b39825-a548-4c0c-8d47-390541b7c60d None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.620814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b39825-a548-4c0c-8d47-390541b7c60d None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.621283 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b39825-a548-4c0c-8d47-390541b7c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.625374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47677fd-ac64-4b16-98b5-0614756646ca admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.657115 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f2b39825-a548-4c0c-8d47-390541b7c60d None None] MFA Rules not processed for user `e28f1235bdf2421c9be0f08028256aec`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:16.658386 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f2b39825-a548-4c0c-8d47-390541b7c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:16.690417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bab786-8d94-4fbf-89cb-a821376eae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.691139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bab786-8d94-4fbf-89cb-a821376eae4b admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.691524 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bab786-8d94-4fbf-89cb-a821376eae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.691800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bab786-8d94-4fbf-89cb-a821376eae4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.692446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bab786-8d94-4fbf-89cb-a821376eae4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:16.694150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bab786-8d94-4fbf-89cb-a821376eae4b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:16.710412 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1281/2557] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:16.711522 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bab786-8d94-4fbf-89cb-a821376eae4b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.721871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bab786-8d94-4fbf-89cb-a821376eae4b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.730858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa512d2-2395-4086-a81b-ee7c9e1b35b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.732044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa512d2-2395-4086-a81b-ee7c9e1b35b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.732420 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1277/2558] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:16.732604 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa512d2-2395-4086-a81b-ee7c9e1b35b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.732788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa512d2-2395-4086-a81b-ee7c9e1b35b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.733456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa512d2-2395-4086-a81b-ee7c9e1b35b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:16.735793 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa512d2-2395-4086-a81b-ee7c9e1b35b7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:16.747155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1282/2559] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:16.752254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b39825-a548-4c0c-8d47-390541b7c60d None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.764170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b39825-a548-4c0c-8d47-390541b7c60d None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.769101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b6dda-1095-4525-9d24-c01a11fe4835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.769777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6dda-1095-4525-9d24-c01a11fe4835 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.770092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6dda-1095-4525-9d24-c01a11fe4835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.770375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b6dda-1095-4525-9d24-c01a11fe4835 admin admin] PATH_INFO: `/v3/projects/9eb32b8bdfca4ec3a665415d6369c3b6/users/173e7f4c0b944177b1d6ef7ce7d66c5e/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.786848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b6dda-1095-4525-9d24-c01a11fe4835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb32b8bdfca4ec3a665415d6369c3b6, user_id=173e7f4c0b944177b1d6ef7ce7d66c5e, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:16.789599 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b6dda-1095-4525-9d24-c01a11fe4835 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:16.791674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa512d2-2395-4086-a81b-ee7c9e1b35b7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:16.797180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9aa512d2-2395-4086-a81b-ee7c9e1b35b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:16.866750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa512d2-2395-4086-a81b-ee7c9e1b35b7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:16.873726 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1278/2560] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:16 2022] PUT /identity/v3/projects/9eb32b8bdfca4ec3a665415d6369c3b6/users/173e7f4c0b944177b1d6ef7ce7d66c5e/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:16.885489 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f67fd-f04a-4847-acda-5d22557f85bd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.885856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f67fd-f04a-4847-acda-5d22557f85bd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.886169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f67fd-f04a-4847-acda-5d22557f85bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.916892 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-ba6f67fd-f04a-4847-acda-5d22557f85bd None None] MFA Rules not processed for user `173e7f4c0b944177b1d6ef7ce7d66c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:16.918525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ba6f67fd-f04a-4847-acda-5d22557f85bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:16.940014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5fe94-bb5b-4e9b-b980-f3021408b411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:16.940707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5fe94-bb5b-4e9b-b980-f3021408b411 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:16.940914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5fe94-bb5b-4e9b-b980-f3021408b411 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:16.941183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5fe94-bb5b-4e9b-b980-f3021408b411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:16.996918 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1279/2561] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:16.998730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f67fd-f04a-4847-acda-5d22557f85bd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.009942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5fe94-bb5b-4e9b-b980-f3021408b411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.011539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5fe94-bb5b-4e9b-b980-f3021408b411 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.021330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1283/2562] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:17.074051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f67fd-f04a-4847-acda-5d22557f85bd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.079613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aecf8b-c21f-4599-b14d-c9a316a97a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.080230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aecf8b-c21f-4599-b14d-c9a316a97a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.080510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aecf8b-c21f-4599-b14d-c9a316a97a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.080780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aecf8b-c21f-4599-b14d-c9a316a97a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.081418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aecf8b-c21f-4599-b14d-c9a316a97a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.083442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aecf8b-c21f-4599-b14d-c9a316a97a38 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.237498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1280/2563] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:16 2022] POST /identity/v3/projects => generated 391 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:17.246206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5fe94-bb5b-4e9b-b980-f3021408b411 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.259009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5fe94-bb5b-4e9b-b980-f3021408b411 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.331866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb683f13-30c0-49a9-846c-1722bc173b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.331866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683f13-30c0-49a9-846c-1722bc173b68 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.331866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683f13-30c0-49a9-846c-1722bc173b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.331866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683f13-30c0-49a9-846c-1722bc173b68 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.332444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb683f13-30c0-49a9-846c-1722bc173b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.332444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb683f13-30c0-49a9-846c-1722bc173b68 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.416992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1284/2564] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:17 2022] POST /identity/v3/users => generated 302 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:17.418381 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aecf8b-c21f-4599-b14d-c9a316a97a38 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.430659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aecf8b-c21f-4599-b14d-c9a316a97a38 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.436952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3062582-0881-4b76-ad0a-8232db75b75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.437526 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3062582-0881-4b76-ad0a-8232db75b75d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.438104 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3062582-0881-4b76-ad0a-8232db75b75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.438542 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3062582-0881-4b76-ad0a-8232db75b75d admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.439265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3062582-0881-4b76-ad0a-8232db75b75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.441241 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3062582-0881-4b76-ad0a-8232db75b75d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.457989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1281/2565] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:17.461762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb683f13-30c0-49a9-846c-1722bc173b68 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.474201 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb683f13-30c0-49a9-846c-1722bc173b68 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.480500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fb646-09d7-4ddb-b944-b293aa88cfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.485503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fb646-09d7-4ddb-b944-b293aa88cfec admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.485503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fb646-09d7-4ddb-b944-b293aa88cfec admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.485503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fb646-09d7-4ddb-b944-b293aa88cfec admin admin] PATH_INFO: `/v3/projects/12799246f34a421ea096e1772d2c6e30/users/8dad71b0736e46deaf50d6d7be028e21/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.520027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fb646-09d7-4ddb-b944-b293aa88cfec admin admin] RBAC: Authorizing `identity:create_grant(project_id=12799246f34a421ea096e1772d2c6e30, user_id=8dad71b0736e46deaf50d6d7be028e21, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.520385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fb646-09d7-4ddb-b944-b293aa88cfec admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.634809 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1285/2566] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:17 2022] PUT /identity/v3/projects/12799246f34a421ea096e1772d2c6e30/users/8dad71b0736e46deaf50d6d7be028e21/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:17.639735 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3062582-0881-4b76-ad0a-8232db75b75d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.651177 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3062582-0881-4b76-ad0a-8232db75b75d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.715288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fd0d1-f03a-4b8c-99ef-c0045bd73b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.716165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fd0d1-f03a-4b8c-99ef-c0045bd73b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.722339 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fd0d1-f03a-4b8c-99ef-c0045bd73b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.730596 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fd0d1-f03a-4b8c-99ef-c0045bd73b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.730596 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fd0d1-f03a-4b8c-99ef-c0045bd73b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.730596 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fd0d1-f03a-4b8c-99ef-c0045bd73b48 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.740247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1282/2567] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:17.744691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fb646-09d7-4ddb-b944-b293aa88cfec admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:17.759395 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fb646-09d7-4ddb-b944-b293aa88cfec admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:17.766684 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef412af-da05-41ee-8731-93819a92c3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:17.767500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef412af-da05-41ee-8731-93819a92c3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.768470 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef412af-da05-41ee-8731-93819a92c3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.768753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef412af-da05-41ee-8731-93819a92c3c2 admin admin] PATH_INFO: `/v3/projects/12799246f34a421ea096e1772d2c6e30/users/8dad71b0736e46deaf50d6d7be028e21/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.771061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef412af-da05-41ee-8731-93819a92c3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12799246f34a421ea096e1772d2c6e30, user_id=8dad71b0736e46deaf50d6d7be028e21, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:17.773800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef412af-da05-41ee-8731-93819a92c3c2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:17.785707 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1286/2568] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:17 2022] PUT /identity/v3/projects/12799246f34a421ea096e1772d2c6e30/users/8dad71b0736e46deaf50d6d7be028e21/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:17.797054 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215804e-31e1-464b-bd87-3493123a3db5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:17.805236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215804e-31e1-464b-bd87-3493123a3db5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:17.805236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215804e-31e1-464b-bd87-3493123a3db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:17.829759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e215804e-31e1-464b-bd87-3493123a3db5 None None] MFA Rules not processed for user `8dad71b0736e46deaf50d6d7be028e21`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:17.831032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e215804e-31e1-464b-bd87-3493123a3db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:17.922828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1283/2569] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:17.998277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef412af-da05-41ee-8731-93819a92c3c2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:18.062548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef412af-da05-41ee-8731-93819a92c3c2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:18.066655 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410dec1-c835-47df-bd26-04beba6d71b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:18.067281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410dec1-c835-47df-bd26-04beba6d71b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.067563 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410dec1-c835-47df-bd26-04beba6d71b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.067841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410dec1-c835-47df-bd26-04beba6d71b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.078386 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410dec1-c835-47df-bd26-04beba6d71b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:18.079841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410dec1-c835-47df-bd26-04beba6d71b3 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:18.090286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1287/2570] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:17 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:18.215462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215804e-31e1-464b-bd87-3493123a3db5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:18.219803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215804e-31e1-464b-bd87-3493123a3db5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:18.223562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bea3fa-58ed-4dce-9231-d316d690bea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:18.224185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bea3fa-58ed-4dce-9231-d316d690bea4 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.224467 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bea3fa-58ed-4dce-9231-d316d690bea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.224737 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bea3fa-58ed-4dce-9231-d316d690bea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.290751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bea3fa-58ed-4dce-9231-d316d690bea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:18.292400 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bea3fa-58ed-4dce-9231-d316d690bea4 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:18.303302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1284/2571] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:18.407365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:18.585470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:18.815339 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410dec1-c835-47df-bd26-04beba6d71b3 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:18.816922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d410dec1-c835-47df-bd26-04beba6d71b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.881762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410dec1-c835-47df-bd26-04beba6d71b3 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:18.885535 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895296c0-6e6b-49e8-b85a-f827bb793110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:18.886198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895296c0-6e6b-49e8-b85a-f827bb793110 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:18.886456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895296c0-6e6b-49e8-b85a-f827bb793110 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:18.886728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895296c0-6e6b-49e8-b85a-f827bb793110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:18.889620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-895296c0-6e6b-49e8-b85a-f827bb793110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:18.899967 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895296c0-6e6b-49e8-b85a-f827bb793110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:18.901429 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895296c0-6e6b-49e8-b85a-f827bb793110 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:18.910886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1288/2572] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:20.048278 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bea3fa-58ed-4dce-9231-d316d690bea4 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:20.058182 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bea3fa-58ed-4dce-9231-d316d690bea4 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:20.066350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dad2b0-87cc-41cd-a991-cb3facb85242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:20.067650 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad2b0-87cc-41cd-a991-cb3facb85242 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:20.070010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad2b0-87cc-41cd-a991-cb3facb85242 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:20.070010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad2b0-87cc-41cd-a991-cb3facb85242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:20.072580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a1dad2b0-87cc-41cd-a991-cb3facb85242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:20.191045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dad2b0-87cc-41cd-a991-cb3facb85242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:20.192384 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dad2b0-87cc-41cd-a991-cb3facb85242 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:20.217988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1285/2573] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:20.778957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:21.335975 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:23.668736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895296c0-6e6b-49e8-b85a-f827bb793110 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:23.671745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-895296c0-6e6b-49e8-b85a-f827bb793110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:23.775146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895296c0-6e6b-49e8-b85a-f827bb793110 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:23.782324 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:23.784207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:23.785139 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:23.785739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] PATH_INFO: `/v3/users/012cc6666e4d46e992d466b4c47c18ff` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:23.787822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=012cc6666e4d46e992d466b4c47c18ff)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:23.791133 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.120986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '012cc6666e4d46e992d466b4c47c18ff'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.129571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '012cc6666e4d46e992d466b4c47c18ff'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.130581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '012cc6666e4d46e992d466b4c47c18ff'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.347818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '012cc6666e4d46e992d466b4c47c18ff'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.370370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '012cc6666e4d46e992d466b4c47c18ff'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:24.376982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1289/2574] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:23 2022] DELETE /identity/v3/users/012cc6666e4d46e992d466b4c47c18ff => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:24.381669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7298e-5d32-47d3-bc02-a51b880548bd None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.382348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7298e-5d32-47d3-bc02-a51b880548bd None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.382348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7298e-5d32-47d3-bc02-a51b880548bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.402312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9cd7298e-5d32-47d3-bc02-a51b880548bd None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:24.403580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9cd7298e-5d32-47d3-bc02-a51b880548bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:24.468038 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1286/2575] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:24.478129 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:24.479503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:24.546895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380947b-501b-4aca-aa8f-1eda979cefa0 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:24.552894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fc169-2b53-46d5-b6a3-3f2b7824b318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:24.553526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fc169-2b53-46d5-b6a3-3f2b7824b318 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:24.553808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fc169-2b53-46d5-b6a3-3f2b7824b318 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:24.554131 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fc169-2b53-46d5-b6a3-3f2b7824b318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:24.571061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fc169-2b53-46d5-b6a3-3f2b7824b318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:24.571061 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fc169-2b53-46d5-b6a3-3f2b7824b318 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:24.580345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1290/2576] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:25.302191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7298e-5d32-47d3-bc02-a51b880548bd None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.303722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9cd7298e-5d32-47d3-bc02-a51b880548bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:25.317361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7298e-5d32-47d3-bc02-a51b880548bd None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.322839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e7e54-ae82-4849-920f-bf143576acf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.323321 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e7e54-ae82-4849-920f-bf143576acf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.323628 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e7e54-ae82-4849-920f-bf143576acf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.323902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e7e54-ae82-4849-920f-bf143576acf7 admin admin] PATH_INFO: `/v3/users/173e7f4c0b944177b1d6ef7ce7d66c5e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.325094 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e7e54-ae82-4849-920f-bf143576acf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173e7f4c0b944177b1d6ef7ce7d66c5e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.328511 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e7e54-ae82-4849-920f-bf143576acf7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:25.355606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fc169-2b53-46d5-b6a3-3f2b7824b318 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:25.357118 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ed3fc169-2b53-46d5-b6a3-3f2b7824b318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:25.378593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fc169-2b53-46d5-b6a3-3f2b7824b318 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:25.386530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:25.387238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:25.387601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:25.388588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] PATH_INFO: `/v3/projects/8c11717233d743d7b6cdaf2924743f9d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:25.389800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c11717233d743d7b6cdaf2924743f9d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:25.391835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.198032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-110e7e54-ae82-4849-920f-bf143576acf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173e7f4c0b944177b1d6ef7ce7d66c5e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.201211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c11717233d743d7b6cdaf2924743f9d', 'request_id': 'req-a49df0c8-a001-468e-94d1-08b8b88c02c9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.206126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-110e7e54-ae82-4849-920f-bf143576acf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173e7f4c0b944177b1d6ef7ce7d66c5e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.211031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c11717233d743d7b6cdaf2924743f9d', 'request_id': 'req-a49df0c8-a001-468e-94d1-08b8b88c02c9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.212012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-110e7e54-ae82-4849-920f-bf143576acf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173e7f4c0b944177b1d6ef7ce7d66c5e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.441626 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c11717233d743d7b6cdaf2924743f9d', 'request_id': 'req-a49df0c8-a001-468e-94d1-08b8b88c02c9'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.455004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] The token cache is being invalidate because project 8c11717233d743d7b6cdaf2924743f9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:26.455272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.456305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a49df0c8-a001-468e-94d1-08b8b88c02c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.457493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1291/2577] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:25 2022] DELETE /identity/v3/projects/8c11717233d743d7b6cdaf2924743f9d => generated 0 bytes in 1102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:26.465452 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14118152-862b-413d-aff0-e81d0aedd943 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.466259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14118152-862b-413d-aff0-e81d0aedd943 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.466570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14118152-862b-413d-aff0-e81d0aedd943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.489692 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-14118152-862b-413d-aff0-e81d0aedd943 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:26.490947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-14118152-862b-413d-aff0-e81d0aedd943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:26.572879 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-110e7e54-ae82-4849-920f-bf143576acf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173e7f4c0b944177b1d6ef7ce7d66c5e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.573850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-110e7e54-ae82-4849-920f-bf143576acf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173e7f4c0b944177b1d6ef7ce7d66c5e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:26.596690 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1292/2578] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:26.599923 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684ae81-ff0d-4f28-ba71-7651ad442457 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.600404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684ae81-ff0d-4f28-ba71-7651ad442457 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.601026 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9684ae81-ff0d-4f28-ba71-7651ad442457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.613466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1287/2579] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:25 2022] DELETE /identity/v3/users/173e7f4c0b944177b1d6ef7ce7d66c5e => generated 0 bytes in 1303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:26.615115 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d9248-b100-4a81-99b0-4f804e7e207b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.615694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d9248-b100-4a81-99b0-4f804e7e207b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.616866 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d9248-b100-4a81-99b0-4f804e7e207b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.623407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9684ae81-ff0d-4f28-ba71-7651ad442457 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:26.624889 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9684ae81-ff0d-4f28-ba71-7651ad442457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:26.665030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b23d9248-b100-4a81-99b0-4f804e7e207b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:26.666606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b23d9248-b100-4a81-99b0-4f804e7e207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:26.711542 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1293/2580] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:26.720308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684ae81-ff0d-4f28-ba71-7651ad442457 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.731024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9684ae81-ff0d-4f28-ba71-7651ad442457 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.738787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da513e7-dbc3-4b39-9221-adda8f2eaa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.741036 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da513e7-dbc3-4b39-9221-adda8f2eaa88 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.741672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da513e7-dbc3-4b39-9221-adda8f2eaa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.742421 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da513e7-dbc3-4b39-9221-adda8f2eaa88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.743692 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da513e7-dbc3-4b39-9221-adda8f2eaa88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:26.746546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:26.757476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da513e7-dbc3-4b39-9221-adda8f2eaa88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.757476 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da513e7-dbc3-4b39-9221-adda8f2eaa88 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.761830 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1288/2581] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:26.780652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d9248-b100-4a81-99b0-4f804e7e207b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.782155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1294/2582] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:26.785835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b23d9248-b100-4a81-99b0-4f804e7e207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:26.788430 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da513e7-dbc3-4b39-9221-adda8f2eaa88 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:26.804315 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da513e7-dbc3-4b39-9221-adda8f2eaa88 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.811659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59da4e-ce15-43d3-bea5-f2a5a888f9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.813049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59da4e-ce15-43d3-bea5-f2a5a888f9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.813553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59da4e-ce15-43d3-bea5-f2a5a888f9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.814242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59da4e-ce15-43d3-bea5-f2a5a888f9c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.814960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59da4e-ce15-43d3-bea5-f2a5a888f9c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.817348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59da4e-ce15-43d3-bea5-f2a5a888f9c6 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.893388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d9248-b100-4a81-99b0-4f804e7e207b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:26.899167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09509e25-66d9-480d-8a92-42042cc3a246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:26.899924 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509e25-66d9-480d-8a92-42042cc3a246 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:26.900308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509e25-66d9-480d-8a92-42042cc3a246 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:26.900672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09509e25-66d9-480d-8a92-42042cc3a246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:26.912377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09509e25-66d9-480d-8a92-42042cc3a246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:26.913951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09509e25-66d9-480d-8a92-42042cc3a246 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:26.926191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1289/2583] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:26.988598 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1295/2584] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:26 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:26.993669 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09509e25-66d9-480d-8a92-42042cc3a246 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.006264 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09509e25-66d9-480d-8a92-42042cc3a246 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.086419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5313fd-c56d-4e62-8684-33b405d08c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.087155 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5313fd-c56d-4e62-8684-33b405d08c41 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.089003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5313fd-c56d-4e62-8684-33b405d08c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.089316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5313fd-c56d-4e62-8684-33b405d08c41 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.090483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5313fd-c56d-4e62-8684-33b405d08c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.094990 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5313fd-c56d-4e62-8684-33b405d08c41 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.150310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:27.288696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1290/2585] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:26 2022] POST /identity/v3/users => generated 287 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:27.291227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59da4e-ce15-43d3-bea5-f2a5a888f9c6 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.303966 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59da4e-ce15-43d3-bea5-f2a5a888f9c6 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.308969 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f7495-4596-49c0-be9f-8bdfb30e7d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.309644 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f7495-4596-49c0-be9f-8bdfb30e7d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.310616 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f7495-4596-49c0-be9f-8bdfb30e7d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.311088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f7495-4596-49c0-be9f-8bdfb30e7d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.311757 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f7495-4596-49c0-be9f-8bdfb30e7d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.313408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f7495-4596-49c0-be9f-8bdfb30e7d40 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.324029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1296/2586] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:27.328062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5313fd-c56d-4e62-8684-33b405d08c41 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.338302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5313fd-c56d-4e62-8684-33b405d08c41 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.343969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1282e7-7665-4b8b-aad5-146f5ca5a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.344588 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1282e7-7665-4b8b-aad5-146f5ca5a21c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.345012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1282e7-7665-4b8b-aad5-146f5ca5a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.345294 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1282e7-7665-4b8b-aad5-146f5ca5a21c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.345977 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1282e7-7665-4b8b-aad5-146f5ca5a21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.347598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1282e7-7665-4b8b-aad5-146f5ca5a21c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.359175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1291/2587] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:27.363094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f7495-4596-49c0-be9f-8bdfb30e7d40 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.373596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f7495-4596-49c0-be9f-8bdfb30e7d40 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.378458 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6f057-cd4d-429e-9092-a16c9c0395f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.379183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f057-cd4d-429e-9092-a16c9c0395f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.379457 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f057-cd4d-429e-9092-a16c9c0395f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.379989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6f057-cd4d-429e-9092-a16c9c0395f0 admin admin] PATH_INFO: `/v3/projects/a3ac36d10ff3428fb4bd9fac4360214b/users/881054ceadb046d9ad004433b67839d8/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.395710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6f057-cd4d-429e-9092-a16c9c0395f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ac36d10ff3428fb4bd9fac4360214b, user_id=881054ceadb046d9ad004433b67839d8, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.398445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6f057-cd4d-429e-9092-a16c9c0395f0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.550899 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1297/2588] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:27 2022] PUT /identity/v3/projects/a3ac36d10ff3428fb4bd9fac4360214b/users/881054ceadb046d9ad004433b67839d8/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:27.561482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfea4d4-37bf-45ea-815b-89558a46b7d1 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.561767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfea4d4-37bf-45ea-815b-89558a46b7d1 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.562079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfea4d4-37bf-45ea-815b-89558a46b7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.596337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0bfea4d4-37bf-45ea-815b-89558a46b7d1 None None] MFA Rules not processed for user `881054ceadb046d9ad004433b67839d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:27.596337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0bfea4d4-37bf-45ea-815b-89558a46b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:27.599732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6f057-cd4d-429e-9092-a16c9c0395f0 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.603632 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d9d6f057-cd4d-429e-9092-a16c9c0395f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:27.684357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6f057-cd4d-429e-9092-a16c9c0395f0 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.691142 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.692012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.692294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.692567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] PATH_INFO: `/v3/projects/9eb32b8bdfca4ec3a665415d6369c3b6` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.697783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb32b8bdfca4ec3a665415d6369c3b6)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.700786 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1292/2589] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:27.700930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.706833 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfea4d4-37bf-45ea-815b-89558a46b7d1 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:27.708555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0bfea4d4-37bf-45ea-815b-89558a46b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:27.807204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfea4d4-37bf-45ea-815b-89558a46b7d1 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:27.814957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c355b1a-536b-48ca-8214-4cd29efeccfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:27.815756 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c355b1a-536b-48ca-8214-4cd29efeccfa service nova] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:27.816043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c355b1a-536b-48ca-8214-4cd29efeccfa service nova] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:27.816316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c355b1a-536b-48ca-8214-4cd29efeccfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:27.825698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c355b1a-536b-48ca-8214-4cd29efeccfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:27.827335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c355b1a-536b-48ca-8214-4cd29efeccfa service nova] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:27.837968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1293/2590] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:27.863877 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb32b8bdfca4ec3a665415d6369c3b6', 'request_id': 'req-3f6065cb-7235-4dbc-96af-234c4dd242c1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.879073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb32b8bdfca4ec3a665415d6369c3b6', 'request_id': 'req-3f6065cb-7235-4dbc-96af-234c4dd242c1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.980668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb32b8bdfca4ec3a665415d6369c3b6', 'request_id': 'req-3f6065cb-7235-4dbc-96af-234c4dd242c1'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.995115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] The token cache is being invalidate because project 9eb32b8bdfca4ec3a665415d6369c3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:27.995373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.996167 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:27.999909 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1298/2591] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:27 2022] DELETE /identity/v3/projects/9eb32b8bdfca4ec3a665415d6369c3b6 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:28.009713 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c355b1a-536b-48ca-8214-4cd29efeccfa service nova] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:28.031391 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c355b1a-536b-48ca-8214-4cd29efeccfa service nova] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.113270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:28.113811 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:28.145377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17c876-f031-4a62-81f5-f9a7f975657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.146069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c876-f031-4a62-81f5-f9a7f975657f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.146356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c876-f031-4a62-81f5-f9a7f975657f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.146637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c876-f031-4a62-81f5-f9a7f975657f admin admin] PATH_INFO: `/v3/users/8dad71b0736e46deaf50d6d7be028e21` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.147815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17c876-f031-4a62-81f5-f9a7f975657f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dad71b0736e46deaf50d6d7be028e21)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.149814 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17c876-f031-4a62-81f5-f9a7f975657f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.230293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6065cb-7235-4dbc-96af-234c4dd242c1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.239237 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.239890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.240319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.240703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] PATH_INFO: `/v3/users/881054ceadb046d9ad004433b67839d8` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.242523 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=881054ceadb046d9ad004433b67839d8)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.245889 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.375368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6e17c876-f031-4a62-81f5-f9a7f975657f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dad71b0736e46deaf50d6d7be028e21'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.386770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6e17c876-f031-4a62-81f5-f9a7f975657f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dad71b0736e46deaf50d6d7be028e21'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.390457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6e17c876-f031-4a62-81f5-f9a7f975657f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dad71b0736e46deaf50d6d7be028e21'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.485202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6e17c876-f031-4a62-81f5-f9a7f975657f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dad71b0736e46deaf50d6d7be028e21'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.488309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6e17c876-f031-4a62-81f5-f9a7f975657f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dad71b0736e46deaf50d6d7be028e21'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.501531 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881054ceadb046d9ad004433b67839d8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.510149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881054ceadb046d9ad004433b67839d8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.511362 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881054ceadb046d9ad004433b67839d8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.526722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1294/2592] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:28 2022] DELETE /identity/v3/users/8dad71b0736e46deaf50d6d7be028e21 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:28.586560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881054ceadb046d9ad004433b67839d8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.609671 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881054ceadb046d9ad004433b67839d8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:28.617180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1299/2593] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:28 2022] DELETE /identity/v3/users/881054ceadb046d9ad004433b67839d8 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:28.621464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd073-4769-40c6-b1ae-d42d691276c5 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.621760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd073-4769-40c6-b1ae-d42d691276c5 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.622764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dd073-4769-40c6-b1ae-d42d691276c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.647228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-313dd073-4769-40c6-b1ae-d42d691276c5 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:28.648496 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-313dd073-4769-40c6-b1ae-d42d691276c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:28.757705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1295/2594] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:28.769817 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:28.771808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:28.875208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070e559-22ce-401c-add4-6512ac88ee3e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:28.880927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a5f8-31cb-42b5-aae9-5fe43f2e2ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:28.882361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a5f8-31cb-42b5-aae9-5fe43f2e2ffe service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:28.882835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a5f8-31cb-42b5-aae9-5fe43f2e2ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:28.883358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91a5f8-31cb-42b5-aae9-5fe43f2e2ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:28.896382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91a5f8-31cb-42b5-aae9-5fe43f2e2ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:28.897975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91a5f8-31cb-42b5-aae9-5fe43f2e2ffe service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:28.913831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1300/2595] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:28.955486 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:29.150556 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:29.305258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dd073-4769-40c6-b1ae-d42d691276c5 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.307648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-313dd073-4769-40c6-b1ae-d42d691276c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:29.331788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dd073-4769-40c6-b1ae-d42d691276c5 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.358197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:29.359320 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.364292 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.364803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] PATH_INFO: `/v3/projects/12799246f34a421ea096e1772d2c6e30` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.371113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=12799246f34a421ea096e1772d2c6e30)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:29.376352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:29.572463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12799246f34a421ea096e1772d2c6e30', 'request_id': 'req-1297867d-b610-4d60-9c47-d8bec2febb7c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:29.586696 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12799246f34a421ea096e1772d2c6e30', 'request_id': 'req-1297867d-b610-4d60-9c47-d8bec2febb7c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:29.600868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12799246f34a421ea096e1772d2c6e30', 'request_id': 'req-1297867d-b610-4d60-9c47-d8bec2febb7c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:29.684787 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a5f8-31cb-42b5-aae9-5fe43f2e2ffe service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.686652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6c91a5f8-31cb-42b5-aae9-5fe43f2e2ffe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:29.720941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91a5f8-31cb-42b5-aae9-5fe43f2e2ffe service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.747111 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] The token cache is being invalidate because project 12799246f34a421ea096e1772d2c6e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:29.749385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:29.750577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1297867d-b610-4d60-9c47-d8bec2febb7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:29.752363 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1296/2596] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:29 2022] DELETE /identity/v3/projects/12799246f34a421ea096e1772d2c6e30 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:29.768062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb63cf-777c-47cf-8313-13b3d1bdf471 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.769316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb63cf-777c-47cf-8313-13b3d1bdf471 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.769621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb63cf-777c-47cf-8313-13b3d1bdf471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.795693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-f1bb63cf-777c-47cf-8313-13b3d1bdf471 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:29.797463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f1bb63cf-777c-47cf-8313-13b3d1bdf471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:29.836848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:29.840346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.842311 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.842849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] PATH_INFO: `/v3/projects/a3ac36d10ff3428fb4bd9fac4360214b` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.845284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ac36d10ff3428fb4bd9fac4360214b)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:29.851085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:29.917457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1297/2597] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:29.920525 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1d52c-bab8-43e5-b2bc-902d131cc378 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:29.920817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1d52c-bab8-43e5-b2bc-902d131cc378 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:29.921095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1d52c-bab8-43e5-b2bc-902d131cc378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:29.945382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-03e1d52c-bab8-43e5-b2bc-902d131cc378 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:29.946559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-03e1d52c-bab8-43e5-b2bc-902d131cc378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:29.957719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1298/2598] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:29.962692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1d52c-bab8-43e5-b2bc-902d131cc378 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:29.975549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1d52c-bab8-43e5-b2bc-902d131cc378 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:29.988697 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ac36d10ff3428fb4bd9fac4360214b', 'request_id': 'req-0e1b263e-6b39-4ad2-95f7-afe613eee004'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:29.997798 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ac36d10ff3428fb4bd9fac4360214b', 'request_id': 'req-0e1b263e-6b39-4ad2-95f7-afe613eee004'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:30.063036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95208b82-9dbf-416b-94c9-d7960694c7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:30.063676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208b82-9dbf-416b-94c9-d7960694c7ff admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.063959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208b82-9dbf-416b-94c9-d7960694c7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.064230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95208b82-9dbf-416b-94c9-d7960694c7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.064949 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95208b82-9dbf-416b-94c9-d7960694c7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:30.065232 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95208b82-9dbf-416b-94c9-d7960694c7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:30.066921 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95208b82-9dbf-416b-94c9-d7960694c7ff admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:30.085261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1299/2599] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:43:30.086952 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95208b82-9dbf-416b-94c9-d7960694c7ff admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.097717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95208b82-9dbf-416b-94c9-d7960694c7ff admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:30.104209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4872fe-4d26-4d8f-be71-f5f2eef04cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:30.104209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4872fe-4d26-4d8f-be71-f5f2eef04cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.104209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4872fe-4d26-4d8f-be71-f5f2eef04cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.104209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4872fe-4d26-4d8f-be71-f5f2eef04cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.105112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4872fe-4d26-4d8f-be71-f5f2eef04cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:30.106577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4872fe-4d26-4d8f-be71-f5f2eef04cdc admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:30.134688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ac36d10ff3428fb4bd9fac4360214b', 'request_id': 'req-0e1b263e-6b39-4ad2-95f7-afe613eee004'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:30.147580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] The token cache is being invalidate because project a3ac36d10ff3428fb4bd9fac4360214b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:30.147876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:30.148546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0e1b263e-6b39-4ad2-95f7-afe613eee004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:30.150137 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1301/2600] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:29 2022] DELETE /identity/v3/projects/a3ac36d10ff3428fb4bd9fac4360214b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:30.173102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36492af-88a1-46ee-a1af-5d24fddd9909 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.173455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36492af-88a1-46ee-a1af-5d24fddd9909 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.173735 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36492af-88a1-46ee-a1af-5d24fddd9909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.199358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e36492af-88a1-46ee-a1af-5d24fddd9909 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:30.200886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e36492af-88a1-46ee-a1af-5d24fddd9909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:30.211068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1302/2601] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:30.219548 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63158a3a-7100-46c5-b6f4-76f8eba9cd92 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.277463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63158a3a-7100-46c5-b6f4-76f8eba9cd92 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.277463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63158a3a-7100-46c5-b6f4-76f8eba9cd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.277463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-63158a3a-7100-46c5-b6f4-76f8eba9cd92 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:30.277463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-63158a3a-7100-46c5-b6f4-76f8eba9cd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:30.277463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1303/2602] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:30.332357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63158a3a-7100-46c5-b6f4-76f8eba9cd92 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.342396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63158a3a-7100-46c5-b6f4-76f8eba9cd92 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:30.357365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f415b48-6e62-4ddd-8ed0-70741a4fee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:30.357572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f415b48-6e62-4ddd-8ed0-70741a4fee50 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.358050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f415b48-6e62-4ddd-8ed0-70741a4fee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.358358 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f415b48-6e62-4ddd-8ed0-70741a4fee50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.359088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f415b48-6e62-4ddd-8ed0-70741a4fee50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:30.359479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f415b48-6e62-4ddd-8ed0-70741a4fee50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:30.361281 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f415b48-6e62-4ddd-8ed0-70741a4fee50 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:30.393811 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1304/2603] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:30.398073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f415b48-6e62-4ddd-8ed0-70741a4fee50 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.409002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f415b48-6e62-4ddd-8ed0-70741a4fee50 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:30.413931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb68ba9-35bf-420e-a693-1c0e5af0386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:30.414581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb68ba9-35bf-420e-a693-1c0e5af0386d admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.414829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb68ba9-35bf-420e-a693-1c0e5af0386d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.415104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb68ba9-35bf-420e-a693-1c0e5af0386d admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.415818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb68ba9-35bf-420e-a693-1c0e5af0386d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:30.426954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb68ba9-35bf-420e-a693-1c0e5af0386d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:30.559087 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1300/2604] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:30 2022] POST /identity/v3/projects => generated 385 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:30.564469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4872fe-4d26-4d8f-be71-f5f2eef04cdc admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.566199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cb4872fe-4d26-4d8f-be71-f5f2eef04cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:30.632864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4872fe-4d26-4d8f-be71-f5f2eef04cdc admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:30.637584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f84e2-5beb-420a-9def-53966bfe75f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:30.638850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f84e2-5beb-420a-9def-53966bfe75f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:30.639137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f84e2-5beb-420a-9def-53966bfe75f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:30.639414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f84e2-5beb-420a-9def-53966bfe75f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:30.640067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f84e2-5beb-420a-9def-53966bfe75f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:30.642070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f84e2-5beb-420a-9def-53966bfe75f8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:30.936701 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1305/2605] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:30 2022] POST /identity/v3/projects => generated 387 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:30.941020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb68ba9-35bf-420e-a693-1c0e5af0386d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:30.969159 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1301/2606] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:30 2022] POST /identity/v3/users => generated 293 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:30.977680 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f84e2-5beb-420a-9def-53966bfe75f8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.003865 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f84e2-5beb-420a-9def-53966bfe75f8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.100533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb68ba9-35bf-420e-a693-1c0e5af0386d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.107511 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38037a8-a891-4999-ae02-8311a76e637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.108777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38037a8-a891-4999-ae02-8311a76e637c admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.109136 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38037a8-a891-4999-ae02-8311a76e637c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.109485 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38037a8-a891-4999-ae02-8311a76e637c admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.110314 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdda0c4-5045-4bb1-b1c7-ba44aad7b4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.110483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38037a8-a891-4999-ae02-8311a76e637c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.111365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda0c4-5045-4bb1-b1c7-ba44aad7b4aa admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.111831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda0c4-5045-4bb1-b1c7-ba44aad7b4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.112255 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda0c4-5045-4bb1-b1c7-ba44aad7b4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.113388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdda0c4-5045-4bb1-b1c7-ba44aad7b4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.113908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38037a8-a891-4999-ae02-8311a76e637c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.116118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdda0c4-5045-4bb1-b1c7-ba44aad7b4aa admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.138493 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1302/2607] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:31.140262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdda0c4-5045-4bb1-b1c7-ba44aad7b4aa admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.152150 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdda0c4-5045-4bb1-b1c7-ba44aad7b4aa admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.159172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1791c3d-0113-41c4-a79b-1d545966c09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.159802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1791c3d-0113-41c4-a79b-1d545966c09c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.160093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1791c3d-0113-41c4-a79b-1d545966c09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.160401 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1791c3d-0113-41c4-a79b-1d545966c09c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.163067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1791c3d-0113-41c4-a79b-1d545966c09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.163067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1791c3d-0113-41c4-a79b-1d545966c09c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.175053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1303/2608] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:31.179444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1791c3d-0113-41c4-a79b-1d545966c09c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.191441 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1791c3d-0113-41c4-a79b-1d545966c09c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.196667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c6427-b4f7-4a30-a73a-f71f217bb3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.197333 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6427-b4f7-4a30-a73a-f71f217bb3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.197614 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6427-b4f7-4a30-a73a-f71f217bb3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.197921 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6427-b4f7-4a30-a73a-f71f217bb3f2 admin admin] PATH_INFO: `/v3/projects/b6644cadabfd441eaf79b3aa3781f588/users/27a48ca885604e4f8503b07dec7064ba/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.214855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c6427-b4f7-4a30-a73a-f71f217bb3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6644cadabfd441eaf79b3aa3781f588, user_id=27a48ca885604e4f8503b07dec7064ba, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.217580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c6427-b4f7-4a30-a73a-f71f217bb3f2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.289933 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1306/2609] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:30 2022] POST /identity/v3/users => generated 294 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:31.294427 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38037a8-a891-4999-ae02-8311a76e637c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.304847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38037a8-a891-4999-ae02-8311a76e637c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.311611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab780ec4-feb4-4d7f-a1ed-068a87c1a9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.311611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab780ec4-feb4-4d7f-a1ed-068a87c1a9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.311611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab780ec4-feb4-4d7f-a1ed-068a87c1a9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.311611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab780ec4-feb4-4d7f-a1ed-068a87c1a9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.312081 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab780ec4-feb4-4d7f-a1ed-068a87c1a9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.313198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab780ec4-feb4-4d7f-a1ed-068a87c1a9a1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.323789 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1307/2610] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:31.328766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab780ec4-feb4-4d7f-a1ed-068a87c1a9a1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.340514 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1304/2611] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:31 2022] PUT /identity/v3/projects/b6644cadabfd441eaf79b3aa3781f588/users/27a48ca885604e4f8503b07dec7064ba/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:31.344121 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab780ec4-feb4-4d7f-a1ed-068a87c1a9a1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.351521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd31a-0bc9-4c87-9bbb-4d679ecc0ac7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.351773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd31a-0bc9-4c87-9bbb-4d679ecc0ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.352008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd31a-0bc9-4c87-9bbb-4d679ecc0ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.382349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-acccd31a-0bc9-4c87-9bbb-4d679ecc0ac7 None None] MFA Rules not processed for user `27a48ca885604e4f8503b07dec7064ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:31.383662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-acccd31a-0bc9-4c87-9bbb-4d679ecc0ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:31.413522 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75af7a-3cbb-4ecb-822a-c418aab08291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.414168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75af7a-3cbb-4ecb-822a-c418aab08291 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.414446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75af7a-3cbb-4ecb-822a-c418aab08291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.414803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75af7a-3cbb-4ecb-822a-c418aab08291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.415365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75af7a-3cbb-4ecb-822a-c418aab08291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.417025 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75af7a-3cbb-4ecb-822a-c418aab08291 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.428921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1308/2612] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:31.433335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75af7a-3cbb-4ecb-822a-c418aab08291 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.443572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75af7a-3cbb-4ecb-822a-c418aab08291 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.456342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7066b-0390-4341-ad77-a1ae66e3f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.457180 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7066b-0390-4341-ad77-a1ae66e3f02c admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.457463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7066b-0390-4341-ad77-a1ae66e3f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.457743 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7066b-0390-4341-ad77-a1ae66e3f02c admin admin] PATH_INFO: `/v3/projects/53c49209bd924a8c9585b7a364b8728b/users/19ef8cc062bc43a88465c8cfa8a72c06/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.459540 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1305/2613] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:31.464557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccd31a-0bc9-4c87-9bbb-4d679ecc0ac7 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.475645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7066b-0390-4341-ad77-a1ae66e3f02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c49209bd924a8c9585b7a364b8728b, user_id=19ef8cc062bc43a88465c8cfa8a72c06, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.476486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccd31a-0bc9-4c87-9bbb-4d679ecc0ac7 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.478419 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7066b-0390-4341-ad77-a1ae66e3f02c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.481821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946a6ba-6c64-4462-8b01-8f728ad3fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.482602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a6ba-6c64-4462-8b01-8f728ad3fad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.486752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a6ba-6c64-4462-8b01-8f728ad3fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.486752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946a6ba-6c64-4462-8b01-8f728ad3fad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.486752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946a6ba-6c64-4462-8b01-8f728ad3fad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.486752 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946a6ba-6c64-4462-8b01-8f728ad3fad6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.640009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1309/2614] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:31 2022] PUT /identity/v3/projects/53c49209bd924a8c9585b7a364b8728b/users/19ef8cc062bc43a88465c8cfa8a72c06/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:31.640405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1306/2615] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:31 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:31.646977 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7066b-0390-4341-ad77-a1ae66e3f02c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.652399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2814b83-0db4-4a88-8ef5-ee0f894f2050 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.652686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2814b83-0db4-4a88-8ef5-ee0f894f2050 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.652987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2814b83-0db4-4a88-8ef5-ee0f894f2050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.667235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:31.683019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e2814b83-0db4-4a88-8ef5-ee0f894f2050 None None] MFA Rules not processed for user `19ef8cc062bc43a88465c8cfa8a72c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:31.684291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e2814b83-0db4-4a88-8ef5-ee0f894f2050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:31.716803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7066b-0390-4341-ad77-a1ae66e3f02c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.761489 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1307/2616] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:31.766794 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2814b83-0db4-4a88-8ef5-ee0f894f2050 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.780976 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971059f6-e51b-48de-8850-08bb729c7017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.781603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971059f6-e51b-48de-8850-08bb729c7017 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.781901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971059f6-e51b-48de-8850-08bb729c7017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.782183 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971059f6-e51b-48de-8850-08bb729c7017 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.782830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971059f6-e51b-48de-8850-08bb729c7017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.784766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971059f6-e51b-48de-8850-08bb729c7017 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.845679 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2814b83-0db4-4a88-8ef5-ee0f894f2050 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.850376 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869e3d9-c2d2-4cdb-a62e-73830dbb344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.850992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869e3d9-c2d2-4cdb-a62e-73830dbb344b admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.851275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869e3d9-c2d2-4cdb-a62e-73830dbb344b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.851545 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869e3d9-c2d2-4cdb-a62e-73830dbb344b admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.852176 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869e3d9-c2d2-4cdb-a62e-73830dbb344b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.854112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869e3d9-c2d2-4cdb-a62e-73830dbb344b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.907529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1310/2617] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:31 2022] POST /identity/v3/users => generated 299 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:31.911234 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971059f6-e51b-48de-8850-08bb729c7017 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.922878 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971059f6-e51b-48de-8850-08bb729c7017 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.927683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a05eb-e778-4581-8c42-1b322426c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.928302 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a05eb-e778-4581-8c42-1b322426c220 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.928581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a05eb-e778-4581-8c42-1b322426c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.928847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a05eb-e778-4581-8c42-1b322426c220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.929488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a05eb-e778-4581-8c42-1b322426c220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.931426 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a05eb-e778-4581-8c42-1b322426c220 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.942752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1311/2618] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:31.947010 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a05eb-e778-4581-8c42-1b322426c220 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:31.957570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a05eb-e778-4581-8c42-1b322426c220 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:31.962583 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5956d-404a-47fd-9fab-299efcf224ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:31.963254 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5956d-404a-47fd-9fab-299efcf224ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:31.963536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5956d-404a-47fd-9fab-299efcf224ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:31.963811 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5956d-404a-47fd-9fab-299efcf224ab admin admin] PATH_INFO: `/v3/projects/ec7be31d93814a948d31bba2b54f1373/users/90c37ebaedd64e9d9b53b279819d9b42/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:31.982182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5956d-404a-47fd-9fab-299efcf224ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7be31d93814a948d31bba2b54f1373, user_id=90c37ebaedd64e9d9b53b279819d9b42, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:31.985179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5956d-404a-47fd-9fab-299efcf224ab admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:31.986324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:31.989553 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1308/2619] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:31 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:31.993603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869e3d9-c2d2-4cdb-a62e-73830dbb344b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.062043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869e3d9-c2d2-4cdb-a62e-73830dbb344b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.067838 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c074be-d226-4086-aac6-f92a36bde6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.068021 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c074be-d226-4086-aac6-f92a36bde6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.068388 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c074be-d226-4086-aac6-f92a36bde6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.068548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c074be-d226-4086-aac6-f92a36bde6d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.069263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c074be-d226-4086-aac6-f92a36bde6d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.071212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c074be-d226-4086-aac6-f92a36bde6d3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.090018 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1312/2620] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:31 2022] PUT /identity/v3/projects/ec7be31d93814a948d31bba2b54f1373/users/90c37ebaedd64e9d9b53b279819d9b42/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:32.092349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5956d-404a-47fd-9fab-299efcf224ab admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.177605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5956d-404a-47fd-9fab-299efcf224ab admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.188673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1309/2621] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:31 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:32.188673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c074be-d226-4086-aac6-f92a36bde6d3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.189025 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-83c074be-d226-4086-aac6-f92a36bde6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.192075 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09a962-9f55-4018-82b5-d7a7ef7142ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.193158 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a962-9f55-4018-82b5-d7a7ef7142ef admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.193619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a962-9f55-4018-82b5-d7a7ef7142ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.194113 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a962-9f55-4018-82b5-d7a7ef7142ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.195198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09a962-9f55-4018-82b5-d7a7ef7142ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.198219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09a962-9f55-4018-82b5-d7a7ef7142ef admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.207880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c074be-d226-4086-aac6-f92a36bde6d3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.212406 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1313/2622] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:32.213277 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09a962-9f55-4018-82b5-d7a7ef7142ef admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.213684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.214389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.214742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.215397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] PATH_INFO: `/v3/users/e28f1235bdf2421c9be0f08028256aec` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.217863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28f1235bdf2421c9be0f08028256aec)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.219999 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.225155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09a962-9f55-4018-82b5-d7a7ef7142ef admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.230286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586b759-b30b-40f2-b6ce-d0ec386b26cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.231182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586b759-b30b-40f2-b6ce-d0ec386b26cd admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.231625 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586b759-b30b-40f2-b6ce-d0ec386b26cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.231955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586b759-b30b-40f2-b6ce-d0ec386b26cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.232751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586b759-b30b-40f2-b6ce-d0ec386b26cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.234397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586b759-b30b-40f2-b6ce-d0ec386b26cd admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.247843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1314/2623] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:32.247843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586b759-b30b-40f2-b6ce-d0ec386b26cd admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.258996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586b759-b30b-40f2-b6ce-d0ec386b26cd admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.267552 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff527f2-1cf6-44e3-bf78-0db2ce75bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.268243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff527f2-1cf6-44e3-bf78-0db2ce75bb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.268519 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff527f2-1cf6-44e3-bf78-0db2ce75bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.268794 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff527f2-1cf6-44e3-bf78-0db2ce75bb04 admin admin] PATH_INFO: `/v3/projects/ec7be31d93814a948d31bba2b54f1373/users/90c37ebaedd64e9d9b53b279819d9b42/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.270980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff527f2-1cf6-44e3-bf78-0db2ce75bb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7be31d93814a948d31bba2b54f1373, user_id=90c37ebaedd64e9d9b53b279819d9b42, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.274079 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff527f2-1cf6-44e3-bf78-0db2ce75bb04 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.288553 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1315/2624] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:32 2022] PUT /identity/v3/projects/ec7be31d93814a948d31bba2b54f1373/users/90c37ebaedd64e9d9b53b279819d9b42/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:32.299120 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff527f2-1cf6-44e3-bf78-0db2ce75bb04 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.363442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff527f2-1cf6-44e3-bf78-0db2ce75bb04 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.368409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59174a-c0f7-4b2b-b9b1-911e7057d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.370088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59174a-c0f7-4b2b-b9b1-911e7057d49f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.370088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59174a-c0f7-4b2b-b9b1-911e7057d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.370088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59174a-c0f7-4b2b-b9b1-911e7057d49f admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.370694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59174a-c0f7-4b2b-b9b1-911e7057d49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.371814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59174a-c0f7-4b2b-b9b1-911e7057d49f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.384157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1316/2625] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:32.385586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9560f-14ec-424e-9f5f-ead0d5e7a40d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.385897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9560f-14ec-424e-9f5f-ead0d5e7a40d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.386167 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9560f-14ec-424e-9f5f-ead0d5e7a40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.417705 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-35c9560f-14ec-424e-9f5f-ead0d5e7a40d None None] MFA Rules not processed for user `90c37ebaedd64e9d9b53b279819d9b42`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:32.419007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-35c9560f-14ec-424e-9f5f-ead0d5e7a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.442308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28f1235bdf2421c9be0f08028256aec'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.449804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28f1235bdf2421c9be0f08028256aec'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.452416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28f1235bdf2421c9be0f08028256aec'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.502870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1317/2626] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:32.503921 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9560f-14ec-424e-9f5f-ead0d5e7a40d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.525160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9560f-14ec-424e-9f5f-ead0d5e7a40d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.531971 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef0012-e5ea-485f-b361-bf09c244080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.532649 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef0012-e5ea-485f-b361-bf09c244080a admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.532926 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef0012-e5ea-485f-b361-bf09c244080a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.533198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef0012-e5ea-485f-b361-bf09c244080a admin admin] PATH_INFO: `/v3/projects/5185625642d94e5385f60389dcd88d6f/users/9fdaeae3345c4c8cacd26efe842b44ec/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.534699 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28f1235bdf2421c9be0f08028256aec'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.535646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28f1235bdf2421c9be0f08028256aec'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:32.552635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef0012-e5ea-485f-b361-bf09c244080a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5185625642d94e5385f60389dcd88d6f, user_id=9fdaeae3345c4c8cacd26efe842b44ec, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.555573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef0012-e5ea-485f-b361-bf09c244080a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.557170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1310/2627] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:32 2022] DELETE /identity/v3/users/e28f1235bdf2421c9be0f08028256aec => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:32.557897 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.559888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.630947 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c856fd3-7437-4713-9525-e57a78c4dab6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.639102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1318/2628] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:32 2022] PUT /identity/v3/projects/5185625642d94e5385f60389dcd88d6f/users/9fdaeae3345c4c8cacd26efe842b44ec/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:32.641640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d6d61-60d9-4af0-a73f-a8898182bd91 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.641640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d6d61-60d9-4af0-a73f-a8898182bd91 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.641640 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d6d61-60d9-4af0-a73f-a8898182bd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.668663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-f19d6d61-60d9-4af0-a73f-a8898182bd91 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:32.670459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-f19d6d61-60d9-4af0-a73f-a8898182bd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.700620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e382503-73ae-44fe-9f3b-ea373c06a441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.701246 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e382503-73ae-44fe-9f3b-ea373c06a441 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.701601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e382503-73ae-44fe-9f3b-ea373c06a441 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.701804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e382503-73ae-44fe-9f3b-ea373c06a441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.703721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8e382503-73ae-44fe-9f3b-ea373c06a441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.746374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1319/2629] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:32.748768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510aaba-121c-4eab-b7d9-ae63355b3d96 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.749236 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510aaba-121c-4eab-b7d9-ae63355b3d96 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.749615 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b510aaba-121c-4eab-b7d9-ae63355b3d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.776490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e382503-73ae-44fe-9f3b-ea373c06a441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.777984 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e382503-73ae-44fe-9f3b-ea373c06a441 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.781715 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b510aaba-121c-4eab-b7d9-ae63355b3d96 None None] MFA Rules not processed for user `9fdaeae3345c4c8cacd26efe842b44ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:32.782979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b510aaba-121c-4eab-b7d9-ae63355b3d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.788650 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1311/2630] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:32.791647 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e382503-73ae-44fe-9f3b-ea373c06a441 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.792976 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-8e382503-73ae-44fe-9f3b-ea373c06a441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.855781 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e382503-73ae-44fe-9f3b-ea373c06a441 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.860194 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3595fea-2842-42cb-a442-1c66acfa28ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.860854 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3595fea-2842-42cb-a442-1c66acfa28ba service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.861310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3595fea-2842-42cb-a442-1c66acfa28ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.861595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3595fea-2842-42cb-a442-1c66acfa28ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.866663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1320/2631] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:32.870922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510aaba-121c-4eab-b7d9-ae63355b3d96 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:32.873005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b510aaba-121c-4eab-b7d9-ae63355b3d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:32.886035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3595fea-2842-42cb-a442-1c66acfa28ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.886035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3595fea-2842-42cb-a442-1c66acfa28ba service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:32.889933 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1312/2632] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:32.895577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b510aaba-121c-4eab-b7d9-ae63355b3d96 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:32.902483 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df01cc-6b5b-46ab-a689-c5813bdd0b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:32.904341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df01cc-6b5b-46ab-a689-c5813bdd0b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:32.904754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df01cc-6b5b-46ab-a689-c5813bdd0b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:32.905186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df01cc-6b5b-46ab-a689-c5813bdd0b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:32.906163 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df01cc-6b5b-46ab-a689-c5813bdd0b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:32.908937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df01cc-6b5b-46ab-a689-c5813bdd0b33 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.008911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1321/2633] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:32 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:33.014017 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3595fea-2842-42cb-a442-1c66acfa28ba service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.024172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3595fea-2842-42cb-a442-1c66acfa28ba service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.093670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80600-33b1-4628-b040-ab162321dc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.094338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80600-33b1-4628-b040-ab162321dc91 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.094722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80600-33b1-4628-b040-ab162321dc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.095135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f80600-33b1-4628-b040-ab162321dc91 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.095630 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f80600-33b1-4628-b040-ab162321dc91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.102836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f80600-33b1-4628-b040-ab162321dc91 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.208978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1313/2634] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:33 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:33.213204 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df01cc-6b5b-46ab-a689-c5813bdd0b33 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.224630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df01cc-6b5b-46ab-a689-c5813bdd0b33 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.229703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae01b5-fbfd-4ad0-b326-63aa6c04062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.230432 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae01b5-fbfd-4ad0-b326-63aa6c04062a admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.230870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae01b5-fbfd-4ad0-b326-63aa6c04062a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.231157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae01b5-fbfd-4ad0-b326-63aa6c04062a admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.232106 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae01b5-fbfd-4ad0-b326-63aa6c04062a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.233908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae01b5-fbfd-4ad0-b326-63aa6c04062a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.249568 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1322/2635] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:33.249979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:33.252072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80600-33b1-4628-b040-ab162321dc91 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.263666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f80600-33b1-4628-b040-ab162321dc91 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.270100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a1349-ee06-4b67-bc48-0c9d0e3904cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.270783 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a1349-ee06-4b67-bc48-0c9d0e3904cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.271060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a1349-ee06-4b67-bc48-0c9d0e3904cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.271740 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a1349-ee06-4b67-bc48-0c9d0e3904cf admin admin] PATH_INFO: `/v3/projects/0a6c5c6f2ffc480286a3c30ce81b5062/users/bf42d45856f5487f850f85468d1e5fa6/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.292826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a1349-ee06-4b67-bc48-0c9d0e3904cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6c5c6f2ffc480286a3c30ce81b5062, user_id=bf42d45856f5487f850f85468d1e5fa6, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.296142 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a1349-ee06-4b67-bc48-0c9d0e3904cf admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.369416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1314/2636] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:33 2022] PUT /identity/v3/projects/0a6c5c6f2ffc480286a3c30ce81b5062/users/bf42d45856f5487f850f85468d1e5fa6/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:33.376194 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae01b5-fbfd-4ad0-b326-63aa6c04062a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.387396 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae01b5-fbfd-4ad0-b326-63aa6c04062a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.449243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c49fa0-aaa1-49cd-8010-9b9f30e6f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.449868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49fa0-aaa1-49cd-8010-9b9f30e6f85f admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.450345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49fa0-aaa1-49cd-8010-9b9f30e6f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.450514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49fa0-aaa1-49cd-8010-9b9f30e6f85f admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.451165 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c49fa0-aaa1-49cd-8010-9b9f30e6f85f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.452797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c49fa0-aaa1-49cd-8010-9b9f30e6f85f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.463612 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1323/2637] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:33.468027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a1349-ee06-4b67-bc48-0c9d0e3904cf admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.478530 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a1349-ee06-4b67-bc48-0c9d0e3904cf admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.485402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d69dad-86d5-4658-a457-f090f69930cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.486195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d69dad-86d5-4658-a457-f090f69930cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.486589 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d69dad-86d5-4658-a457-f090f69930cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.486931 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d69dad-86d5-4658-a457-f090f69930cd admin admin] PATH_INFO: `/v3/projects/0a6c5c6f2ffc480286a3c30ce81b5062/users/bf42d45856f5487f850f85468d1e5fa6/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.492189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d69dad-86d5-4658-a457-f090f69930cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6c5c6f2ffc480286a3c30ce81b5062, user_id=bf42d45856f5487f850f85468d1e5fa6, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.495863 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d69dad-86d5-4658-a457-f090f69930cd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.506785 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c49fa0-aaa1-49cd-8010-9b9f30e6f85f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.509504 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-10c49fa0-aaa1-49cd-8010-9b9f30e6f85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:33.527948 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1315/2638] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:33 2022] PUT /identity/v3/projects/0a6c5c6f2ffc480286a3c30ce81b5062/users/bf42d45856f5487f850f85468d1e5fa6/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:33.533379 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c49fa0-aaa1-49cd-8010-9b9f30e6f85f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.533584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89384aa-ebf6-4791-9b58-d10afcf13138 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.533584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89384aa-ebf6-4791-9b58-d10afcf13138 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.533584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89384aa-ebf6-4791-9b58-d10afcf13138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.574263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c89384aa-ebf6-4791-9b58-d10afcf13138 None None] MFA Rules not processed for user `bf42d45856f5487f850f85468d1e5fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:33.575980 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c89384aa-ebf6-4791-9b58-d10afcf13138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:33.598899 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.599547 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.599824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.600096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] PATH_INFO: `/v3/projects/9c471eca857d4896b50067569974914d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.601257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c471eca857d4896b50067569974914d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.603213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.650521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1316/2639] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:33.662751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89384aa-ebf6-4791-9b58-d10afcf13138 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:33.722883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89384aa-ebf6-4791-9b58-d10afcf13138 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:33.727067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1609cdd-f8b5-4152-8f57-17a63603db28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:33.739199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1609cdd-f8b5-4152-8f57-17a63603db28 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:33.739199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1609cdd-f8b5-4152-8f57-17a63603db28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:33.739593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:33.739704 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1609cdd-f8b5-4152-8f57-17a63603db28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:33.740665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1609cdd-f8b5-4152-8f57-17a63603db28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:33.742142 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1609cdd-f8b5-4152-8f57-17a63603db28 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:33.753771 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1317/2640] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:33.766435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c471eca857d4896b50067569974914d', 'request_id': 'req-c939aef9-7f61-4021-8682-5bbe4d98ed5b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:33.777711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c471eca857d4896b50067569974914d', 'request_id': 'req-c939aef9-7f61-4021-8682-5bbe4d98ed5b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:33.838032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c471eca857d4896b50067569974914d', 'request_id': 'req-c939aef9-7f61-4021-8682-5bbe4d98ed5b'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:33.862241 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] The token cache is being invalidate because project 9c471eca857d4896b50067569974914d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:33.862498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:33.863186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c939aef9-7f61-4021-8682-5bbe4d98ed5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:33.864830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1324/2641] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:33 2022] DELETE /identity/v3/projects/9c471eca857d4896b50067569974914d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:34.310780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1609cdd-f8b5-4152-8f57-17a63603db28 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:34.312462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d1609cdd-f8b5-4152-8f57-17a63603db28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:34.330072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1609cdd-f8b5-4152-8f57-17a63603db28 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:34.394927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:34.395596 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.395883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.396160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] PATH_INFO: `/v3/users/27a48ca885604e4f8503b07dec7064ba` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.397360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a48ca885604e4f8503b07dec7064ba)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:34.399432 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:34.759521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a48ca885604e4f8503b07dec7064ba'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:34.767008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a48ca885604e4f8503b07dec7064ba'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:34.767708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a48ca885604e4f8503b07dec7064ba'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:34.865563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a48ca885604e4f8503b07dec7064ba'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:34.866204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a48ca885604e4f8503b07dec7064ba'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:34.889205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1318/2642] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:34 2022] DELETE /identity/v3/users/27a48ca885604e4f8503b07dec7064ba => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:34.897267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2797f4-27c3-4815-a1a9-e798894aec3c None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:34.897871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2797f4-27c3-4815-a1a9-e798894aec3c None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:34.897871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2797f4-27c3-4815-a1a9-e798894aec3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:34.961085 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:34.962612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:34.964127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-bd2797f4-27c3-4815-a1a9-e798894aec3c None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:34.965328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bd2797f4-27c3-4815-a1a9-e798894aec3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:35.044926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048b8da-79f9-4cda-92af-ab3189ebb4b2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:35.049946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eae043-ab49-4adf-9feb-9694d2a8d493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:35.050609 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eae043-ab49-4adf-9feb-9694d2a8d493 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:35.050888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eae043-ab49-4adf-9feb-9694d2a8d493 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:35.051160 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eae043-ab49-4adf-9feb-9694d2a8d493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:35.053057 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-30eae043-ab49-4adf-9feb-9694d2a8d493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:35.074054 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1325/2643] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:35.085325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2797f4-27c3-4815-a1a9-e798894aec3c None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:35.086837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bd2797f4-27c3-4815-a1a9-e798894aec3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:35.130167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eae043-ab49-4adf-9feb-9694d2a8d493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:35.131900 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eae043-ab49-4adf-9feb-9694d2a8d493 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:35.142677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1319/2644] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:35.179221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2797f4-27c3-4815-a1a9-e798894aec3c None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:35.183559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684ff2a-567e-4421-aade-21c33e8815d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:35.184177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684ff2a-567e-4421-aade-21c33e8815d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:35.185002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684ff2a-567e-4421-aade-21c33e8815d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:35.185287 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684ff2a-567e-4421-aade-21c33e8815d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:35.196000 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684ff2a-567e-4421-aade-21c33e8815d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:35.197443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684ff2a-567e-4421-aade-21c33e8815d6 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:35.209203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1326/2645] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:35.608501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:35.835820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eae043-ab49-4adf-9feb-9694d2a8d493 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:35.843761 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-30eae043-ab49-4adf-9feb-9694d2a8d493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:35.858652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eae043-ab49-4adf-9feb-9694d2a8d493 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:35.871460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:35.872041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:35.872387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:35.872939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] PATH_INFO: `/v3/projects/b6644cadabfd441eaf79b3aa3781f588` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:35.875069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6644cadabfd441eaf79b3aa3781f588)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:35.877196 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:36.081121 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:36.113111 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6644cadabfd441eaf79b3aa3781f588', 'request_id': 'req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.131499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6644cadabfd441eaf79b3aa3781f588', 'request_id': 'req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.144095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6644cadabfd441eaf79b3aa3781f588', 'request_id': 'req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.264926 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] The token cache is being invalidate because project b6644cadabfd441eaf79b3aa3781f588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:36.265527 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.266565 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.269739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1320/2646] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:35 2022] DELETE /identity/v3/projects/b6644cadabfd441eaf79b3aa3781f588 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:36.274793 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684ff2a-567e-4421-aade-21c33e8815d6 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:36.290436 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684ff2a-567e-4421-aade-21c33e8815d6 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:36.369683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee481d-4568-4446-8052-c9ceb5ac3a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:36.369683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee481d-4568-4446-8052-c9ceb5ac3a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:36.369683 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee481d-4568-4446-8052-c9ceb5ac3a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:36.371334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee481d-4568-4446-8052-c9ceb5ac3a08 admin admin] PATH_INFO: `/v3/users/90c37ebaedd64e9d9b53b279819d9b42` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:36.371334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee481d-4568-4446-8052-c9ceb5ac3a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c37ebaedd64e9d9b53b279819d9b42)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:36.373854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee481d-4568-4446-8052-c9ceb5ac3a08 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:36.595088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-97ee481d-4568-4446-8052-c9ceb5ac3a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c37ebaedd64e9d9b53b279819d9b42'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.603836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-97ee481d-4568-4446-8052-c9ceb5ac3a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c37ebaedd64e9d9b53b279819d9b42'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.609584 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-97ee481d-4568-4446-8052-c9ceb5ac3a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c37ebaedd64e9d9b53b279819d9b42'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.700469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-97ee481d-4568-4446-8052-c9ceb5ac3a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c37ebaedd64e9d9b53b279819d9b42'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.721759 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-97ee481d-4568-4446-8052-c9ceb5ac3a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c37ebaedd64e9d9b53b279819d9b42'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:36.729115 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1327/2647] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:36 2022] DELETE /identity/v3/users/90c37ebaedd64e9d9b53b279819d9b42 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:37.381026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:37.386127 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:37.416331 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd3ba6d-4c53-4fac-af94-590ee27aa8d3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:37.534096 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:37.549368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:37.555266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:37.555266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] PATH_INFO: `/v3/projects/ec7be31d93814a948d31bba2b54f1373` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:37.555266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec7be31d93814a948d31bba2b54f1373)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:37.556934 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:37.771452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec7be31d93814a948d31bba2b54f1373', 'request_id': 'req-de3222a0-09f3-4460-a3da-c45a1dee9000'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.783107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec7be31d93814a948d31bba2b54f1373', 'request_id': 'req-de3222a0-09f3-4460-a3da-c45a1dee9000'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.790191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec7be31d93814a948d31bba2b54f1373', 'request_id': 'req-de3222a0-09f3-4460-a3da-c45a1dee9000'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.915115 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] The token cache is being invalidate because project ec7be31d93814a948d31bba2b54f1373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:37.915409 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.916067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-de3222a0-09f3-4460-a3da-c45a1dee9000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:37.923889 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7b88-9647-4312-b610-087527aec611 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:37.924423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7b88-9647-4312-b610-087527aec611 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:37.924423 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7b88-9647-4312-b610-087527aec611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:37.925985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1321/2648] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:37 2022] DELETE /identity/v3/projects/ec7be31d93814a948d31bba2b54f1373 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:37.979573 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9c0a7b88-9647-4312-b610-087527aec611 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:37.980686 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9c0a7b88-9647-4312-b610-087527aec611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:38.061299 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1328/2649] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:38.069559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275104-0f45-479d-9c36-1748c56cfa70 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.070370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275104-0f45-479d-9c36-1748c56cfa70 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.070755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28275104-0f45-479d-9c36-1748c56cfa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.094211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-28275104-0f45-479d-9c36-1748c56cfa70 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:38.095446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-28275104-0f45-479d-9c36-1748c56cfa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:38.113761 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1322/2650] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:38.118460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a7b88-9647-4312-b610-087527aec611 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.138056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a7b88-9647-4312-b610-087527aec611 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.145169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7333483-fb08-4dc2-849b-d468489e7ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.145896 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7333483-fb08-4dc2-849b-d468489e7ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.146270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7333483-fb08-4dc2-849b-d468489e7ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.146630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7333483-fb08-4dc2-849b-d468489e7ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.147366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7333483-fb08-4dc2-849b-d468489e7ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:38.147746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7333483-fb08-4dc2-849b-d468489e7ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.149399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7333483-fb08-4dc2-849b-d468489e7ec3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.164982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1329/2651] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:38.169172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275104-0f45-479d-9c36-1748c56cfa70 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.179452 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28275104-0f45-479d-9c36-1748c56cfa70 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.184670 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ccca1-e6b6-4a2c-9c93-251aa8123b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.185299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ccca1-e6b6-4a2c-9c93-251aa8123b29 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.186132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ccca1-e6b6-4a2c-9c93-251aa8123b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.186132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ccca1-e6b6-4a2c-9c93-251aa8123b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.189264 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ccca1-e6b6-4a2c-9c93-251aa8123b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.189264 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ccca1-e6b6-4a2c-9c93-251aa8123b29 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.313867 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1323/2652] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:38 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:38.318051 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7333483-fb08-4dc2-849b-d468489e7ec3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.347858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7333483-fb08-4dc2-849b-d468489e7ec3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.435675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0af7-8b1c-438a-a19c-f56132ba73e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.436336 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0af7-8b1c-438a-a19c-f56132ba73e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.436617 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0af7-8b1c-438a-a19c-f56132ba73e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.439101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0af7-8b1c-438a-a19c-f56132ba73e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.439101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c0af7-8b1c-438a-a19c-f56132ba73e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.439636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c0af7-8b1c-438a-a19c-f56132ba73e1 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.562223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:38.595708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1330/2653] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:38 2022] POST /identity/v3/users => generated 286 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:38.599882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ccca1-e6b6-4a2c-9c93-251aa8123b29 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.612185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ccca1-e6b6-4a2c-9c93-251aa8123b29 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.617754 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d9d72-481b-4b24-ac6a-9d575229e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.618411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d9d72-481b-4b24-ac6a-9d575229e69a admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.618694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d9d72-481b-4b24-ac6a-9d575229e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.618967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d9d72-481b-4b24-ac6a-9d575229e69a admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.619621 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d9d72-481b-4b24-ac6a-9d575229e69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.621238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d9d72-481b-4b24-ac6a-9d575229e69a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.633851 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1324/2654] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:38.645720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0af7-8b1c-438a-a19c-f56132ba73e1 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.656570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0af7-8b1c-438a-a19c-f56132ba73e1 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.661607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97ab4-19fd-4fe4-a4e4-bccac75e78d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.662275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97ab4-19fd-4fe4-a4e4-bccac75e78d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.662576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97ab4-19fd-4fe4-a4e4-bccac75e78d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.662957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97ab4-19fd-4fe4-a4e4-bccac75e78d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.663672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97ab4-19fd-4fe4-a4e4-bccac75e78d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.665410 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97ab4-19fd-4fe4-a4e4-bccac75e78d9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.683646 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1331/2655] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:38.688480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d9d72-481b-4b24-ac6a-9d575229e69a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:38.705603 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d9d72-481b-4b24-ac6a-9d575229e69a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:38.713968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a8a7-99de-4dc3-8077-165b256edf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:38.715395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a8a7-99de-4dc3-8077-165b256edf42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.725124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a8a7-99de-4dc3-8077-165b256edf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.725124 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52a8a7-99de-4dc3-8077-165b256edf42 admin admin] PATH_INFO: `/v3/projects/fed1fd3f5cc54a18a43cc501494b6892/users/5766b9c5b4e6435fb845c504434144af/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.736836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52a8a7-99de-4dc3-8077-165b256edf42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed1fd3f5cc54a18a43cc501494b6892, user_id=5766b9c5b4e6435fb845c504434144af, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:38.740343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52a8a7-99de-4dc3-8077-165b256edf42 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:38.806823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:38.865770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1325/2656] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:38 2022] PUT /identity/v3/projects/fed1fd3f5cc54a18a43cc501494b6892/users/5766b9c5b4e6435fb845c504434144af/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:38.877463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc2fd6-ab8c-4630-8e6b-80b4b8ba55bb None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:38.877888 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc2fd6-ab8c-4630-8e6b-80b4b8ba55bb None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:38.878246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc2fd6-ab8c-4630-8e6b-80b4b8ba55bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:38.917207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-cacc2fd6-ab8c-4630-8e6b-80b4b8ba55bb None None] MFA Rules not processed for user `5766b9c5b4e6435fb845c504434144af`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:38.919295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-cacc2fd6-ab8c-4630-8e6b-80b4b8ba55bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.010217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1332/2657] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:39.252797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a8a7-99de-4dc3-8077-165b256edf42 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.254560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-ae52a8a7-99de-4dc3-8077-165b256edf42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:39.350405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52a8a7-99de-4dc3-8077-165b256edf42 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.356987 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0061d26e-9a6e-401b-b473-2bc7ce13039e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.358665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061d26e-9a6e-401b-b473-2bc7ce13039e service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.359147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061d26e-9a6e-401b-b473-2bc7ce13039e service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.359562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0061d26e-9a6e-401b-b473-2bc7ce13039e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.378416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061d26e-9a6e-401b-b473-2bc7ce13039e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.378416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0061d26e-9a6e-401b-b473-2bc7ce13039e service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.393546 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1326/2658] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:39.419349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc2fd6-ab8c-4630-8e6b-80b4b8ba55bb None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:39.498785 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc2fd6-ab8c-4630-8e6b-80b4b8ba55bb None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:39.504596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:39.505522 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.505800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.506107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] PATH_INFO: `/v3/users/5766b9c5b4e6435fb845c504434144af` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.507292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=5766b9c5b4e6435fb845c504434144af)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:39.509251 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:39.807844 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5766b9c5b4e6435fb845c504434144af'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.816605 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5766b9c5b4e6435fb845c504434144af'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.817536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5766b9c5b4e6435fb845c504434144af'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.917352 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5766b9c5b4e6435fb845c504434144af'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.932150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5766b9c5b4e6435fb845c504434144af'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:39.939349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1333/2659] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:39 2022] DELETE /identity/v3/users/5766b9c5b4e6435fb845c504434144af => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:39.944237 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f359d-54a1-4553-9a39-82e7a6d5299b None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:39.945171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f359d-54a1-4553-9a39-82e7a6d5299b None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:39.945539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f359d-54a1-4553-9a39-82e7a6d5299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:39.966738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4c0f359d-54a1-4553-9a39-82e7a6d5299b None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:39.967988 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4c0f359d-54a1-4553-9a39-82e7a6d5299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:40.027810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:40.055146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1327/2660] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:40.078610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:40.078610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:40.185132 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f1d7e-384e-4388-b538-812a016788ea admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:40.189824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9848c-19fe-4b15-9e68-7d853c7ef03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:40.190750 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9848c-19fe-4b15-9e68-7d853c7ef03a service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:40.192075 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9848c-19fe-4b15-9e68-7d853c7ef03a service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:40.192360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9848c-19fe-4b15-9e68-7d853c7ef03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:40.203964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9848c-19fe-4b15-9e68-7d853c7ef03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:40.205440 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9848c-19fe-4b15-9e68-7d853c7ef03a service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:40.222032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1334/2661] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:40.813676 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f359d-54a1-4553-9a39-82e7a6d5299b None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:40.815832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4c0f359d-54a1-4553-9a39-82e7a6d5299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:40.912945 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f359d-54a1-4553-9a39-82e7a6d5299b None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:40.918350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd106e-5bdc-4161-be7e-a8cc95b64b37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:40.919705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd106e-5bdc-4161-be7e-a8cc95b64b37 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:40.925742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd106e-5bdc-4161-be7e-a8cc95b64b37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:40.925742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd106e-5bdc-4161-be7e-a8cc95b64b37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:40.925742 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-efbd106e-5bdc-4161-be7e-a8cc95b64b37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:40.950609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:41.023377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd106e-5bdc-4161-be7e-a8cc95b64b37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.024841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd106e-5bdc-4161-be7e-a8cc95b64b37 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.037801 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1328/2662] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:41.142575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9848c-19fe-4b15-9e68-7d853c7ef03a service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.146250 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5ad9848c-19fe-4b15-9e68-7d853c7ef03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:41.195782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9848c-19fe-4b15-9e68-7d853c7ef03a service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:41.204179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:41.204908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.206702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.206989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] PATH_INFO: `/v3/projects/fed1fd3f5cc54a18a43cc501494b6892` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.208491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed1fd3f5cc54a18a43cc501494b6892)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.211645 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.386848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed1fd3f5cc54a18a43cc501494b6892', 'request_id': 'req-0ed363b6-ed23-4cff-8620-7d682b7ade06'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:41.393756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed1fd3f5cc54a18a43cc501494b6892', 'request_id': 'req-0ed363b6-ed23-4cff-8620-7d682b7ade06'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:41.477174 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed1fd3f5cc54a18a43cc501494b6892', 'request_id': 'req-0ed363b6-ed23-4cff-8620-7d682b7ade06'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:41.490334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] The token cache is being invalidate because project fed1fd3f5cc54a18a43cc501494b6892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:41.490618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:41.491269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0ed363b6-ed23-4cff-8620-7d682b7ade06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:41.492767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1335/2663] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:41 2022] DELETE /identity/v3/projects/fed1fd3f5cc54a18a43cc501494b6892 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:41.497837 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11ce2-3707-4f12-be8b-12215a2e6b60 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.498156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11ce2-3707-4f12-be8b-12215a2e6b60 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.498426 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f11ce2-3707-4f12-be8b-12215a2e6b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.519972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d5f11ce2-3707-4f12-be8b-12215a2e6b60 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:41.521189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d5f11ce2-3707-4f12-be8b-12215a2e6b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:41.584367 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1329/2664] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:41.593860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05ba63-07bf-4e83-9b73-1c32ed9f4b43 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.594170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05ba63-07bf-4e83-9b73-1c32ed9f4b43 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.594668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05ba63-07bf-4e83-9b73-1c32ed9f4b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.622736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ec05ba63-07bf-4e83-9b73-1c32ed9f4b43 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:41.623948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ec05ba63-07bf-4e83-9b73-1c32ed9f4b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:41.632823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1336/2665] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:41.640254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f11ce2-3707-4f12-be8b-12215a2e6b60 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.650691 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f11ce2-3707-4f12-be8b-12215a2e6b60 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:41.656360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:41.658581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7723498-1da6-4904-bca1-6c5214ce6f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:41.659204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7723498-1da6-4904-bca1-6c5214ce6f2e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.659481 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7723498-1da6-4904-bca1-6c5214ce6f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.659757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7723498-1da6-4904-bca1-6c5214ce6f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.660417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7723498-1da6-4904-bca1-6c5214ce6f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:41.660717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7723498-1da6-4904-bca1-6c5214ce6f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.662490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7723498-1da6-4904-bca1-6c5214ce6f2e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.676113 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1330/2666] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:41.680666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05ba63-07bf-4e83-9b73-1c32ed9f4b43 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.690443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05ba63-07bf-4e83-9b73-1c32ed9f4b43 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:41.695284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9df901-466b-4612-8aee-98dc8a7c393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:41.695887 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9df901-466b-4612-8aee-98dc8a7c393e admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.696167 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9df901-466b-4612-8aee-98dc8a7c393e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.696439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9df901-466b-4612-8aee-98dc8a7c393e admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.697096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9df901-466b-4612-8aee-98dc8a7c393e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.699053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9df901-466b-4612-8aee-98dc8a7c393e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.820004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1337/2667] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:41 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:41.821062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7723498-1da6-4904-bca1-6c5214ce6f2e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.832635 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7723498-1da6-4904-bca1-6c5214ce6f2e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:41.907719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f32a99-d565-4b16-b604-132f344d86cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:41.908485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f32a99-d565-4b16-b604-132f344d86cf admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:41.908660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f32a99-d565-4b16-b604-132f344d86cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:41.909010 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f32a99-d565-4b16-b604-132f344d86cf admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:41.909480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f32a99-d565-4b16-b604-132f344d86cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:41.911466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f32a99-d565-4b16-b604-132f344d86cf admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:41.943970 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9df901-466b-4612-8aee-98dc8a7c393e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:41.946737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-7c9df901-466b-4612-8aee-98dc8a7c393e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:42.011595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9df901-466b-4612-8aee-98dc8a7c393e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.016294 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446a5d8-c431-46c1-96da-2f30612cd259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.016905 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446a5d8-c431-46c1-96da-2f30612cd259 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.017179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446a5d8-c431-46c1-96da-2f30612cd259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.017446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446a5d8-c431-46c1-96da-2f30612cd259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.019261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8446a5d8-c431-46c1-96da-2f30612cd259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:42.029927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1331/2668] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:41 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:42.033363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446a5d8-c431-46c1-96da-2f30612cd259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.034252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f32a99-d565-4b16-b604-132f344d86cf admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.034574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446a5d8-c431-46c1-96da-2f30612cd259 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.045080 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f32a99-d565-4b16-b604-132f344d86cf admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.048687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1338/2669] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:42.061602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28522fa-a5e2-428d-9896-51f413df703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.067884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28522fa-a5e2-428d-9896-51f413df703c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.067884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28522fa-a5e2-428d-9896-51f413df703c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.067884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28522fa-a5e2-428d-9896-51f413df703c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.068405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:42.068521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28522fa-a5e2-428d-9896-51f413df703c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.068521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28522fa-a5e2-428d-9896-51f413df703c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.083086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1332/2670] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:42.084862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446a5d8-c431-46c1-96da-2f30612cd259 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.100468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446a5d8-c431-46c1-96da-2f30612cd259 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.107023 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e1580-d510-44ac-b2a3-592d2e37058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.107651 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e1580-d510-44ac-b2a3-592d2e37058c admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.107992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e1580-d510-44ac-b2a3-592d2e37058c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.108297 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e1580-d510-44ac-b2a3-592d2e37058c admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.108945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e1580-d510-44ac-b2a3-592d2e37058c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.110619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e1580-d510-44ac-b2a3-592d2e37058c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.121464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1339/2671] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:42.126528 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28522fa-a5e2-428d-9896-51f413df703c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.138488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28522fa-a5e2-428d-9896-51f413df703c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.143436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28537eee-d8fd-44ae-b26c-d30b612bfbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.144081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28537eee-d8fd-44ae-b26c-d30b612bfbe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.144365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28537eee-d8fd-44ae-b26c-d30b612bfbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.144638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28537eee-d8fd-44ae-b26c-d30b612bfbe6 admin admin] PATH_INFO: `/v3/projects/5c62ee36a781493ea50308aeadeb2af6/users/b64d75ac7db849749fa9632707146702/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.160418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28537eee-d8fd-44ae-b26c-d30b612bfbe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c62ee36a781493ea50308aeadeb2af6, user_id=b64d75ac7db849749fa9632707146702, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.163151 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28537eee-d8fd-44ae-b26c-d30b612bfbe6 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.306335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1333/2672] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:42 2022] PUT /identity/v3/projects/5c62ee36a781493ea50308aeadeb2af6/users/b64d75ac7db849749fa9632707146702/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:42.316988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe16763-73a2-4116-81fe-479301983bf9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.317479 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe16763-73a2-4116-81fe-479301983bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.317700 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe16763-73a2-4116-81fe-479301983bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.327694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:42.366917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-9fe16763-73a2-4116-81fe-479301983bf9 None None] MFA Rules not processed for user `b64d75ac7db849749fa9632707146702`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:42.368150 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9fe16763-73a2-4116-81fe-479301983bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:42.445789 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1340/2673] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:42.456618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28537eee-d8fd-44ae-b26c-d30b612bfbe6 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.555325 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28537eee-d8fd-44ae-b26c-d30b612bfbe6 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.562498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b33e53-d4ec-476d-a5e9-5e2ef135c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.563122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b33e53-d4ec-476d-a5e9-5e2ef135c32e admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.563404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b33e53-d4ec-476d-a5e9-5e2ef135c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.563675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b33e53-d4ec-476d-a5e9-5e2ef135c32e admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.564310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b33e53-d4ec-476d-a5e9-5e2ef135c32e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.566291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b33e53-d4ec-476d-a5e9-5e2ef135c32e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.699648 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:42.720309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1334/2674] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:42 2022] POST /identity/v3/projects => generated 375 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:42.721507 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe16763-73a2-4116-81fe-479301983bf9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.752893 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe16763-73a2-4116-81fe-479301983bf9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.834232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a0a4e-f663-490b-88c4-c2588d735c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.834860 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a0a4e-f663-490b-88c4-c2588d735c1b admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.835138 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a0a4e-f663-490b-88c4-c2588d735c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.835529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a0a4e-f663-490b-88c4-c2588d735c1b admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.836053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a0a4e-f663-490b-88c4-c2588d735c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.838308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a0a4e-f663-490b-88c4-c2588d735c1b admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:42.855504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:42.963601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1341/2675] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:42 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:42.969092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b33e53-d4ec-476d-a5e9-5e2ef135c32e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:42.981008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b33e53-d4ec-476d-a5e9-5e2ef135c32e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:42.986662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cbe9c-3410-4860-a5a0-180909b273cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:42.987281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cbe9c-3410-4860-a5a0-180909b273cd admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:42.987563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cbe9c-3410-4860-a5a0-180909b273cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:42.987836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cbe9c-3410-4860-a5a0-180909b273cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:42.988492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cbe9c-3410-4860-a5a0-180909b273cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:42.990709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cbe9c-3410-4860-a5a0-180909b273cd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:43.003722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1335/2676] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:43.008411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a0a4e-f663-490b-88c4-c2588d735c1b admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:43.021658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a0a4e-f663-490b-88c4-c2588d735c1b admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:43.026779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f629d1a-5691-44a7-8781-a74ff9d36301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:43.027450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629d1a-5691-44a7-8781-a74ff9d36301 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:43.027734 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629d1a-5691-44a7-8781-a74ff9d36301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:43.028347 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f629d1a-5691-44a7-8781-a74ff9d36301 admin admin] PATH_INFO: `/v3/projects/64b3e4a8cbb944798fba8d046aecc3e1/users/a329e80840dc454aa7bff1954a8343e7/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:43.046700 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f629d1a-5691-44a7-8781-a74ff9d36301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b3e4a8cbb944798fba8d046aecc3e1, user_id=a329e80840dc454aa7bff1954a8343e7, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:43.049409 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f629d1a-5691-44a7-8781-a74ff9d36301 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:43.179451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1342/2677] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:43 2022] PUT /identity/v3/projects/64b3e4a8cbb944798fba8d046aecc3e1/users/a329e80840dc454aa7bff1954a8343e7/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:43.186064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cbe9c-3410-4860-a5a0-180909b273cd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:43.199277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cbe9c-3410-4860-a5a0-180909b273cd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:43.290076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7147ef-244d-4fe9-b63c-f8c9ed2bbba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:43.290884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7147ef-244d-4fe9-b63c-f8c9ed2bbba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:43.291271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7147ef-244d-4fe9-b63c-f8c9ed2bbba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:43.291553 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7147ef-244d-4fe9-b63c-f8c9ed2bbba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:43.292347 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7147ef-244d-4fe9-b63c-f8c9ed2bbba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:43.294847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7147ef-244d-4fe9-b63c-f8c9ed2bbba8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:43.306518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1336/2678] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:43.311780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:43.314748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f629d1a-5691-44a7-8781-a74ff9d36301 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:43.324611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f629d1a-5691-44a7-8781-a74ff9d36301 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:43.332145 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f376a2-6c47-4777-8de5-a2c758515ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:43.333462 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f376a2-6c47-4777-8de5-a2c758515ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:43.333960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f376a2-6c47-4777-8de5-a2c758515ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:43.334526 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f376a2-6c47-4777-8de5-a2c758515ba9 admin admin] PATH_INFO: `/v3/projects/64b3e4a8cbb944798fba8d046aecc3e1/users/a329e80840dc454aa7bff1954a8343e7/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:43.336600 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f376a2-6c47-4777-8de5-a2c758515ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b3e4a8cbb944798fba8d046aecc3e1, user_id=a329e80840dc454aa7bff1954a8343e7, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:43.339505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f376a2-6c47-4777-8de5-a2c758515ba9 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:43.352232 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1343/2679] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:43 2022] PUT /identity/v3/projects/64b3e4a8cbb944798fba8d046aecc3e1/users/a329e80840dc454aa7bff1954a8343e7/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:43.364277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74c11-1385-4f5f-a12a-4b308c223638 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:43.364581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74c11-1385-4f5f-a12a-4b308c223638 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:43.364826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c74c11-1385-4f5f-a12a-4b308c223638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:43.404316 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b5c74c11-1385-4f5f-a12a-4b308c223638 None None] MFA Rules not processed for user `a329e80840dc454aa7bff1954a8343e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:43.405436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b5c74c11-1385-4f5f-a12a-4b308c223638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:43.497518 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1337/2680] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:43.512780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f376a2-6c47-4777-8de5-a2c758515ba9 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:43.515248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e2f376a2-6c47-4777-8de5-a2c758515ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:43.582915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f376a2-6c47-4777-8de5-a2c758515ba9 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:43.586740 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3759c-5fa5-4e46-9c56-75c99dd9c895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:43.587357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3759c-5fa5-4e46-9c56-75c99dd9c895 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:43.587641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3759c-5fa5-4e46-9c56-75c99dd9c895 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:43.587910 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3759c-5fa5-4e46-9c56-75c99dd9c895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:43.649530 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3759c-5fa5-4e46-9c56-75c99dd9c895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:43.651153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3759c-5fa5-4e46-9c56-75c99dd9c895 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:43.664610 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1344/2681] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:43.875180 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:43.968980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:44.586126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:44.691267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:45.079519 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:45.117768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:45.831318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74c11-1385-4f5f-a12a-4b308c223638 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:45.834019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b5c74c11-1385-4f5f-a12a-4b308c223638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:45.909585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c74c11-1385-4f5f-a12a-4b308c223638 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:45.914413 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:45.915068 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:45.915502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:45.915779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] PATH_INFO: `/v3/users/19ef8cc062bc43a88465c8cfa8a72c06` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:45.916910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ef8cc062bc43a88465c8cfa8a72c06)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:45.919933 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.168335 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ef8cc062bc43a88465c8cfa8a72c06'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:46.179098 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ef8cc062bc43a88465c8cfa8a72c06'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:46.179880 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ef8cc062bc43a88465c8cfa8a72c06'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:46.212673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:46.286660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ef8cc062bc43a88465c8cfa8a72c06'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:46.287214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ef8cc062bc43a88465c8cfa8a72c06'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:46.306938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1338/2682] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:45 2022] DELETE /identity/v3/users/19ef8cc062bc43a88465c8cfa8a72c06 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:46.312407 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9d008-8d5b-4f1f-a16d-df17029635a2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.312930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9d008-8d5b-4f1f-a16d-df17029635a2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.313035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9d008-8d5b-4f1f-a16d-df17029635a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.332363 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-74e9d008-8d5b-4f1f-a16d-df17029635a2 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:46.333582 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-74e9d008-8d5b-4f1f-a16d-df17029635a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:46.367859 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.369758 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:46.387359 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:46.407586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1345/2683] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:46.419806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9d008-8d5b-4f1f-a16d-df17029635a2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.421919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-74e9d008-8d5b-4f1f-a16d-df17029635a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:46.459461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7cca1-e8a1-4549-b566-af0ed63674e8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.469153 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.471015 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.471583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.472308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] PATH_INFO: `/v3/users/36ae407308bf4947b1f113f5390db714` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.474878 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ae407308bf4947b1f113f5390db714)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.479957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.487266 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9d008-8d5b-4f1f-a16d-df17029635a2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:46.491456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f659d1-e672-4003-9679-7eefa563cfe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:46.496515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f659d1-e672-4003-9679-7eefa563cfe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:46.496515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f659d1-e672-4003-9679-7eefa563cfe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:46.496515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f659d1-e672-4003-9679-7eefa563cfe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:46.503580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f659d1-e672-4003-9679-7eefa563cfe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:46.505284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f659d1-e672-4003-9679-7eefa563cfe2 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:46.516034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1346/2684] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:46.681190 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ae407308bf4947b1f113f5390db714'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:46.689077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ae407308bf4947b1f113f5390db714'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:46.690001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ae407308bf4947b1f113f5390db714'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:46.776571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ae407308bf4947b1f113f5390db714'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:46.776571 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ae407308bf4947b1f113f5390db714'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:46.801486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1339/2685] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:46 2022] DELETE /identity/v3/users/36ae407308bf4947b1f113f5390db714 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:46.879383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f659d1-e672-4003-9679-7eefa563cfe2 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:46.881208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-21f659d1-e672-4003-9679-7eefa563cfe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:47.002205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f659d1-e672-4003-9679-7eefa563cfe2 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.016126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:47.017979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:47.087557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06fd7-13c2-4339-a065-4f7b832ed221 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d15478ca864f49aae2301e2328fe23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.088455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06fd7-13c2-4339-a065-4f7b832ed221 service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.089008 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06fd7-13c2-4339-a065-4f7b832ed221 service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.089762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06fd7-13c2-4339-a065-4f7b832ed221 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.096125 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-02c06fd7-13c2-4339-a065-4f7b832ed221 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:47.111031 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c06fd7-13c2-4339-a065-4f7b832ed221 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.113527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c06fd7-13c2-4339-a065-4f7b832ed221 service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.124024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b104c-53ce-4508-a282-2f0dd91894bf admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.139943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.141342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.142097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.142666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1347/2686] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:47.143870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06fd7-13c2-4339-a065-4f7b832ed221 service placement] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:47.145932 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-02c06fd7-13c2-4339-a065-4f7b832ed221 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:47.151884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:47.155458 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] PATH_INFO: `/v3/projects/53c49209bd924a8c9585b7a364b8728b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.155458 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c49209bd924a8c9585b7a364b8728b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.157277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.160296 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06fd7-13c2-4339-a065-4f7b832ed221 service placement] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.166197 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.167286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.167286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.167536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] PATH_INFO: `/v3/users/b64d75ac7db849749fa9632707146702` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.169269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b64d75ac7db849749fa9632707146702)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.172834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.182647 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:47.317964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c49209bd924a8c9585b7a364b8728b', 'request_id': 'req-1f53a4c1-497c-443f-a47d-211ed2995c01'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.325668 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c49209bd924a8c9585b7a364b8728b', 'request_id': 'req-1f53a4c1-497c-443f-a47d-211ed2995c01'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.333399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c49209bd924a8c9585b7a364b8728b', 'request_id': 'req-1f53a4c1-497c-443f-a47d-211ed2995c01'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.464305 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] The token cache is being invalidate because project 53c49209bd924a8c9585b7a364b8728b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:47.470028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.470028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.470601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1340/2687] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:47 2022] DELETE /identity/v3/projects/53c49209bd924a8c9585b7a364b8728b => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:47.471515 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:47.472837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b64d75ac7db849749fa9632707146702'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.473410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:47.481116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b64d75ac7db849749fa9632707146702'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.482657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b64d75ac7db849749fa9632707146702'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.544750 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:47.549526 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53a4c1-497c-443f-a47d-211ed2995c01 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.554318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.554963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.555240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.555649 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] PATH_INFO: `/v3/projects/ba7ee5834a304139958dc23716aa8819` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.556807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba7ee5834a304139958dc23716aa8819)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.558722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.568558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b64d75ac7db849749fa9632707146702'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.581212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:47.586606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b64d75ac7db849749fa9632707146702'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.594777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1348/2688] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:47 2022] DELETE /identity/v3/users/b64d75ac7db849749fa9632707146702 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:47.595704 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:47.597076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:47.635575 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:47.675295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a4619-c659-4c15-942b-ae92afc0f751 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.688557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba7ee5834a304139958dc23716aa8819', 'request_id': 'req-ebdffb8a-54e2-4b4a-82bf-860ed956721d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.695540 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba7ee5834a304139958dc23716aa8819', 'request_id': 'req-ebdffb8a-54e2-4b4a-82bf-860ed956721d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.702646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba7ee5834a304139958dc23716aa8819', 'request_id': 'req-ebdffb8a-54e2-4b4a-82bf-860ed956721d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.739664 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.740457 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.740668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.740937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] PATH_INFO: `/v3/users/9fdaeae3345c4c8cacd26efe842b44ec` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.742171 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdaeae3345c4c8cacd26efe842b44ec)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.744185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.791163 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] The token cache is being invalidate because project ba7ee5834a304139958dc23716aa8819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:47.791455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.792135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ebdffb8a-54e2-4b4a-82bf-860ed956721d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.794767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1341/2689] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:47 2022] DELETE /identity/v3/projects/ba7ee5834a304139958dc23716aa8819 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:47.796252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11420a7-c612-470e-b0b2-1b09226035c8 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.796537 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11420a7-c612-470e-b0b2-1b09226035c8 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.796803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11420a7-c612-470e-b0b2-1b09226035c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.819102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-b11420a7-c612-470e-b0b2-1b09226035c8 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:47.820239 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-b11420a7-c612-470e-b0b2-1b09226035c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:47.828986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1342/2690] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:47.830348 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc998bc-6fb2-4c15-8f24-94e7300d7399 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.830634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc998bc-6fb2-4c15-8f24-94e7300d7399 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.830911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc998bc-6fb2-4c15-8f24-94e7300d7399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.834685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:47.853972 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-0bc998bc-6fb2-4c15-8f24-94e7300d7399 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:47.855205 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0bc998bc-6fb2-4c15-8f24-94e7300d7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:47.866624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1343/2691] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:47.867477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc998bc-6fb2-4c15-8f24-94e7300d7399 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:47.868779 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0bc998bc-6fb2-4c15-8f24-94e7300d7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:47.885079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:47.932705 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc998bc-6fb2-4c15-8f24-94e7300d7399 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:47.938112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6421216-23ac-43f7-8016-02dcdfd70be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:47.938785 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421216-23ac-43f7-8016-02dcdfd70be7 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.939105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421216-23ac-43f7-8016-02dcdfd70be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.939460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6421216-23ac-43f7-8016-02dcdfd70be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.951787 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6421216-23ac-43f7-8016-02dcdfd70be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:47.953262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6421216-23ac-43f7-8016-02dcdfd70be7 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:47.966397 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1344/2692] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:47.967992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eda3c4-275b-41e7-8f27-8988f1f960cb None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:47.968416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eda3c4-275b-41e7-8f27-8988f1f960cb None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:47.968695 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eda3c4-275b-41e7-8f27-8988f1f960cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:47.973460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:47.977182 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdaeae3345c4c8cacd26efe842b44ec'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.985265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdaeae3345c4c8cacd26efe842b44ec'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.986113 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdaeae3345c4c8cacd26efe842b44ec'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:47.990106 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c0eda3c4-275b-41e7-8f27-8988f1f960cb None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:47.991108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c0eda3c4-275b-41e7-8f27-8988f1f960cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:48.004101 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1345/2693] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:48.009185 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eda3c4-275b-41e7-8f27-8988f1f960cb None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:48.037418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eda3c4-275b-41e7-8f27-8988f1f960cb None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:48.045624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01801d8-e24f-4f9b-94af-7db22c827eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:48.046276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01801d8-e24f-4f9b-94af-7db22c827eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:48.046549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01801d8-e24f-4f9b-94af-7db22c827eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:48.046815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01801d8-e24f-4f9b-94af-7db22c827eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:48.047532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01801d8-e24f-4f9b-94af-7db22c827eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:48.048492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01801d8-e24f-4f9b-94af-7db22c827eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:48.050123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01801d8-e24f-4f9b-94af-7db22c827eb2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:48.061793 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdaeae3345c4c8cacd26efe842b44ec'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:48.070105 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1346/2694] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:48.072344 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01801d8-e24f-4f9b-94af-7db22c827eb2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:48.087140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdaeae3345c4c8cacd26efe842b44ec'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:48.089937 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01801d8-e24f-4f9b-94af-7db22c827eb2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:48.098039 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a69bc-1a81-4a3d-9f4b-57d0b9091819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:48.099789 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1349/2695] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:47 2022] DELETE /identity/v3/users/9fdaeae3345c4c8cacd26efe842b44ec => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:48.099939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a69bc-1a81-4a3d-9f4b-57d0b9091819 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:48.099939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a69bc-1a81-4a3d-9f4b-57d0b9091819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:48.099939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a69bc-1a81-4a3d-9f4b-57d0b9091819 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:48.100213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a69bc-1a81-4a3d-9f4b-57d0b9091819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:48.102116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a69bc-1a81-4a3d-9f4b-57d0b9091819 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:48.199286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1347/2696] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:48 2022] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:48.201443 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:48.202944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:48.280509 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d21e6c-fc7e-44e6-8114-077957d3eb7c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:48.345776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a5803-4216-47eb-985b-cd286d86df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:48.346528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a5803-4216-47eb-985b-cd286d86df41 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:48.346902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a5803-4216-47eb-985b-cd286d86df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:48.347295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a5803-4216-47eb-985b-cd286d86df41 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:48.348088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a5803-4216-47eb-985b-cd286d86df41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:48.350851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a5803-4216-47eb-985b-cd286d86df41 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:48.459238 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1350/2697] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:48 2022] POST /identity/v3/users => generated 284 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:48.463442 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a69bc-1a81-4a3d-9f4b-57d0b9091819 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:48.474108 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a69bc-1a81-4a3d-9f4b-57d0b9091819 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:48.484353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c23d56-e430-42a7-aee9-4aff777938bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:48.485103 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23d56-e430-42a7-aee9-4aff777938bd admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:48.485521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23d56-e430-42a7-aee9-4aff777938bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:48.485860 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c23d56-e430-42a7-aee9-4aff777938bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:48.486543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c23d56-e430-42a7-aee9-4aff777938bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:48.488129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c23d56-e430-42a7-aee9-4aff777938bd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:48.499605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1348/2698] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:48.503930 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a5803-4216-47eb-985b-cd286d86df41 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:48.509834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:48.518937 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a5803-4216-47eb-985b-cd286d86df41 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:48.524032 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2fcf9-da49-484c-afca-be7338d245d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:48.524713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2fcf9-da49-484c-afca-be7338d245d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:48.524989 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2fcf9-da49-484c-afca-be7338d245d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:48.525293 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2fcf9-da49-484c-afca-be7338d245d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:48.526035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2fcf9-da49-484c-afca-be7338d245d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:48.527736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2fcf9-da49-484c-afca-be7338d245d4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:48.538825 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1351/2699] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:48.543312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c23d56-e430-42a7-aee9-4aff777938bd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:48.554861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c23d56-e430-42a7-aee9-4aff777938bd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:48.561826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee00cde-c3ca-4961-953c-64f68d573bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:48.561826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00cde-c3ca-4961-953c-64f68d573bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:48.562445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00cde-c3ca-4961-953c-64f68d573bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:48.562644 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee00cde-c3ca-4961-953c-64f68d573bba admin admin] PATH_INFO: `/v3/projects/79d87601f8254bae9aa505877281104e/users/75f42509ac3d44bfb53f57ffc84294c5/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:48.563391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2fcf9-da49-484c-afca-be7338d245d4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:48.565348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-67e2fcf9-da49-484c-afca-be7338d245d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:48.578842 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:48.581772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2fcf9-da49-484c-afca-be7338d245d4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:48.585803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee00cde-c3ca-4961-953c-64f68d573bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d87601f8254bae9aa505877281104e, user_id=75f42509ac3d44bfb53f57ffc84294c5, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:48.588490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee00cde-c3ca-4961-953c-64f68d573bba admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:48.589342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:48.590341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:48.590898 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:48.591143 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] PATH_INFO: `/v3/projects/5c62ee36a781493ea50308aeadeb2af6` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:48.592769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c62ee36a781493ea50308aeadeb2af6)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:48.594944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:48.683455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1349/2700] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:48 2022] PUT /identity/v3/projects/79d87601f8254bae9aa505877281104e/users/75f42509ac3d44bfb53f57ffc84294c5/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:48.693203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee00cde-c3ca-4961-953c-64f68d573bba admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:48.693203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1ee00cde-c3ca-4961-953c-64f68d573bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:48.713328 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c62ee36a781493ea50308aeadeb2af6', 'request_id': 'req-f6cf9419-7fd2-4043-8df2-34f2c2576cca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:48.721217 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c62ee36a781493ea50308aeadeb2af6', 'request_id': 'req-f6cf9419-7fd2-4043-8df2-34f2c2576cca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:48.757855 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee00cde-c3ca-4961-953c-64f68d573bba admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:48.791405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c62ee36a781493ea50308aeadeb2af6', 'request_id': 'req-f6cf9419-7fd2-4043-8df2-34f2c2576cca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:48.803907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] The token cache is being invalidate because project 5c62ee36a781493ea50308aeadeb2af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:48.804202 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:48.804880 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-f6cf9419-7fd2-4043-8df2-34f2c2576cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:48.809666 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1352/2701] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:48 2022] DELETE /identity/v3/projects/5c62ee36a781493ea50308aeadeb2af6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:48.815351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dae84-089b-4c12-9532-47d6dfa26c4a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:48.815351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dae84-089b-4c12-9532-47d6dfa26c4a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:48.815351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dae84-089b-4c12-9532-47d6dfa26c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:48.820171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:48.820721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:48.821035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:48.821307 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] PATH_INFO: `/v3/projects/5185625642d94e5385f60389dcd88d6f` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:48.822510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5185625642d94e5385f60389dcd88d6f)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:48.824418 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:48.842792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-297dae84-089b-4c12-9532-47d6dfa26c4a None None] MFA Rules not processed for user `75f42509ac3d44bfb53f57ffc84294c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:48.844055 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-297dae84-089b-4c12-9532-47d6dfa26c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:48.916691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1353/2702] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:48.925945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dae84-089b-4c12-9532-47d6dfa26c4a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:48.925945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-297dae84-089b-4c12-9532-47d6dfa26c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:48.935354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dae84-089b-4c12-9532-47d6dfa26c4a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:48.942162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5185625642d94e5385f60389dcd88d6f', 'request_id': 'req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:48.955079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5185625642d94e5385f60389dcd88d6f', 'request_id': 'req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:48.961022 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5185625642d94e5385f60389dcd88d6f', 'request_id': 'req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:48.997778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:48.998540 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:48.998822 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:48.999112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] PATH_INFO: `/v3/users/a329e80840dc454aa7bff1954a8343e7` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:49.000326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a329e80840dc454aa7bff1954a8343e7)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:49.002319 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:49.054271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] The token cache is being invalidate because project 5185625642d94e5385f60389dcd88d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:49.054906 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.055238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.056772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1350/2703] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:48 2022] DELETE /identity/v3/projects/5185625642d94e5385f60389dcd88d6f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:49.060644 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:49.060644 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:49.072310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2c64b-b5bf-4deb-9e1e-46f676128f92 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:49.078658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329df46-a00a-4935-8e10-16da14fac30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:49.079280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329df46-a00a-4935-8e10-16da14fac30f admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:49.079562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329df46-a00a-4935-8e10-16da14fac30f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:49.079835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329df46-a00a-4935-8e10-16da14fac30f admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:49.080470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329df46-a00a-4935-8e10-16da14fac30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:49.082428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329df46-a00a-4935-8e10-16da14fac30f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:49.199469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1351/2704] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:49 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:49.201474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329df46-a00a-4935-8e10-16da14fac30f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:49.203374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2329df46-a00a-4935-8e10-16da14fac30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:49.270624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329df46-a00a-4935-8e10-16da14fac30f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:49.275080 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a329e80840dc454aa7bff1954a8343e7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.275370 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:49.276009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:49.276427 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:49.276548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] PATH_INFO: `/v3/users/bf42d45856f5487f850f85468d1e5fa6` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:49.277723 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf42d45856f5487f850f85468d1e5fa6)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:49.281276 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:49.283544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a329e80840dc454aa7bff1954a8343e7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.284267 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a329e80840dc454aa7bff1954a8343e7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.342047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a329e80840dc454aa7bff1954a8343e7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.355614 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a329e80840dc454aa7bff1954a8343e7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.362103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1354/2705] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:48 2022] DELETE /identity/v3/users/a329e80840dc454aa7bff1954a8343e7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:49.363098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:49.364658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:49.371152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:49.420405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:49.476893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf42d45856f5487f850f85468d1e5fa6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.478014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9e595-4416-432c-a4a0-af5a8bfde857 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:49.484790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048a27b-5dbb-4cf3-8f49-44f1a9a06a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:49.485635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048a27b-5dbb-4cf3-8f49-44f1a9a06a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:49.488762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf42d45856f5487f850f85468d1e5fa6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.488964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048a27b-5dbb-4cf3-8f49-44f1a9a06a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:49.488964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048a27b-5dbb-4cf3-8f49-44f1a9a06a8f admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:49.489306 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf42d45856f5487f850f85468d1e5fa6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.489488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048a27b-5dbb-4cf3-8f49-44f1a9a06a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:49.490431 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5048a27b-5dbb-4cf3-8f49-44f1a9a06a8f admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:49.557077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf42d45856f5487f850f85468d1e5fa6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.557796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf42d45856f5487f850f85468d1e5fa6'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:49.563832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1355/2706] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:49 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:49.567749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048a27b-5dbb-4cf3-8f49-44f1a9a06a8f admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:49.569490 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5048a27b-5dbb-4cf3-8f49-44f1a9a06a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:49.578258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1352/2707] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:49 2022] DELETE /identity/v3/users/bf42d45856f5487f850f85468d1e5fa6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:49.586231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048a27b-5dbb-4cf3-8f49-44f1a9a06a8f admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:49.650905 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad5f3-6027-4031-bead-4b05a6f191bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:49.651738 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad5f3-6027-4031-bead-4b05a6f191bd admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:49.652024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad5f3-6027-4031-bead-4b05a6f191bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:49.652368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad5f3-6027-4031-bead-4b05a6f191bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:49.653093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ad5f3-6027-4031-bead-4b05a6f191bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:49.654998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ad5f3-6027-4031-bead-4b05a6f191bd admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:49.675272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1356/2708] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:49.679278 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:49.692637 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af497d-9dd6-4f76-9c4e-6bb4b75dc55c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:49.700817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0625-7f7b-48e2-ae8a-0a6c53080226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:49.703356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0625-7f7b-48e2-ae8a-0a6c53080226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:49.703356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0625-7f7b-48e2-ae8a-0a6c53080226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:49.703356 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0625-7f7b-48e2-ae8a-0a6c53080226 admin admin] PATH_INFO: `/v3/projects/abb09eff11534bfe8ab76757a8e45ef6/users/6a67f54e55894db8a1cf0c5597337263/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:49.722095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da0625-7f7b-48e2-ae8a-0a6c53080226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb09eff11534bfe8ab76757a8e45ef6, user_id=6a67f54e55894db8a1cf0c5597337263, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:49.725191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da0625-7f7b-48e2-ae8a-0a6c53080226 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:49.792252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1353/2709] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:49 2022] PUT /identity/v3/projects/abb09eff11534bfe8ab76757a8e45ef6/users/6a67f54e55894db8a1cf0c5597337263/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:49.796591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad5f3-6027-4031-bead-4b05a6f191bd admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:49.808829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad5f3-6027-4031-bead-4b05a6f191bd admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:49.889272 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f398a-2b0e-4f99-a83c-4b0c19a0c868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:49.890033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f398a-2b0e-4f99-a83c-4b0c19a0c868 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:49.890404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f398a-2b0e-4f99-a83c-4b0c19a0c868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:49.890763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f398a-2b0e-4f99-a83c-4b0c19a0c868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:49.891506 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f398a-2b0e-4f99-a83c-4b0c19a0c868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:49.893317 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f398a-2b0e-4f99-a83c-4b0c19a0c868 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:49.904980 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1357/2710] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:49.909230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0625-7f7b-48e2-ae8a-0a6c53080226 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:49.915467 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f398a-2b0e-4f99-a83c-4b0c19a0c868 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:49.916910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:49.917566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-da7f398a-2b0e-4f99-a83c-4b0c19a0c868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:49.922324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0625-7f7b-48e2-ae8a-0a6c53080226 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:49.927377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6db05-649f-4de5-8402-685bf5b0ef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:49.928044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6db05-649f-4de5-8402-685bf5b0ef18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:49.929021 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6db05-649f-4de5-8402-685bf5b0ef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:49.929021 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6db05-649f-4de5-8402-685bf5b0ef18 admin admin] PATH_INFO: `/v3/projects/abb09eff11534bfe8ab76757a8e45ef6/users/6a67f54e55894db8a1cf0c5597337263/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:49.932064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f398a-2b0e-4f99-a83c-4b0c19a0c868 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:49.933609 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6db05-649f-4de5-8402-685bf5b0ef18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb09eff11534bfe8ab76757a8e45ef6, user_id=6a67f54e55894db8a1cf0c5597337263, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:49.936711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde6db05-649f-4de5-8402-685bf5b0ef18 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:49.938847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:49.939850 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:49.940283 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:49.940662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] PATH_INFO: `/v3/projects/64b3e4a8cbb944798fba8d046aecc3e1` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:49.942341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b3e4a8cbb944798fba8d046aecc3e1)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:49.944447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:49.971822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1354/2711] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:49 2022] PUT /identity/v3/projects/abb09eff11534bfe8ab76757a8e45ef6/users/6a67f54e55894db8a1cf0c5597337263/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:49.984212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9dddd-95ec-4d6d-a530-ba425414a7c3 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:49.984490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9dddd-95ec-4d6d-a530-ba425414a7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:49.984753 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9dddd-95ec-4d6d-a530-ba425414a7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.019943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-5ef9dddd-95ec-4d6d-a530-ba425414a7c3 None None] MFA Rules not processed for user `6a67f54e55894db8a1cf0c5597337263`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:50.021283 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5ef9dddd-95ec-4d6d-a530-ba425414a7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:50.091488 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:50.119174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1355/2712] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:50.119631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9dddd-95ec-4d6d-a530-ba425414a7c3 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:50.125009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5ef9dddd-95ec-4d6d-a530-ba425414a7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:50.209379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9dddd-95ec-4d6d-a530-ba425414a7c3 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:50.216044 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:50.216872 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.217175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.217424 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] PATH_INFO: `/v3/projects/0a6c5c6f2ffc480286a3c30ce81b5062` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.218689 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6c5c6f2ffc480286a3c30ce81b5062)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:50.220585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:50.239838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b3e4a8cbb944798fba8d046aecc3e1', 'request_id': 'req-bd123519-6b5e-49c8-9c3a-3159359a5f8e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.252642 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b3e4a8cbb944798fba8d046aecc3e1', 'request_id': 'req-bd123519-6b5e-49c8-9c3a-3159359a5f8e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.343083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6c5c6f2ffc480286a3c30ce81b5062', 'request_id': 'req-8412c231-0ec2-474b-882e-f8f201c9af12'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.344346 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b3e4a8cbb944798fba8d046aecc3e1', 'request_id': 'req-bd123519-6b5e-49c8-9c3a-3159359a5f8e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.350191 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6c5c6f2ffc480286a3c30ce81b5062', 'request_id': 'req-8412c231-0ec2-474b-882e-f8f201c9af12'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.356978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6c5c6f2ffc480286a3c30ce81b5062', 'request_id': 'req-8412c231-0ec2-474b-882e-f8f201c9af12'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.358086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] The token cache is being invalidate because project 64b3e4a8cbb944798fba8d046aecc3e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:50.358667 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.359487 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.361424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1358/2713] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:49 2022] DELETE /identity/v3/projects/64b3e4a8cbb944798fba8d046aecc3e1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:50.362333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:50.363698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:50.430910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:50.432999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd123519-6b5e-49c8-9c3a-3159359a5f8e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:50.469343 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] The token cache is being invalidate because project 0a6c5c6f2ffc480286a3c30ce81b5062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:50.469969 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.470836 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-8412c231-0ec2-474b-882e-f8f201c9af12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:50.472446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1356/2714] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:50 2022] DELETE /identity/v3/projects/0a6c5c6f2ffc480286a3c30ce81b5062 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:50.473903 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c72e4a-e770-436b-b2d4-0a508d747b2e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.474269 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c72e4a-e770-436b-b2d4-0a508d747b2e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.474612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c72e4a-e770-436b-b2d4-0a508d747b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.494334 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b940a2c-46dd-4988-a642-880482d5a6e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:50.494945 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b940a2c-46dd-4988-a642-880482d5a6e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.499410 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b940a2c-46dd-4988-a642-880482d5a6e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.499410 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b940a2c-46dd-4988-a642-880482d5a6e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.499721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-e8c72e4a-e770-436b-b2d4-0a508d747b2e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:50.500029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5b940a2c-46dd-4988-a642-880482d5a6e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:50.500171 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e8c72e4a-e770-436b-b2d4-0a508d747b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:50.562053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1357/2715] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:50.563640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03f26-2274-4f4e-8858-2c64d3af143e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.563822 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03f26-2274-4f4e-8858-2c64d3af143e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.564126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c03f26-2274-4f4e-8858-2c64d3af143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.577668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b940a2c-46dd-4988-a642-880482d5a6e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:50.577668 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b940a2c-46dd-4988-a642-880482d5a6e0 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:50.584993 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1359/2716] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:50.601169 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c3c03f26-2274-4f4e-8858-2c64d3af143e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:50.601317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c3c03f26-2274-4f4e-8858-2c64d3af143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:50.611765 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1358/2717] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:50.620774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f65c6-f753-4c5e-9cd7-c39c0e89169d None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.621073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f65c6-f753-4c5e-9cd7-c39c0e89169d None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.621354 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f65c6-f753-4c5e-9cd7-c39c0e89169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.639095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cb2be-dae0-485c-9130-81188ee8e0fe None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.639393 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cb2be-dae0-485c-9130-81188ee8e0fe None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.639625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cb2be-dae0-485c-9130-81188ee8e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.644242 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-711f65c6-f753-4c5e-9cd7-c39c0e89169d None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:50.645449 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-711f65c6-f753-4c5e-9cd7-c39c0e89169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:50.654904 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1360/2718] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:50.659229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f65c6-f753-4c5e-9cd7-c39c0e89169d None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:50.663247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-115cb2be-dae0-485c-9130-81188ee8e0fe None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:50.664440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-115cb2be-dae0-485c-9130-81188ee8e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:50.669991 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f65c6-f753-4c5e-9cd7-c39c0e89169d None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:50.676826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1740-d909-497e-85c5-62e7e0c61e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:50.677444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1740-d909-497e-85c5-62e7e0c61e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.677725 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1740-d909-497e-85c5-62e7e0c61e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.678033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e1740-d909-497e-85c5-62e7e0c61e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.678682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e1740-d909-497e-85c5-62e7e0c61e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:50.678984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e1740-d909-497e-85c5-62e7e0c61e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:50.679827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1359/2719] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:50.680755 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e1740-d909-497e-85c5-62e7e0c61e34 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:50.684759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cb2be-dae0-485c-9130-81188ee8e0fe None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:50.694698 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cb2be-dae0-485c-9130-81188ee8e0fe None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:50.695009 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1361/2720] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:43:50.698663 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1740-d909-497e-85c5-62e7e0c61e34 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:50.700361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e3edf-7082-4475-bc6f-9d582dd00a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:50.701149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3edf-7082-4475-bc6f-9d582dd00a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.701569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3edf-7082-4475-bc6f-9d582dd00a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.704223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3edf-7082-4475-bc6f-9d582dd00a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.704223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e3edf-7082-4475-bc6f-9d582dd00a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:50.704223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e3edf-7082-4475-bc6f-9d582dd00a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:50.704561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e3edf-7082-4475-bc6f-9d582dd00a1d admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:50.710665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e1740-d909-497e-85c5-62e7e0c61e34 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:50.717915 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1360/2721] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:43:50.719608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aeea4-6043-4f33-8fa5-c1d78489b482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:50.720225 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aeea4-6043-4f33-8fa5-c1d78489b482 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.720505 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aeea4-6043-4f33-8fa5-c1d78489b482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.720776 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aeea4-6043-4f33-8fa5-c1d78489b482 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.721410 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aeea4-6043-4f33-8fa5-c1d78489b482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:50.722401 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e3edf-7082-4475-bc6f-9d582dd00a1d admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:50.724636 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aeea4-6043-4f33-8fa5-c1d78489b482 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:50.731941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:50.737797 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e3edf-7082-4475-bc6f-9d582dd00a1d admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:50.741827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812d268-8e4f-483c-a486-5b33181be43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:50.742476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812d268-8e4f-483c-a486-5b33181be43a admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:50.742762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812d268-8e4f-483c-a486-5b33181be43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:50.743032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812d268-8e4f-483c-a486-5b33181be43a admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:50.743736 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812d268-8e4f-483c-a486-5b33181be43a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:50.745651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812d268-8e4f-483c-a486-5b33181be43a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:50.888713 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1362/2722] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:50 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:50.893029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aeea4-6043-4f33-8fa5-c1d78489b482 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:50.922665 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1361/2723] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:50 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:50.937764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812d268-8e4f-483c-a486-5b33181be43a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:50.967048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aeea4-6043-4f33-8fa5-c1d78489b482 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:50.987480 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:51.024506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812d268-8e4f-483c-a486-5b33181be43a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.038558 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c4533-ffa9-4221-bf8a-7fcbd5410334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.038759 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d07c8-cf1c-4cd8-abf9-b23bcc9f7f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.039185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c4533-ffa9-4221-bf8a-7fcbd5410334 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.039327 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d07c8-cf1c-4cd8-abf9-b23bcc9f7f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.039497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c4533-ffa9-4221-bf8a-7fcbd5410334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.039618 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d07c8-cf1c-4cd8-abf9-b23bcc9f7f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.039710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c4533-ffa9-4221-bf8a-7fcbd5410334 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.039806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d07c8-cf1c-4cd8-abf9-b23bcc9f7f38 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.040375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d07c8-cf1c-4cd8-abf9-b23bcc9f7f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.040501 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c4533-ffa9-4221-bf8a-7fcbd5410334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.042341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c4533-ffa9-4221-bf8a-7fcbd5410334 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.042711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d07c8-cf1c-4cd8-abf9-b23bcc9f7f38 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.152318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1362/2725] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:50 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:51.153164 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1363/2724] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:50 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:51.156609 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c4533-ffa9-4221-bf8a-7fcbd5410334 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.157619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d07c8-cf1c-4cd8-abf9-b23bcc9f7f38 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.168323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d07c8-cf1c-4cd8-abf9-b23bcc9f7f38 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.168492 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c4533-ffa9-4221-bf8a-7fcbd5410334 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.179919 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f29b7-c559-4275-8825-141bffbae349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.180361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd528f5-0172-4877-b143-2812f8117226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.180593 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f29b7-c559-4275-8825-141bffbae349 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.180873 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f29b7-c559-4275-8825-141bffbae349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.181141 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f29b7-c559-4275-8825-141bffbae349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.181688 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd528f5-0172-4877-b143-2812f8117226 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.181829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f29b7-c559-4275-8825-141bffbae349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.182297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd528f5-0172-4877-b143-2812f8117226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.182790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd528f5-0172-4877-b143-2812f8117226 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.183966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd528f5-0172-4877-b143-2812f8117226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.184902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f29b7-c559-4275-8825-141bffbae349 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.186492 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd528f5-0172-4877-b143-2812f8117226 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.197718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1363/2726] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:51.205295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1364/2727] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:51.205520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd528f5-0172-4877-b143-2812f8117226 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.208445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f29b7-c559-4275-8825-141bffbae349 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.213536 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd528f5-0172-4877-b143-2812f8117226 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.218821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb051b4-0a62-4090-b12f-36a0feeae8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.219430 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb051b4-0a62-4090-b12f-36a0feeae8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.219714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb051b4-0a62-4090-b12f-36a0feeae8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.220192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb051b4-0a62-4090-b12f-36a0feeae8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.220846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb051b4-0a62-4090-b12f-36a0feeae8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.222782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb051b4-0a62-4090-b12f-36a0feeae8d5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.231198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f29b7-c559-4275-8825-141bffbae349 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.231198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67bc0-f9b5-4eae-92cc-61271ebb7110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.231198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67bc0-f9b5-4eae-92cc-61271ebb7110 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.231585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67bc0-f9b5-4eae-92cc-61271ebb7110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.231585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f67bc0-f9b5-4eae-92cc-61271ebb7110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.232198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f67bc0-f9b5-4eae-92cc-61271ebb7110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.233792 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f67bc0-f9b5-4eae-92cc-61271ebb7110 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.234778 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1364/2728] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:51.239445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb051b4-0a62-4090-b12f-36a0feeae8d5 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.247782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1365/2729] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:51.251936 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb051b4-0a62-4090-b12f-36a0feeae8d5 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.252168 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67bc0-f9b5-4eae-92cc-61271ebb7110 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.257354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef58e5f-7832-4212-ac43-57133bb6d786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.258074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58e5f-7832-4212-ac43-57133bb6d786 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.258354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58e5f-7832-4212-ac43-57133bb6d786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.258644 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef58e5f-7832-4212-ac43-57133bb6d786 admin admin] PATH_INFO: `/v3/projects/e3d88aa0e09347619cc61ad3c2cd9a0c/users/7af4b79d65174412afa604291fd8c937/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.260783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:51.267836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f67bc0-f9b5-4eae-92cc-61271ebb7110 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.273920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225349c4-627c-475a-81dd-d572938571cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.274599 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225349c4-627c-475a-81dd-d572938571cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.274764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef58e5f-7832-4212-ac43-57133bb6d786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d88aa0e09347619cc61ad3c2cd9a0c, user_id=7af4b79d65174412afa604291fd8c937, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.274879 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225349c4-627c-475a-81dd-d572938571cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.275134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225349c4-627c-475a-81dd-d572938571cd admin admin] PATH_INFO: `/v3/projects/1eab7f8446b244078ae374f20ce73781/users/7fcce86f9874449ea29793d5621e9d9b/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.277416 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef58e5f-7832-4212-ac43-57133bb6d786 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.291635 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225349c4-627c-475a-81dd-d572938571cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eab7f8446b244078ae374f20ce73781, user_id=7fcce86f9874449ea29793d5621e9d9b, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.294682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225349c4-627c-475a-81dd-d572938571cd admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.424741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1365/2730] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:51 2022] PUT /identity/v3/projects/e3d88aa0e09347619cc61ad3c2cd9a0c/users/7af4b79d65174412afa604291fd8c937/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:51.438145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757e05-aedf-4575-942f-201695e3665c None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.438429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757e05-aedf-4575-942f-201695e3665c None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.438701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757e05-aedf-4575-942f-201695e3665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.473803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1366/2731] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:51 2022] PUT /identity/v3/projects/1eab7f8446b244078ae374f20ce73781/users/7fcce86f9874449ea29793d5621e9d9b/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:51.474014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-19757e05-aedf-4575-942f-201695e3665c None None] MFA Rules not processed for user `7af4b79d65174412afa604291fd8c937`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:51.474014 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-19757e05-aedf-4575-942f-201695e3665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:51.475999 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758582c-8e67-47d4-9355-9b458669ec96 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.476446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758582c-8e67-47d4-9355-9b458669ec96 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.476868 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758582c-8e67-47d4-9355-9b458669ec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.509257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e758582c-8e67-47d4-9355-9b458669ec96 None None] MFA Rules not processed for user `7fcce86f9874449ea29793d5621e9d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:51.510515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e758582c-8e67-47d4-9355-9b458669ec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:51.541323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1366/2732] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:51.546767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19757e05-aedf-4575-942f-201695e3665c None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.578147 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1367/2733] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:51.600456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758582c-8e67-47d4-9355-9b458669ec96 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.600456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e758582c-8e67-47d4-9355-9b458669ec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:51.619677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19757e05-aedf-4575-942f-201695e3665c None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.626036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c00012-3972-4f1e-9114-6d60133d8581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.626720 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c00012-3972-4f1e-9114-6d60133d8581 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.627068 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c00012-3972-4f1e-9114-6d60133d8581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.627548 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c00012-3972-4f1e-9114-6d60133d8581 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.628249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c00012-3972-4f1e-9114-6d60133d8581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.630520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c00012-3972-4f1e-9114-6d60133d8581 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.662376 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758582c-8e67-47d4-9355-9b458669ec96 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.666176 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9419e25-12da-4106-b8e1-1a6a7be6ae53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a16e6246fb4693b044bf939bce8244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.666781 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419e25-12da-4106-b8e1-1a6a7be6ae53 service glance] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.667057 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419e25-12da-4106-b8e1-1a6a7be6ae53 service glance] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.667323 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9419e25-12da-4106-b8e1-1a6a7be6ae53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.676805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9419e25-12da-4106-b8e1-1a6a7be6ae53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.678205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9419e25-12da-4106-b8e1-1a6a7be6ae53 service glance] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.688482 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1368/2734] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:51.701001 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:51.743214 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1367/2735] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:51 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:51.747644 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9419e25-12da-4106-b8e1-1a6a7be6ae53 service glance] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.760831 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9419e25-12da-4106-b8e1-1a6a7be6ae53 service glance] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.830269 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17f57-a303-41e0-8cdd-6791b4a3e30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.833276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17f57-a303-41e0-8cdd-6791b4a3e30d admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.833276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17f57-a303-41e0-8cdd-6791b4a3e30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.833276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17f57-a303-41e0-8cdd-6791b4a3e30d admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.833276 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17f57-a303-41e0-8cdd-6791b4a3e30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.834050 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17f57-a303-41e0-8cdd-6791b4a3e30d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.940590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:51.951327 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1369/2736] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:51 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:51.955923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c00012-3972-4f1e-9114-6d60133d8581 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:51.973243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c00012-3972-4f1e-9114-6d60133d8581 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:51.978249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2acbf-b59b-415f-8dc0-7617d89e264a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:51.978993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2acbf-b59b-415f-8dc0-7617d89e264a admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:51.979375 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2acbf-b59b-415f-8dc0-7617d89e264a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:51.979716 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2acbf-b59b-415f-8dc0-7617d89e264a admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:51.980434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2acbf-b59b-415f-8dc0-7617d89e264a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:51.982879 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2acbf-b59b-415f-8dc0-7617d89e264a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:51.993717 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1368/2737] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:51.998137 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17f57-a303-41e0-8cdd-6791b4a3e30d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:52.008942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17f57-a303-41e0-8cdd-6791b4a3e30d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:52.014577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df2c0b-e1ca-4a3a-a841-e6b47e2ebba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:52.015961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df2c0b-e1ca-4a3a-a841-e6b47e2ebba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:52.015961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df2c0b-e1ca-4a3a-a841-e6b47e2ebba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:52.015961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df2c0b-e1ca-4a3a-a841-e6b47e2ebba4 admin admin] PATH_INFO: `/v3/projects/c8f7101a40fd491c83ca6380c9428f6b/users/faf5af1578a94251a3d8a92357929046/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:52.031308 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df2c0b-e1ca-4a3a-a841-e6b47e2ebba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f7101a40fd491c83ca6380c9428f6b, user_id=faf5af1578a94251a3d8a92357929046, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:52.033990 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8df2c0b-e1ca-4a3a-a841-e6b47e2ebba4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:52.158726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1370/2738] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:51 2022] PUT /identity/v3/projects/c8f7101a40fd491c83ca6380c9428f6b/users/faf5af1578a94251a3d8a92357929046/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:52.162554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2acbf-b59b-415f-8dc0-7617d89e264a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:52.172905 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2acbf-b59b-415f-8dc0-7617d89e264a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:52.252913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a0476-7d40-4ab7-8ea4-ae6f29dd3590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:52.252913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a0476-7d40-4ab7-8ea4-ae6f29dd3590 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:52.252913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a0476-7d40-4ab7-8ea4-ae6f29dd3590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:52.252913 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a0476-7d40-4ab7-8ea4-ae6f29dd3590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:52.253502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a0476-7d40-4ab7-8ea4-ae6f29dd3590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:52.253502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a0476-7d40-4ab7-8ea4-ae6f29dd3590 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:52.265620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1369/2739] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:52.271788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df2c0b-e1ca-4a3a-a841-e6b47e2ebba4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:52.283630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df2c0b-e1ca-4a3a-a841-e6b47e2ebba4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:52.290393 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f48afa-cc66-47e0-bb7b-e5fae67849bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:52.291068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f48afa-cc66-47e0-bb7b-e5fae67849bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:52.291399 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f48afa-cc66-47e0-bb7b-e5fae67849bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:52.291675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f48afa-cc66-47e0-bb7b-e5fae67849bc admin admin] PATH_INFO: `/v3/projects/c8f7101a40fd491c83ca6380c9428f6b/users/faf5af1578a94251a3d8a92357929046/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:52.294426 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f48afa-cc66-47e0-bb7b-e5fae67849bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f7101a40fd491c83ca6380c9428f6b, user_id=faf5af1578a94251a3d8a92357929046, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:52.297079 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f48afa-cc66-47e0-bb7b-e5fae67849bc admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:52.320621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1371/2740] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:52 2022] PUT /identity/v3/projects/c8f7101a40fd491c83ca6380c9428f6b/users/faf5af1578a94251a3d8a92357929046/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:52.330346 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af919c-2d42-42db-b194-0174ff48ca86 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:52.330664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af919c-2d42-42db-b194-0174ff48ca86 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:52.330938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af919c-2d42-42db-b194-0174ff48ca86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:52.362795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-57af919c-2d42-42db-b194-0174ff48ca86 None None] MFA Rules not processed for user `faf5af1578a94251a3d8a92357929046`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:52.364026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-57af919c-2d42-42db-b194-0174ff48ca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:52.454463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1370/2741] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:52.489199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:52.582560 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f48afa-cc66-47e0-bb7b-e5fae67849bc admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:52.584591 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-96f48afa-cc66-47e0-bb7b-e5fae67849bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:52.650461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f48afa-cc66-47e0-bb7b-e5fae67849bc admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:52.654685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325e5ed-3b3b-4e4c-84bb-f48c9d818c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:52.655299 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325e5ed-3b3b-4e4c-84bb-f48c9d818c31 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:52.655574 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325e5ed-3b3b-4e4c-84bb-f48c9d818c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:52.655853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325e5ed-3b3b-4e4c-84bb-f48c9d818c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:52.667065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325e5ed-3b3b-4e4c-84bb-f48c9d818c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:52.669093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325e5ed-3b3b-4e4c-84bb-f48c9d818c31 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:52.680372 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1372/2742] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:52.874402 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af919c-2d42-42db-b194-0174ff48ca86 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:52.875920 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-57af919c-2d42-42db-b194-0174ff48ca86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:52.889579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af919c-2d42-42db-b194-0174ff48ca86 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:52.894076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565f6aa-c35f-4745-ab95-d5f418370b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:52.894815 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565f6aa-c35f-4745-ab95-d5f418370b9e service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:52.895100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565f6aa-c35f-4745-ab95-d5f418370b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:52.900902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565f6aa-c35f-4745-ab95-d5f418370b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:52.975659 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565f6aa-c35f-4745-ab95-d5f418370b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:52.977256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565f6aa-c35f-4745-ab95-d5f418370b9e service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:52.979938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:52.988055 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1371/2743] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:53.618588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325e5ed-3b3b-4e4c-84bb-f48c9d818c31 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:53.701561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325e5ed-3b3b-4e4c-84bb-f48c9d818c31 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:53.707364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:53.708228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:53.708571 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:53.714555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] PATH_INFO: `/v3/users/7af4b79d65174412afa604291fd8c937` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:53.714555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af4b79d65174412afa604291fd8c937)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:53.714555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:53.916721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af4b79d65174412afa604291fd8c937'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.927861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af4b79d65174412afa604291fd8c937'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:53.928500 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af4b79d65174412afa604291fd8c937'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.019159 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af4b79d65174412afa604291fd8c937'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.033644 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af4b79d65174412afa604291fd8c937'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.048028 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1373/2744] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:53 2022] DELETE /identity/v3/users/7af4b79d65174412afa604291fd8c937 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:54.052629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b07d3e-b88c-41bc-9aac-8a2537bf282a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.053208 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b07d3e-b88c-41bc-9aac-8a2537bf282a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.053208 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b07d3e-b88c-41bc-9aac-8a2537bf282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.089559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-77b07d3e-b88c-41bc-9aac-8a2537bf282a None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:54.089559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-77b07d3e-b88c-41bc-9aac-8a2537bf282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.107764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:54.162072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1372/2745] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:54.171169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:54.172824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.263862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:54.272152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f6e60-0cea-4b02-9182-d5b5a88adc06 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:54.276411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593a7c9-62ee-46d0-a8aa-213a113d673f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:54.277025 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a7c9-62ee-46d0-a8aa-213a113d673f service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.277301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a7c9-62ee-46d0-a8aa-213a113d673f service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.277565 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a7c9-62ee-46d0-a8aa-213a113d673f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.289844 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593a7c9-62ee-46d0-a8aa-213a113d673f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:54.292451 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593a7c9-62ee-46d0-a8aa-213a113d673f service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:54.307832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1374/2746] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:54.320107 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b07d3e-b88c-41bc-9aac-8a2537bf282a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:54.321965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-77b07d3e-b88c-41bc-9aac-8a2537bf282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.335165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b07d3e-b88c-41bc-9aac-8a2537bf282a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:54.341310 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:54.342730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.343146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.343595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] PATH_INFO: `/v3/users/75f42509ac3d44bfb53f57ffc84294c5` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.345284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f42509ac3d44bfb53f57ffc84294c5)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:54.347385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:54.582577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f42509ac3d44bfb53f57ffc84294c5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.593203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f42509ac3d44bfb53f57ffc84294c5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.594258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f42509ac3d44bfb53f57ffc84294c5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.706284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f42509ac3d44bfb53f57ffc84294c5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.707373 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f42509ac3d44bfb53f57ffc84294c5'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:54.734842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1373/2747] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:54 2022] DELETE /identity/v3/users/75f42509ac3d44bfb53f57ffc84294c5 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:54.739843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df773-3d5f-4358-a9d1-47b20897befc None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.740368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df773-3d5f-4358-a9d1-47b20897befc None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.744101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5df773-3d5f-4358-a9d1-47b20897befc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.762285 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-ea5df773-3d5f-4358-a9d1-47b20897befc None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:54.763580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ea5df773-3d5f-4358-a9d1-47b20897befc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.849639 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:54.851550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.862569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1375/2748] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:54.883648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c25b4d-cbae-415d-8cab-dc0987b3a1aa admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:54.901610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:54.902301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.902663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.903508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] PATH_INFO: `/v3/projects/e3d88aa0e09347619cc61ad3c2cd9a0c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:54.905143 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5df773-3d5f-4358-a9d1-47b20897befc None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:54.905290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d88aa0e09347619cc61ad3c2cd9a0c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:54.906628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-ea5df773-3d5f-4358-a9d1-47b20897befc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:54.907565 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:54.987924 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5df773-3d5f-4358-a9d1-47b20897befc None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:54.992413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcaf7b-e3df-4774-acfb-0275114269e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:54.993248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcaf7b-e3df-4774-acfb-0275114269e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:54.993555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcaf7b-e3df-4774-acfb-0275114269e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:54.993996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcaf7b-e3df-4774-acfb-0275114269e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.005020 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcaf7b-e3df-4774-acfb-0275114269e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:55.006766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dcaf7b-e3df-4774-acfb-0275114269e2 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.017403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1376/2749] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:55.052249 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d88aa0e09347619cc61ad3c2cd9a0c', 'request_id': 'req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.064382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d88aa0e09347619cc61ad3c2cd9a0c', 'request_id': 'req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.078203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d88aa0e09347619cc61ad3c2cd9a0c', 'request_id': 'req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.226279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] The token cache is being invalidate because project e3d88aa0e09347619cc61ad3c2cd9a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:55.226902 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.227640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.229252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1374/2750] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:54 2022] DELETE /identity/v3/projects/e3d88aa0e09347619cc61ad3c2cd9a0c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:55.234307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcaf7b-e3df-4774-acfb-0275114269e2 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:55.244291 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcaf7b-e3df-4774-acfb-0275114269e2 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:55.311961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:55.312621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.312902 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.313195 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] PATH_INFO: `/v3/users/faf5af1578a94251a3d8a92357929046` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.314375 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf5af1578a94251a3d8a92357929046)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:55.316373 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.541908 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:55.556528 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf5af1578a94251a3d8a92357929046'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.564499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf5af1578a94251a3d8a92357929046'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.565160 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf5af1578a94251a3d8a92357929046'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.591436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:55.593174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:55.607798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc710e-4bf3-4575-80ad-4a722c9ebb48 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:55.612591 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:55.613225 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:55.613552 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:55.613896 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] PATH_INFO: `/v3/projects/79d87601f8254bae9aa505877281104e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:55.615043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d87601f8254bae9aa505877281104e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:55.616909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:55.636610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:55.669662 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf5af1578a94251a3d8a92357929046'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.682420 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf5af1578a94251a3d8a92357929046'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.689116 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1377/2751] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:55 2022] DELETE /identity/v3/users/faf5af1578a94251a3d8a92357929046 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:55.850769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d87601f8254bae9aa505877281104e', 'request_id': 'req-1de18c0e-662b-4af1-a860-0a88def3e792'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.858763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d87601f8254bae9aa505877281104e', 'request_id': 'req-1de18c0e-662b-4af1-a860-0a88def3e792'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.866839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d87601f8254bae9aa505877281104e', 'request_id': 'req-1de18c0e-662b-4af1-a860-0a88def3e792'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.988578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] The token cache is being invalidate because project 79d87601f8254bae9aa505877281104e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:55.989772 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.990223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:55.992829 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1375/2752] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:55 2022] DELETE /identity/v3/projects/79d87601f8254bae9aa505877281104e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:55.997279 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:55.999014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:56.090038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740008ce-1de5-4431-aeb4-77597446e090 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:56.168595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afccf4d-63bf-49bf-844b-a8c9f3455a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:56.169413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afccf4d-63bf-49bf-844b-a8c9f3455a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:56.169753 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afccf4d-63bf-49bf-844b-a8c9f3455a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:56.170140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afccf4d-63bf-49bf-844b-a8c9f3455a0c admin admin] PATH_INFO: `/v3/users/6a67f54e55894db8a1cf0c5597337263` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:56.171378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afccf4d-63bf-49bf-844b-a8c9f3455a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a67f54e55894db8a1cf0c5597337263)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:56.173388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afccf4d-63bf-49bf-844b-a8c9f3455a0c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:56.213309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:56.216254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:56.237636 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de18c0e-662b-4af1-a860-0a88def3e792 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:56.243533 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:56.244587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:56.244946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:56.245516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] PATH_INFO: `/v3/projects/c8f7101a40fd491c83ca6380c9428f6b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:56.247706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f7101a40fd491c83ca6380c9428f6b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:56.249856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:56.389936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5afccf4d-63bf-49bf-844b-a8c9f3455a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a67f54e55894db8a1cf0c5597337263'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:56.391739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f7101a40fd491c83ca6380c9428f6b', 'request_id': 'req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:56.396993 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5afccf4d-63bf-49bf-844b-a8c9f3455a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a67f54e55894db8a1cf0c5597337263'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:56.397732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5afccf4d-63bf-49bf-844b-a8c9f3455a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a67f54e55894db8a1cf0c5597337263'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:56.398620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f7101a40fd491c83ca6380c9428f6b', 'request_id': 'req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:56.400496 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:56.405489 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f7101a40fd491c83ca6380c9428f6b', 'request_id': 'req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:56.458257 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5afccf4d-63bf-49bf-844b-a8c9f3455a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a67f54e55894db8a1cf0c5597337263'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:56.474145 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5afccf4d-63bf-49bf-844b-a8c9f3455a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a67f54e55894db8a1cf0c5597337263'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:56.482056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1378/2753] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:55 2022] DELETE /identity/v3/users/6a67f54e55894db8a1cf0c5597337263 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:56.532118 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] The token cache is being invalidate because project c8f7101a40fd491c83ca6380c9428f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:56.532460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:56.533112 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-c866a6e5-cd86-4fc0-9bfb-2035733e6dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:56.534658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1376/2754] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:56 2022] DELETE /identity/v3/projects/c8f7101a40fd491c83ca6380c9428f6b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:56.539493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfaa39-27b9-4752-86fc-509f226e8422 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:56.539774 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfaa39-27b9-4752-86fc-509f226e8422 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:56.540041 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfaa39-27b9-4752-86fc-509f226e8422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:56.561834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-98bfaa39-27b9-4752-86fc-509f226e8422 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:56.563065 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-98bfaa39-27b9-4752-86fc-509f226e8422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:56.636189 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1379/2755] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:56.650507 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325c045-42c7-49aa-a2fd-c08d31883a78 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:56.650737 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325c045-42c7-49aa-a2fd-c08d31883a78 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:56.651026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325c045-42c7-49aa-a2fd-c08d31883a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:56.671962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-d325c045-42c7-49aa-a2fd-c08d31883a78 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:56.673165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d325c045-42c7-49aa-a2fd-c08d31883a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:56.688503 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1377/2756] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:56.693569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfaa39-27b9-4752-86fc-509f226e8422 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:56.707706 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfaa39-27b9-4752-86fc-509f226e8422 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:56.714307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc73bbc-e035-4fd5-b78f-4bbfcf83f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:56.715836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73bbc-e035-4fd5-b78f-4bbfcf83f7ec admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:56.715836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73bbc-e035-4fd5-b78f-4bbfcf83f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:56.716104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc73bbc-e035-4fd5-b78f-4bbfcf83f7ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:56.717087 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc73bbc-e035-4fd5-b78f-4bbfcf83f7ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:56.717463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc73bbc-e035-4fd5-b78f-4bbfcf83f7ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:56.719305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc73bbc-e035-4fd5-b78f-4bbfcf83f7ec admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:56.739118 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1380/2757] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:43:56.743322 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325c045-42c7-49aa-a2fd-c08d31883a78 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:56.759060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325c045-42c7-49aa-a2fd-c08d31883a78 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:56.764080 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70487d18-283d-48a9-8954-4e54951b3356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:56.764702 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70487d18-283d-48a9-8954-4e54951b3356 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:56.764981 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70487d18-283d-48a9-8954-4e54951b3356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:56.765251 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70487d18-283d-48a9-8954-4e54951b3356 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:56.765989 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70487d18-283d-48a9-8954-4e54951b3356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:56.767903 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70487d18-283d-48a9-8954-4e54951b3356 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:56.856811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1378/2758] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:56 2022] POST /identity/v3/projects => generated 359 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:56.861529 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc73bbc-e035-4fd5-b78f-4bbfcf83f7ec admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:56.873014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc73bbc-e035-4fd5-b78f-4bbfcf83f7ec admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:56.939208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cdba0-e02d-4559-9814-81fbe57a7ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:56.939836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cdba0-e02d-4559-9814-81fbe57a7ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:56.940146 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cdba0-e02d-4559-9814-81fbe57a7ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:56.940418 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0cdba0-e02d-4559-9814-81fbe57a7ab2 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:56.941067 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cdba0-e02d-4559-9814-81fbe57a7ab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:56.943053 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0cdba0-e02d-4559-9814-81fbe57a7ab2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:57.043606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1381/2759] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:56 2022] POST /identity/v3/users => generated 280 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:57.047818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70487d18-283d-48a9-8954-4e54951b3356 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:57.058834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70487d18-283d-48a9-8954-4e54951b3356 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:57.068598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749c645-3774-41b3-88ad-ba666374a4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:57.069303 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749c645-3774-41b3-88ad-ba666374a4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:57.072301 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749c645-3774-41b3-88ad-ba666374a4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:57.072606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749c645-3774-41b3-88ad-ba666374a4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:57.074045 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749c645-3774-41b3-88ad-ba666374a4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:57.076959 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749c645-3774-41b3-88ad-ba666374a4f2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:57.092155 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1379/2760] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:57.093446 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cdba0-e02d-4559-9814-81fbe57a7ab2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:57.104857 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0cdba0-e02d-4559-9814-81fbe57a7ab2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:57.110248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba36ea-18e1-4e60-8e3f-41856c19dae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:57.110897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba36ea-18e1-4e60-8e3f-41856c19dae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:57.111178 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba36ea-18e1-4e60-8e3f-41856c19dae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:57.111448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba36ea-18e1-4e60-8e3f-41856c19dae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:57.112088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba36ea-18e1-4e60-8e3f-41856c19dae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:57.113747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba36ea-18e1-4e60-8e3f-41856c19dae7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:57.134790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1382/2761] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:57.140895 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749c645-3774-41b3-88ad-ba666374a4f2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:57.152161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749c645-3774-41b3-88ad-ba666374a4f2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:57.157342 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967e082-e2af-4d0b-a934-978f94611a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:57.158051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967e082-e2af-4d0b-a934-978f94611a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:57.158360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967e082-e2af-4d0b-a934-978f94611a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:57.158634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967e082-e2af-4d0b-a934-978f94611a80 admin admin] PATH_INFO: `/v3/projects/a3652cd7829544089cc225472b3b6d6a/users/db5c195defa2499fa2e38a97f596b45d/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:57.179982 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967e082-e2af-4d0b-a934-978f94611a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3652cd7829544089cc225472b3b6d6a, user_id=db5c195defa2499fa2e38a97f596b45d, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:57.182844 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967e082-e2af-4d0b-a934-978f94611a80 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:57.290497 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba36ea-18e1-4e60-8e3f-41856c19dae7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:57.292621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-67ba36ea-18e1-4e60-8e3f-41856c19dae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:57.306804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba36ea-18e1-4e60-8e3f-41856c19dae7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:57.317805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:57.319562 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:57.319903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:57.320435 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] PATH_INFO: `/v3/projects/abb09eff11534bfe8ab76757a8e45ef6` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:57.321938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb09eff11534bfe8ab76757a8e45ef6)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:57.327764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1380/2762] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:57 2022] PUT /identity/v3/projects/a3652cd7829544089cc225472b3b6d6a/users/db5c195defa2499fa2e38a97f596b45d/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:57.330491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:57.339036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db17f6-2688-4a4f-975a-e8b36898a7a9 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:57.339313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db17f6-2688-4a4f-975a-e8b36898a7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:57.339757 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db17f6-2688-4a4f-975a-e8b36898a7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:57.383102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-07db17f6-2688-4a4f-975a-e8b36898a7a9 None None] MFA Rules not processed for user `db5c195defa2499fa2e38a97f596b45d`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:57.384543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-07db17f6-2688-4a4f-975a-e8b36898a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:57.400832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:57.465952 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:57.474374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1381/2763] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:57.479962 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb09eff11534bfe8ab76757a8e45ef6', 'request_id': 'req-9a472ddc-fde8-49a9-9913-4e8dc2211d98'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:57.487351 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb09eff11534bfe8ab76757a8e45ef6', 'request_id': 'req-9a472ddc-fde8-49a9-9913-4e8dc2211d98'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:57.510640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db17f6-2688-4a4f-975a-e8b36898a7a9 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:57.512018 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-07db17f6-2688-4a4f-975a-e8b36898a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:57.568044 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb09eff11534bfe8ab76757a8e45ef6', 'request_id': 'req-9a472ddc-fde8-49a9-9913-4e8dc2211d98'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:57.577864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db17f6-2688-4a4f-975a-e8b36898a7a9 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:57.582015 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] The token cache is being invalidate because project abb09eff11534bfe8ab76757a8e45ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:57.582313 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:57.582994 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9a472ddc-fde8-49a9-9913-4e8dc2211d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:57.584763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1383/2764] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:57 2022] DELETE /identity/v3/projects/abb09eff11534bfe8ab76757a8e45ef6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:57.589459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0106b-a9ef-4aaa-a5af-3de016460af1 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:57.589788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0106b-a9ef-4aaa-a5af-3de016460af1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:57.590097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0106b-a9ef-4aaa-a5af-3de016460af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:57.610917 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-47f0106b-a9ef-4aaa-a5af-3de016460af1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:57.612129 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-47f0106b-a9ef-4aaa-a5af-3de016460af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:57.634529 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4923c0-85b5-4c97-9eb6-a5a7938585d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:57.635166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4923c0-85b5-4c97-9eb6-a5a7938585d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:57.635474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4923c0-85b5-4c97-9eb6-a5a7938585d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:57.635745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4923c0-85b5-4c97-9eb6-a5a7938585d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:57.638415 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-da4923c0-85b5-4c97-9eb6-a5a7938585d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:57.680161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1384/2765] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:57.689039 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d90-6fc5-4536-98c5-087efe192415 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:57.689329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d90-6fc5-4536-98c5-087efe192415 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:57.689602 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613d90-6fc5-4536-98c5-087efe192415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:57.710219 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4923c0-85b5-4c97-9eb6-a5a7938585d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:57.710463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-e0613d90-6fc5-4536-98c5-087efe192415 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:57.711633 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4923c0-85b5-4c97-9eb6-a5a7938585d8 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:57.711754 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-e0613d90-6fc5-4536-98c5-087efe192415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:57.720338 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1385/2766] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:57.722563 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1382/2767] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:43:57.725853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613d90-6fc5-4536-98c5-087efe192415 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:57.735830 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0613d90-6fc5-4536-98c5-087efe192415 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:57.740170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4923c0-85b5-4c97-9eb6-a5a7938585d8 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:57.741549 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-da4923c0-85b5-4c97-9eb6-a5a7938585d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:57.741714 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d099f-7929-409a-b41c-c97855dfb111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:57.742464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d099f-7929-409a-b41c-c97855dfb111 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:57.742797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d099f-7929-409a-b41c-c97855dfb111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:57.743106 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d099f-7929-409a-b41c-c97855dfb111 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:57.743779 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d099f-7929-409a-b41c-c97855dfb111 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:57.744107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d099f-7929-409a-b41c-c97855dfb111 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:57.745810 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d099f-7929-409a-b41c-c97855dfb111 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:57.757464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4923c0-85b5-4c97-9eb6-a5a7938585d8 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:57.760514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1386/2768] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:43:57.762434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed790d9c-007c-4751-94af-22b3e8077914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:57.763066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790d9c-007c-4751-94af-22b3e8077914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:57.763361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790d9c-007c-4751-94af-22b3e8077914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:57.763612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed790d9c-007c-4751-94af-22b3e8077914 admin admin] PATH_INFO: `/v3/users/db5c195defa2499fa2e38a97f596b45d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:57.764841 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed790d9c-007c-4751-94af-22b3e8077914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5c195defa2499fa2e38a97f596b45d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:57.764954 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d099f-7929-409a-b41c-c97855dfb111 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:57.766781 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed790d9c-007c-4751-94af-22b3e8077914 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:57.777149 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d099f-7929-409a-b41c-c97855dfb111 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:57.785813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071589cd-10e6-4edd-80d6-56785061da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:57.786450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071589cd-10e6-4edd-80d6-56785061da09 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:57.786724 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071589cd-10e6-4edd-80d6-56785061da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:57.786988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071589cd-10e6-4edd-80d6-56785061da09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:57.787624 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071589cd-10e6-4edd-80d6-56785061da09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:57.789510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071589cd-10e6-4edd-80d6-56785061da09 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:57.790395 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:57.909416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1387/2769] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:57 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:57.913337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071589cd-10e6-4edd-80d6-56785061da09 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:57.948106 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ed790d9c-007c-4751-94af-22b3e8077914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5c195defa2499fa2e38a97f596b45d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:57.956597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ed790d9c-007c-4751-94af-22b3e8077914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5c195defa2499fa2e38a97f596b45d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:57.957332 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ed790d9c-007c-4751-94af-22b3e8077914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5c195defa2499fa2e38a97f596b45d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:57.999223 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071589cd-10e6-4edd-80d6-56785061da09 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:58.008566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311524d1-1b53-49a1-b5d5-132188c6b3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:58.009228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311524d1-1b53-49a1-b5d5-132188c6b3db admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:58.009510 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311524d1-1b53-49a1-b5d5-132188c6b3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:58.009781 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311524d1-1b53-49a1-b5d5-132188c6b3db admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:58.010458 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311524d1-1b53-49a1-b5d5-132188c6b3db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:58.012433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311524d1-1b53-49a1-b5d5-132188c6b3db admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:58.025745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ed790d9c-007c-4751-94af-22b3e8077914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5c195defa2499fa2e38a97f596b45d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:58.026471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ed790d9c-007c-4751-94af-22b3e8077914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5c195defa2499fa2e38a97f596b45d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:58.053577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1383/2770] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:43:57 2022] DELETE /identity/v3/users/db5c195defa2499fa2e38a97f596b45d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:58.057802 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b349e7-9d36-45c4-a95b-8d00e888218e None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:58.058121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b349e7-9d36-45c4-a95b-8d00e888218e None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:58.058399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b349e7-9d36-45c4-a95b-8d00e888218e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:58.084475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-24b349e7-9d36-45c4-a95b-8d00e888218e None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:58.085685 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-24b349e7-9d36-45c4-a95b-8d00e888218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:58.134595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1388/2771] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:57 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:58.139719 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311524d1-1b53-49a1-b5d5-132188c6b3db admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:58.141703 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-311524d1-1b53-49a1-b5d5-132188c6b3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:58.159349 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1384/2772] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:58.159685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311524d1-1b53-49a1-b5d5-132188c6b3db admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:58.172295 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b349e7-9d36-45c4-a95b-8d00e888218e None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:58.173799 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-24b349e7-9d36-45c4-a95b-8d00e888218e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:58.176056 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560e6f6-37e1-47cd-a04d-b0a8ea814260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:58.176691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560e6f6-37e1-47cd-a04d-b0a8ea814260 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:58.176961 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560e6f6-37e1-47cd-a04d-b0a8ea814260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:58.177230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560e6f6-37e1-47cd-a04d-b0a8ea814260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:58.177906 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560e6f6-37e1-47cd-a04d-b0a8ea814260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:58.179634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560e6f6-37e1-47cd-a04d-b0a8ea814260 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:58.191849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1389/2773] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:58.200682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560e6f6-37e1-47cd-a04d-b0a8ea814260 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:58.206769 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:58.212513 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560e6f6-37e1-47cd-a04d-b0a8ea814260 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:58.218746 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9590b6-b2e9-4cf7-b0fe-0a16598acdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:58.222456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9590b6-b2e9-4cf7-b0fe-0a16598acdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:58.222456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9590b6-b2e9-4cf7-b0fe-0a16598acdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:58.222456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9590b6-b2e9-4cf7-b0fe-0a16598acdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:58.222456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9590b6-b2e9-4cf7-b0fe-0a16598acdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:58.222456 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9590b6-b2e9-4cf7-b0fe-0a16598acdd4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:58.235102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1390/2774] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:58.239337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9590b6-b2e9-4cf7-b0fe-0a16598acdd4 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:58.241023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b349e7-9d36-45c4-a95b-8d00e888218e None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:58.245270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be929bd-ac06-4117-9303-36c1840a7c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:58.245899 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be929bd-ac06-4117-9303-36c1840a7c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:58.246195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be929bd-ac06-4117-9303-36c1840a7c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:58.246505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be929bd-ac06-4117-9303-36c1840a7c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:58.249348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9590b6-b2e9-4cf7-b0fe-0a16598acdd4 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:58.254064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf7606-7a0c-43d7-9925-2afe519a75fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:58.254720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf7606-7a0c-43d7-9925-2afe519a75fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:58.254998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf7606-7a0c-43d7-9925-2afe519a75fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:58.255533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf7606-7a0c-43d7-9925-2afe519a75fb admin admin] PATH_INFO: `/v3/projects/1ec3ff7df82b45fbb352fa2e6ab5d45e/users/af92e071c4c6440ca65abf933203748d/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:58.256827 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be929bd-ac06-4117-9303-36c1840a7c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:58.258279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be929bd-ac06-4117-9303-36c1840a7c46 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:58.269847 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1385/2775] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:43:58.272951 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf7606-7a0c-43d7-9925-2afe519a75fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec3ff7df82b45fbb352fa2e6ab5d45e, user_id=af92e071c4c6440ca65abf933203748d, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:58.275943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf7606-7a0c-43d7-9925-2afe519a75fb admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:58.380751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1391/2776] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:58 2022] PUT /identity/v3/projects/1ec3ff7df82b45fbb352fa2e6ab5d45e/users/af92e071c4c6440ca65abf933203748d/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:58.393247 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d07a-3d40-45d1-89eb-d75a97760ace None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:58.393820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d07a-3d40-45d1-89eb-d75a97760ace None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:58.393820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9d07a-3d40-45d1-89eb-d75a97760ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:58.423592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-09f9d07a-3d40-45d1-89eb-d75a97760ace None None] MFA Rules not processed for user `af92e071c4c6440ca65abf933203748d`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:58.424824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-09f9d07a-3d40-45d1-89eb-d75a97760ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:58.460161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:58.511852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1386/2777] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:58.518037 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf7606-7a0c-43d7-9925-2afe519a75fb admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:58.588596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf7606-7a0c-43d7-9925-2afe519a75fb admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:58.593693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8c3ed-ac38-4e44-aaa6-ddec5ee01879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:58.594348 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8c3ed-ac38-4e44-aaa6-ddec5ee01879 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:58.594625 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8c3ed-ac38-4e44-aaa6-ddec5ee01879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:58.594894 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8c3ed-ac38-4e44-aaa6-ddec5ee01879 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:58.595543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8c3ed-ac38-4e44-aaa6-ddec5ee01879 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:58.597461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8c3ed-ac38-4e44-aaa6-ddec5ee01879 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:58.753472 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1392/2778] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:58 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:58.758477 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9d07a-3d40-45d1-89eb-d75a97760ace None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:58.769673 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9d07a-3d40-45d1-89eb-d75a97760ace None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:58.834063 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd5445-52f2-45b2-bc54-1853b3c6592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:58.834687 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd5445-52f2-45b2-bc54-1853b3c6592b admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:58.834968 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd5445-52f2-45b2-bc54-1853b3c6592b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:58.835240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd5445-52f2-45b2-bc54-1853b3c6592b admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:58.836029 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd5445-52f2-45b2-bc54-1853b3c6592b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:58.837986 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd5445-52f2-45b2-bc54-1853b3c6592b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:58.845453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8c3ed-ac38-4e44-aaa6-ddec5ee01879 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:58.847498 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8fc8c3ed-ac38-4e44-aaa6-ddec5ee01879 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:58.865357 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8c3ed-ac38-4e44-aaa6-ddec5ee01879 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:58.870153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:58.871046 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:58.871172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:58.871416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] PATH_INFO: `/v3/projects/a3652cd7829544089cc225472b3b6d6a` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:58.872689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3652cd7829544089cc225472b3b6d6a)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:58.874596 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:58.938762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1387/2779] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:58 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:43:58.942764 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd5445-52f2-45b2-bc54-1853b3c6592b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:58.953910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd5445-52f2-45b2-bc54-1853b3c6592b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:58.958620 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527febd-1e7e-4329-89cd-4df96633c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:58.959288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527febd-1e7e-4329-89cd-4df96633c53c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:58.959569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527febd-1e7e-4329-89cd-4df96633c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:58.959842 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527febd-1e7e-4329-89cd-4df96633c53c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:58.960494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527febd-1e7e-4329-89cd-4df96633c53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:58.962165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527febd-1e7e-4329-89cd-4df96633c53c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:58.977123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1388/2780] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:58.977400 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3652cd7829544089cc225472b3b6d6a', 'request_id': 'req-00c778ad-d694-4a2a-b804-8377fce50f3d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:58.978638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527febd-1e7e-4329-89cd-4df96633c53c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:58.982408 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3652cd7829544089cc225472b3b6d6a', 'request_id': 'req-00c778ad-d694-4a2a-b804-8377fce50f3d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:58.989215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527febd-1e7e-4329-89cd-4df96633c53c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.051411 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda21a04-7b56-4d02-be72-2a3cf4e6a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.052023 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda21a04-7b56-4d02-be72-2a3cf4e6a72f admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.052304 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda21a04-7b56-4d02-be72-2a3cf4e6a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.052578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda21a04-7b56-4d02-be72-2a3cf4e6a72f admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.053837 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda21a04-7b56-4d02-be72-2a3cf4e6a72f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.055453 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda21a04-7b56-4d02-be72-2a3cf4e6a72f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.067979 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1389/2781] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:59.069055 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3652cd7829544089cc225472b3b6d6a', 'request_id': 'req-00c778ad-d694-4a2a-b804-8377fce50f3d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:59.071298 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda21a04-7b56-4d02-be72-2a3cf4e6a72f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.083627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] The token cache is being invalidate because project a3652cd7829544089cc225472b3b6d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:43:59.084883 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda21a04-7b56-4d02-be72-2a3cf4e6a72f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.085094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:59.085094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00c778ad-d694-4a2a-b804-8377fce50f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:43:59.088422 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1393/2782] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:43:58 2022] DELETE /identity/v3/projects/a3652cd7829544089cc225472b3b6d6a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:59.088730 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85081a1-d3e6-4d78-a700-660767a842a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.089446 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85081a1-d3e6-4d78-a700-660767a842a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.090036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85081a1-d3e6-4d78-a700-660767a842a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.090036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85081a1-d3e6-4d78-a700-660767a842a5 admin admin] PATH_INFO: `/v3/projects/4488499caac7474c9a9b69937c266664/users/002fff6d98104774bb3c06b138ffa110/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.094546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811916-bf2b-447b-9cff-429e5fd759ec None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.094834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811916-bf2b-447b-9cff-429e5fd759ec None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.095094 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6811916-bf2b-447b-9cff-429e5fd759ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.113288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85081a1-d3e6-4d78-a700-660767a842a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4488499caac7474c9a9b69937c266664, user_id=002fff6d98104774bb3c06b138ffa110, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.116868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85081a1-d3e6-4d78-a700-660767a842a5 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.124448 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b6811916-bf2b-447b-9cff-429e5fd759ec None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:59.125720 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b6811916-bf2b-447b-9cff-429e5fd759ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:59.135192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1394/2783] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:59.143807 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00734a39-63f0-4bdc-8cd2-fb8521d74d61 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.144091 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00734a39-63f0-4bdc-8cd2-fb8521d74d61 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.144369 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00734a39-63f0-4bdc-8cd2-fb8521d74d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.165835 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-00734a39-63f0-4bdc-8cd2-fb8521d74d61 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:59.167177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-00734a39-63f0-4bdc-8cd2-fb8521d74d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:59.175539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1395/2784] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:59.179800 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00734a39-63f0-4bdc-8cd2-fb8521d74d61 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.189601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00734a39-63f0-4bdc-8cd2-fb8521d74d61 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.194958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2002acd-6387-4e7a-a9a4-6efc34a6e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.195594 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002acd-6387-4e7a-a9a4-6efc34a6e076 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.195890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002acd-6387-4e7a-a9a4-6efc34a6e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.196144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2002acd-6387-4e7a-a9a4-6efc34a6e076 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.196805 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2002acd-6387-4e7a-a9a4-6efc34a6e076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:43:59.197106 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2002acd-6387-4e7a-a9a4-6efc34a6e076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.198761 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2002acd-6387-4e7a-a9a4-6efc34a6e076 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.212097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1396/2785] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:43:59.217546 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2002acd-6387-4e7a-a9a4-6efc34a6e076 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.223938 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1390/2786] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:59 2022] PUT /identity/v3/projects/4488499caac7474c9a9b69937c266664/users/002fff6d98104774bb3c06b138ffa110/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:59.227913 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2002acd-6387-4e7a-a9a4-6efc34a6e076 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.232944 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:59.243624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e61dc-9ad3-40e8-81fb-645ac86d9eb0 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.243912 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e61dc-9ad3-40e8-81fb-645ac86d9eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.244220 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e61dc-9ad3-40e8-81fb-645ac86d9eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.275166 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-018e61dc-9ad3-40e8-81fb-645ac86d9eb0 None None] MFA Rules not processed for user `002fff6d98104774bb3c06b138ffa110`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:59.276399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-018e61dc-9ad3-40e8-81fb-645ac86d9eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:59.281834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:59.294432 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167704a-7cf4-4e96-ba76-6f52421a6f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.297366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167704a-7cf4-4e96-ba76-6f52421a6f47 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.297366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167704a-7cf4-4e96-ba76-6f52421a6f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.297366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167704a-7cf4-4e96-ba76-6f52421a6f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.297366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167704a-7cf4-4e96-ba76-6f52421a6f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.298458 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167704a-7cf4-4e96-ba76-6f52421a6f47 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.345790 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1391/2787] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:43:59.350451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e61dc-9ad3-40e8-81fb-645ac86d9eb0 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.351928 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-018e61dc-9ad3-40e8-81fb-645ac86d9eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:59.366522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e61dc-9ad3-40e8-81fb-645ac86d9eb0 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.371302 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8716505-4a4d-4e5a-b14a-f75b31f508e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.372490 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716505-4a4d-4e5a-b14a-f75b31f508e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.372763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716505-4a4d-4e5a-b14a-f75b31f508e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.373028 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8716505-4a4d-4e5a-b14a-f75b31f508e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.373663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8716505-4a4d-4e5a-b14a-f75b31f508e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.375591 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8716505-4a4d-4e5a-b14a-f75b31f508e3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.393424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1397/2788] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:59 2022] POST /identity/v3/projects => generated 377 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:59.397911 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167704a-7cf4-4e96-ba76-6f52421a6f47 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.463534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167704a-7cf4-4e96-ba76-6f52421a6f47 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.468793 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca0b11-036e-4aa5-9475-847062d05998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.469416 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca0b11-036e-4aa5-9475-847062d05998 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.469698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca0b11-036e-4aa5-9475-847062d05998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.470001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca0b11-036e-4aa5-9475-847062d05998 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.470638 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca0b11-036e-4aa5-9475-847062d05998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.472561 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca0b11-036e-4aa5-9475-847062d05998 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.498277 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1392/2789] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:43:59 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:59.502963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8716505-4a4d-4e5a-b14a-f75b31f508e3 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.573006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8716505-4a4d-4e5a-b14a-f75b31f508e3 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.578617 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4c751-a443-460b-932c-eb5b3ee806ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.579240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4c751-a443-460b-932c-eb5b3ee806ee admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.579523 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4c751-a443-460b-932c-eb5b3ee806ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.579798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4c751-a443-460b-932c-eb5b3ee806ee admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.580438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4c751-a443-460b-932c-eb5b3ee806ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.582465 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4c751-a443-460b-932c-eb5b3ee806ee admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.617766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1398/2790] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:59 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:59.617766 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca0b11-036e-4aa5-9475-847062d05998 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.625960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca0b11-036e-4aa5-9475-847062d05998 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.631085 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76140e9-33d2-45ee-a53f-7f629eb35709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.631700 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76140e9-33d2-45ee-a53f-7f629eb35709 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.631977 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76140e9-33d2-45ee-a53f-7f629eb35709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.632246 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76140e9-33d2-45ee-a53f-7f629eb35709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.632897 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76140e9-33d2-45ee-a53f-7f629eb35709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.634567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76140e9-33d2-45ee-a53f-7f629eb35709 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.649941 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1399/2791] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:59.654326 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76140e9-33d2-45ee-a53f-7f629eb35709 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.664623 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76140e9-33d2-45ee-a53f-7f629eb35709 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.670055 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c8884-c9d8-478f-87e0-9e2d859969fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.670678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8884-c9d8-478f-87e0-9e2d859969fe admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.670955 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8884-c9d8-478f-87e0-9e2d859969fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.671228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8884-c9d8-478f-87e0-9e2d859969fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.671875 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c8884-c9d8-478f-87e0-9e2d859969fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.673464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c8884-c9d8-478f-87e0-9e2d859969fe admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.686233 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1400/2792] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:43:59.690543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c8884-c9d8-478f-87e0-9e2d859969fe admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.701212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c8884-c9d8-478f-87e0-9e2d859969fe admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.708491 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1393/2793] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:43:59 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:43:59.708681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7730d-e26a-40a2-8ce3-41a969402ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.708681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7730d-e26a-40a2-8ce3-41a969402ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.708681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7730d-e26a-40a2-8ce3-41a969402ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.708681 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7730d-e26a-40a2-8ce3-41a969402ff4 admin admin] PATH_INFO: `/v3/projects/0c22e95784d24041ab03bb977d408817/users/e2ffe406847040e794c333def9db608e/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.709560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4c751-a443-460b-932c-eb5b3ee806ee admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.721013 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4c751-a443-460b-932c-eb5b3ee806ee admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.726378 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333871bf-64e4-4e7c-99c1-52f38c1b0626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.731508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333871bf-64e4-4e7c-99c1-52f38c1b0626 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.731508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333871bf-64e4-4e7c-99c1-52f38c1b0626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.731508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333871bf-64e4-4e7c-99c1-52f38c1b0626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.731823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7730d-e26a-40a2-8ce3-41a969402ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c22e95784d24041ab03bb977d408817, user_id=e2ffe406847040e794c333def9db608e, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.731925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333871bf-64e4-4e7c-99c1-52f38c1b0626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.731925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333871bf-64e4-4e7c-99c1-52f38c1b0626 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.732109 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7730d-e26a-40a2-8ce3-41a969402ff4 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.742627 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1394/2794] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:43:59.747610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333871bf-64e4-4e7c-99c1-52f38c1b0626 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.758941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333871bf-64e4-4e7c-99c1-52f38c1b0626 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.764447 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3148ea7-9cdb-439f-a744-23f46652d7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.765187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3148ea7-9cdb-439f-a744-23f46652d7e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.765470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3148ea7-9cdb-439f-a744-23f46652d7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.765745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3148ea7-9cdb-439f-a744-23f46652d7e2 admin admin] PATH_INFO: `/v3/projects/2919c91c27c44fabb32c4edd9b5d4521/users/c2a3a04cdcbc4a1eb90ab8ff989d9bde/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.786161 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3148ea7-9cdb-439f-a744-23f46652d7e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2919c91c27c44fabb32c4edd9b5d4521, user_id=c2a3a04cdcbc4a1eb90ab8ff989d9bde, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.788819 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3148ea7-9cdb-439f-a744-23f46652d7e2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.838349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1401/2795] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:59 2022] PUT /identity/v3/projects/0c22e95784d24041ab03bb977d408817/users/e2ffe406847040e794c333def9db608e/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:43:59.850494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d02d4-e0f3-45ca-b810-dd30c8768887 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.850783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d02d4-e0f3-45ca-b810-dd30c8768887 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.851060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d02d4-e0f3-45ca-b810-dd30c8768887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.874911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1395/2796] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:43:59 2022] PUT /identity/v3/projects/2919c91c27c44fabb32c4edd9b5d4521/users/c2a3a04cdcbc4a1eb90ab8ff989d9bde/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:43:59.879777 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3148ea7-9cdb-439f-a744-23f46652d7e2 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.888035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-1f9d02d4-e0f3-45ca-b810-dd30c8768887 None None] MFA Rules not processed for user `e2ffe406847040e794c333def9db608e`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:43:59.889886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1f9d02d4-e0f3-45ca-b810-dd30c8768887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:59.931544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:59.955297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:59.978392 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3148ea7-9cdb-439f-a744-23f46652d7e2 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:43:59.980608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1402/2797] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:43:59.983601 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb4623-c161-4cd2-9d4e-165d1e04e49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:43:59.984279 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb4623-c161-4cd2-9d4e-165d1e04e49e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:43:59.984555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb4623-c161-4cd2-9d4e-165d1e04e49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:43:59.984831 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb4623-c161-4cd2-9d4e-165d1e04e49e admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:43:59.985475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb4623-c161-4cd2-9d4e-165d1e04e49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:43:59.987073 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb4623-c161-4cd2-9d4e-165d1e04e49e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:43:59.992253 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d02d4-e0f3-45ca-b810-dd30c8768887 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:43:59.993958 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1f9d02d4-e0f3-45ca-b810-dd30c8768887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:43:59.999121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1396/2798] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:00.004086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb4623-c161-4cd2-9d4e-165d1e04e49e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:00.016806 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb4623-c161-4cd2-9d4e-165d1e04e49e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:00.021625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf374a5-535f-4aa4-9647-d838c1487d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:00.029962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf374a5-535f-4aa4-9647-d838c1487d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:00.029962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf374a5-535f-4aa4-9647-d838c1487d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:00.029962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf374a5-535f-4aa4-9647-d838c1487d01 admin admin] PATH_INFO: `/v3/projects/2919c91c27c44fabb32c4edd9b5d4521/users/c2a3a04cdcbc4a1eb90ab8ff989d9bde/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:00.029962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf374a5-535f-4aa4-9647-d838c1487d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2919c91c27c44fabb32c4edd9b5d4521, user_id=c2a3a04cdcbc4a1eb90ab8ff989d9bde, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:00.029962 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf374a5-535f-4aa4-9647-d838c1487d01 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:00.039097 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1397/2799] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:00 2022] PUT /identity/v3/projects/2919c91c27c44fabb32c4edd9b5d4521/users/c2a3a04cdcbc4a1eb90ab8ff989d9bde/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:44:00.049910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645eb85-b031-46fd-9f4e-cc782650e543 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:00.050494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645eb85-b031-46fd-9f4e-cc782650e543 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:00.050811 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645eb85-b031-46fd-9f4e-cc782650e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:00.059641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d02d4-e0f3-45ca-b810-dd30c8768887 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:00.083751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9645eb85-b031-46fd-9f4e-cc782650e543 None None] MFA Rules not processed for user `c2a3a04cdcbc4a1eb90ab8ff989d9bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:00.085026 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9645eb85-b031-46fd-9f4e-cc782650e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:00.119567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fea150-8059-49b1-9343-6a1307892b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:00.120205 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fea150-8059-49b1-9343-6a1307892b50 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:00.120468 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fea150-8059-49b1-9343-6a1307892b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:00.120743 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fea150-8059-49b1-9343-6a1307892b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:00.166187 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1398/2800] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:00.180475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645eb85-b031-46fd-9f4e-cc782650e543 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:00.180475 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9645eb85-b031-46fd-9f4e-cc782650e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:00.193527 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645eb85-b031-46fd-9f4e-cc782650e543 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:00.194534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fea150-8059-49b1-9343-6a1307892b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:00.196019 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fea150-8059-49b1-9343-6a1307892b50 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:00.197459 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d81ac-e4b0-45b9-9f83-9f6bd932bfcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:00.198102 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d81ac-e4b0-45b9-9f83-9f6bd932bfcf service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:00.198385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d81ac-e4b0-45b9-9f83-9f6bd932bfcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:00.198663 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d81ac-e4b0-45b9-9f83-9f6bd932bfcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:00.206601 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1403/2801] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:43:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:44:00.209218 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d81ac-e4b0-45b9-9f83-9f6bd932bfcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:00.210985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d81ac-e4b0-45b9-9f83-9f6bd932bfcf service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:00.222956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1399/2802] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:00.357621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fea150-8059-49b1-9343-6a1307892b50 service cinder] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:00.367134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fea150-8059-49b1-9343-6a1307892b50 service cinder] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:00.371029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdf5fd-394e-4330-bf01-138f62b1eb20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:00.372306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf5fd-394e-4330-bf01-138f62b1eb20 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:00.372581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf5fd-394e-4330-bf01-138f62b1eb20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:00.372851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdf5fd-394e-4330-bf01-138f62b1eb20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:00.374631 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-86bdf5fd-394e-4330-bf01-138f62b1eb20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:00.413123 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:00.440177 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdf5fd-394e-4330-bf01-138f62b1eb20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:00.441929 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdf5fd-394e-4330-bf01-138f62b1eb20 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:00.455301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1404/2803] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:04.816482 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d81ac-e4b0-45b9-9f83-9f6bd932bfcf service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:04.882399 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d81ac-e4b0-45b9-9f83-9f6bd932bfcf service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:04.887030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:04.887769 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:04.888035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:04.888308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] PATH_INFO: `/v3/users/af92e071c4c6440ca65abf933203748d` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:04.889445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af92e071c4c6440ca65abf933203748d)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:04.891390 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:05.114143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:05.131256 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af92e071c4c6440ca65abf933203748d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:05.140041 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af92e071c4c6440ca65abf933203748d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:05.140800 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af92e071c4c6440ca65abf933203748d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:05.271583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af92e071c4c6440ca65abf933203748d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:05.272353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af92e071c4c6440ca65abf933203748d'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:05.296613 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1400/2804] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:04 2022] DELETE /identity/v3/users/af92e071c4c6440ca65abf933203748d => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:05.302349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670357e7-2616-42b3-bc55-65c2ca442ee7 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:05.302887 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670357e7-2616-42b3-bc55-65c2ca442ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:05.303012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670357e7-2616-42b3-bc55-65c2ca442ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:05.324380 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-670357e7-2616-42b3-bc55-65c2ca442ee7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:05.325572 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-670357e7-2616-42b3-bc55-65c2ca442ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:05.393068 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1405/2805] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:05.403584 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:05.405308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:05.467555 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8be9b1-2499-4648-b09f-3e8edacfbf52 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:05.472506 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a8d7e-6f54-4716-95c3-cccc6efeac4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:05.473148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a8d7e-6f54-4716-95c3-cccc6efeac4e service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:05.473429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a8d7e-6f54-4716-95c3-cccc6efeac4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:05.473700 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a8d7e-6f54-4716-95c3-cccc6efeac4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:05.483846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a8d7e-6f54-4716-95c3-cccc6efeac4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:05.485262 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a8d7e-6f54-4716-95c3-cccc6efeac4e service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:05.495194 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1401/2806] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:05.939963 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670357e7-2616-42b3-bc55-65c2ca442ee7 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:05.941447 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-670357e7-2616-42b3-bc55-65c2ca442ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:05.954838 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670357e7-2616-42b3-bc55-65c2ca442ee7 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:05.962433 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:05.962762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:05.963017 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:05.963322 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] PATH_INFO: `/v3/projects/1ec3ff7df82b45fbb352fa2e6ab5d45e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:05.964588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec3ff7df82b45fbb352fa2e6ab5d45e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:05.967207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:06.104350 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec3ff7df82b45fbb352fa2e6ab5d45e', 'request_id': 'req-221c6218-659d-4dc4-b145-3f480fd89dc8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:06.111208 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec3ff7df82b45fbb352fa2e6ab5d45e', 'request_id': 'req-221c6218-659d-4dc4-b145-3f480fd89dc8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:06.206606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec3ff7df82b45fbb352fa2e6ab5d45e', 'request_id': 'req-221c6218-659d-4dc4-b145-3f480fd89dc8'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:06.230445 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] The token cache is being invalidate because project 1ec3ff7df82b45fbb352fa2e6ab5d45e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:06.230738 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:06.231312 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:06.232843 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1406/2807] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:05 2022] DELETE /identity/v3/projects/1ec3ff7df82b45fbb352fa2e6ab5d45e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:06.237472 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a8d7e-6f54-4716-95c3-cccc6efeac4e service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:06.248159 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a8d7e-6f54-4716-95c3-cccc6efeac4e service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:06.317701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:06.318410 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:06.318692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:06.318965 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] PATH_INFO: `/v3/users/002fff6d98104774bb3c06b138ffa110` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:06.320451 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=002fff6d98104774bb3c06b138ffa110)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:06.322522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:06.524904 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '002fff6d98104774bb3c06b138ffa110'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:06.532323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '002fff6d98104774bb3c06b138ffa110'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:06.533524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '002fff6d98104774bb3c06b138ffa110'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:06.536197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:06.619463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '002fff6d98104774bb3c06b138ffa110'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:06.620195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '002fff6d98104774bb3c06b138ffa110'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:06.641042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1402/2808] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:06 2022] DELETE /identity/v3/users/002fff6d98104774bb3c06b138ffa110 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:07.060621 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:07.062692 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:07.076914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c6218-659d-4dc4-b145-3f480fd89dc8 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:07.162907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:07.163541 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:07.163851 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:07.164114 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] PATH_INFO: `/v3/projects/4488499caac7474c9a9b69937c266664` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:07.165261 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4488499caac7474c9a9b69937c266664)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:07.167174 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:07.168780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:07.277576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4488499caac7474c9a9b69937c266664', 'request_id': 'req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:07.284537 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4488499caac7474c9a9b69937c266664', 'request_id': 'req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:07.351344 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4488499caac7474c9a9b69937c266664', 'request_id': 'req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:07.362481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] The token cache is being invalidate because project 4488499caac7474c9a9b69937c266664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:07.362767 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:07.363397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:07.364869 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1407/2809] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:07 2022] DELETE /identity/v3/projects/4488499caac7474c9a9b69937c266664 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:07.368966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:07.370425 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:07.383861 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafb11f-34d5-4b3e-985c-2e0ed2096bac admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:07.441958 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d0fa05-a7e7-4a84-9a33-59ebf89fcb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:07.442625 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0fa05-a7e7-4a84-9a33-59ebf89fcb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:07.442903 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0fa05-a7e7-4a84-9a33-59ebf89fcb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:07.443173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d0fa05-a7e7-4a84-9a33-59ebf89fcb11 admin admin] PATH_INFO: `/v3/users/c2a3a04cdcbc4a1eb90ab8ff989d9bde` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:07.444297 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0fa05-a7e7-4a84-9a33-59ebf89fcb11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a3a04cdcbc4a1eb90ab8ff989d9bde)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:07.446224 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d0fa05-a7e7-4a84-9a33-59ebf89fcb11 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:07.612892 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-53d0fa05-a7e7-4a84-9a33-59ebf89fcb11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a3a04cdcbc4a1eb90ab8ff989d9bde'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:07.620291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-53d0fa05-a7e7-4a84-9a33-59ebf89fcb11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a3a04cdcbc4a1eb90ab8ff989d9bde'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:07.622629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-53d0fa05-a7e7-4a84-9a33-59ebf89fcb11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a3a04cdcbc4a1eb90ab8ff989d9bde'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:07.695197 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-53d0fa05-a7e7-4a84-9a33-59ebf89fcb11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a3a04cdcbc4a1eb90ab8ff989d9bde'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:07.695821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-53d0fa05-a7e7-4a84-9a33-59ebf89fcb11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a3a04cdcbc4a1eb90ab8ff989d9bde'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:07.715892 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1403/2810] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:07 2022] DELETE /identity/v3/users/c2a3a04cdcbc4a1eb90ab8ff989d9bde => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:44:08.191608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:08.193098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:08.207464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8eb08a-b61d-41ed-bcaf-315c386a23ca admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:08.292752 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:08.294920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:08.295421 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:08.295915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] PATH_INFO: `/v3/projects/2919c91c27c44fabb32c4edd9b5d4521` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:08.297907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2919c91c27c44fabb32c4edd9b5d4521)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:08.301866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:08.424464 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2919c91c27c44fabb32c4edd9b5d4521', 'request_id': 'req-4efc5c31-c502-452a-a735-15617a819915'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:08.432657 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2919c91c27c44fabb32c4edd9b5d4521', 'request_id': 'req-4efc5c31-c502-452a-a735-15617a819915'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:08.492310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2919c91c27c44fabb32c4edd9b5d4521', 'request_id': 'req-4efc5c31-c502-452a-a735-15617a819915'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:08.505213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] The token cache is being invalidate because project 2919c91c27c44fabb32c4edd9b5d4521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:08.505747 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:08.506425 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-4efc5c31-c502-452a-a735-15617a819915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:08.508316 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1408/2811] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:08 2022] DELETE /identity/v3/projects/2919c91c27c44fabb32c4edd9b5d4521 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:08.514444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2ef59-5fe3-4203-8556-9f45dd81036f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:08.514946 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2ef59-5fe3-4203-8556-9f45dd81036f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:08.515052 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2ef59-5fe3-4203-8556-9f45dd81036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:08.535652 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3fc2ef59-5fe3-4203-8556-9f45dd81036f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:08.540254 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3fc2ef59-5fe3-4203-8556-9f45dd81036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:08.589691 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:08.601721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1404/2812] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:08.611862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0f13-342a-4bfe-825e-fb652d4b62b1 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:08.612155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0f13-342a-4bfe-825e-fb652d4b62b1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:08.612513 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed0f13-342a-4bfe-825e-fb652d4b62b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:08.636444 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-afed0f13-342a-4bfe-825e-fb652d4b62b1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:08.639487 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-afed0f13-342a-4bfe-825e-fb652d4b62b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:08.659780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1409/2813] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:08.661011 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2ef59-5fe3-4203-8556-9f45dd81036f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:08.672436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2ef59-5fe3-4203-8556-9f45dd81036f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:08.677086 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c7bdb-a502-4768-bff2-ee0219a65c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:08.677707 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7bdb-a502-4768-bff2-ee0219a65c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:08.678035 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7bdb-a502-4768-bff2-ee0219a65c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:08.678281 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7bdb-a502-4768-bff2-ee0219a65c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:08.679719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c7bdb-a502-4768-bff2-ee0219a65c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:44:08.679719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c7bdb-a502-4768-bff2-ee0219a65c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:08.680798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c7bdb-a502-4768-bff2-ee0219a65c01 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:08.693517 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1405/2814] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:44:08.698210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed0f13-342a-4bfe-825e-fb652d4b62b1 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:08.707670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed0f13-342a-4bfe-825e-fb652d4b62b1 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:08.712579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29028-22f0-421c-a49a-dbd0e0ef776d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:08.713192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29028-22f0-421c-a49a-dbd0e0ef776d admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:08.718144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29028-22f0-421c-a49a-dbd0e0ef776d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:08.718144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29028-22f0-421c-a49a-dbd0e0ef776d admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:08.718144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc29028-22f0-421c-a49a-dbd0e0ef776d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:08.718144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc29028-22f0-421c-a49a-dbd0e0ef776d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:08.729001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:08.853730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1410/2815] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:44:08 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:44:08.858616 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c7bdb-a502-4768-bff2-ee0219a65c01 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:08.869312 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c7bdb-a502-4768-bff2-ee0219a65c01 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:08.957856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b26d8-9ea9-4758-b4b5-23f6bef54c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:08.959059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b26d8-9ea9-4758-b4b5-23f6bef54c71 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:08.959438 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b26d8-9ea9-4758-b4b5-23f6bef54c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:08.959718 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b26d8-9ea9-4758-b4b5-23f6bef54c71 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:08.960369 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b26d8-9ea9-4758-b4b5-23f6bef54c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:08.962350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b26d8-9ea9-4758-b4b5-23f6bef54c71 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:09.085864 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1406/2816] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:44:08 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:44:09.090840 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29028-22f0-421c-a49a-dbd0e0ef776d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:09.101384 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29028-22f0-421c-a49a-dbd0e0ef776d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:09.112228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c324fef-5413-4c27-9cd4-63912b02dd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:09.112853 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c324fef-5413-4c27-9cd4-63912b02dd63 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:09.113152 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c324fef-5413-4c27-9cd4-63912b02dd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:09.113424 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c324fef-5413-4c27-9cd4-63912b02dd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:09.114166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c324fef-5413-4c27-9cd4-63912b02dd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:09.115815 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c324fef-5413-4c27-9cd4-63912b02dd63 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:09.127291 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1411/2817] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:09.131651 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b26d8-9ea9-4758-b4b5-23f6bef54c71 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:09.142846 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b26d8-9ea9-4758-b4b5-23f6bef54c71 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:09.147560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0674af-f525-4aa2-a1a5-837d0d413492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:09.148164 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0674af-f525-4aa2-a1a5-837d0d413492 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:09.148444 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0674af-f525-4aa2-a1a5-837d0d413492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:09.148721 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0674af-f525-4aa2-a1a5-837d0d413492 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:09.149364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0674af-f525-4aa2-a1a5-837d0d413492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:09.151072 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0674af-f525-4aa2-a1a5-837d0d413492 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:09.163747 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1407/2818] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:09.168134 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c324fef-5413-4c27-9cd4-63912b02dd63 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:09.179064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c324fef-5413-4c27-9cd4-63912b02dd63 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:09.183607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2826550-f64a-4e3f-a0dd-e0af774f5520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:09.184845 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826550-f64a-4e3f-a0dd-e0af774f5520 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:09.185124 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826550-f64a-4e3f-a0dd-e0af774f5520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:09.188813 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826550-f64a-4e3f-a0dd-e0af774f5520 admin admin] PATH_INFO: `/v3/projects/2b480577d4794e5faa6dae2bca72e00d/users/95c8fc0842514d2ab96593d357ba3189/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:09.200885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2826550-f64a-4e3f-a0dd-e0af774f5520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b480577d4794e5faa6dae2bca72e00d, user_id=95c8fc0842514d2ab96593d357ba3189, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:09.203586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2826550-f64a-4e3f-a0dd-e0af774f5520 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:09.301030 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1412/2819] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:09 2022] PUT /identity/v3/projects/2b480577d4794e5faa6dae2bca72e00d/users/95c8fc0842514d2ab96593d357ba3189/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:09.313778 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebfdd5-a522-4cb7-9109-f9252997fbcc None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:09.314144 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebfdd5-a522-4cb7-9109-f9252997fbcc None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:09.314559 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebfdd5-a522-4cb7-9109-f9252997fbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:09.345352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-a6ebfdd5-a522-4cb7-9109-f9252997fbcc None None] MFA Rules not processed for user `95c8fc0842514d2ab96593d357ba3189`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:09.346612 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a6ebfdd5-a522-4cb7-9109-f9252997fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:09.414092 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1408/2820] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:09.420071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2826550-f64a-4e3f-a0dd-e0af774f5520 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:09.502710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2826550-f64a-4e3f-a0dd-e0af774f5520 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:09.508912 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7d2d-47bd-4e83-a2b8-2db49094cf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:09.509708 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7d2d-47bd-4e83-a2b8-2db49094cf7c admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:09.511577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7d2d-47bd-4e83-a2b8-2db49094cf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:09.511577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7d2d-47bd-4e83-a2b8-2db49094cf7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:09.511577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf7d2d-47bd-4e83-a2b8-2db49094cf7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:09.513986 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf7d2d-47bd-4e83-a2b8-2db49094cf7c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:09.642848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1413/2821] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:44:09 2022] POST /identity/v3/projects => generated 365 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:44:09.648464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebfdd5-a522-4cb7-9109-f9252997fbcc None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:09.661194 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebfdd5-a522-4cb7-9109-f9252997fbcc None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:09.734570 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:09.744361 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d4117-b094-497a-a211-778e7e7af898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:09.745201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d4117-b094-497a-a211-778e7e7af898 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:09.745479 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d4117-b094-497a-a211-778e7e7af898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:09.745795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d4117-b094-497a-a211-778e7e7af898 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:09.746543 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d4117-b094-497a-a211-778e7e7af898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:09.748631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d4117-b094-497a-a211-778e7e7af898 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:09.861793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1409/2822] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:44:09 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:44:09.865820 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7d2d-47bd-4e83-a2b8-2db49094cf7c admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:09.877388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7d2d-47bd-4e83-a2b8-2db49094cf7c admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:09.886095 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67cb79-5e88-438b-9f8f-4ef067ea0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:09.886784 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67cb79-5e88-438b-9f8f-4ef067ea0590 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:09.887157 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67cb79-5e88-438b-9f8f-4ef067ea0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:09.888062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67cb79-5e88-438b-9f8f-4ef067ea0590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:09.888890 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67cb79-5e88-438b-9f8f-4ef067ea0590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:09.890622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67cb79-5e88-438b-9f8f-4ef067ea0590 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:09.902073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1414/2823] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:09.907064 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d4117-b094-497a-a211-778e7e7af898 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:09.917137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d4117-b094-497a-a211-778e7e7af898 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:09.922461 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c8f44-c839-4344-8b89-50806dc734b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:09.923110 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c8f44-c839-4344-8b89-50806dc734b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:09.923389 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c8f44-c839-4344-8b89-50806dc734b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:09.923661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c8f44-c839-4344-8b89-50806dc734b7 admin admin] PATH_INFO: `/v3/projects/638022784729480298c2e4642fcf9dc5/users/bbba2b5515a841b1a4c210b21ce54796/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:09.939597 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c8f44-c839-4344-8b89-50806dc734b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638022784729480298c2e4642fcf9dc5, user_id=bbba2b5515a841b1a4c210b21ce54796, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:09.942323 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c8f44-c839-4344-8b89-50806dc734b7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:10.058121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1410/2824] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:09 2022] PUT /identity/v3/projects/638022784729480298c2e4642fcf9dc5/users/bbba2b5515a841b1a4c210b21ce54796/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:10.062495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67cb79-5e88-438b-9f8f-4ef067ea0590 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:10.072581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67cb79-5e88-438b-9f8f-4ef067ea0590 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:10.131439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86096481-1bec-4716-9d2c-91c750ddfd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:10.132060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86096481-1bec-4716-9d2c-91c750ddfd28 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:10.132369 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86096481-1bec-4716-9d2c-91c750ddfd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:10.132687 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86096481-1bec-4716-9d2c-91c750ddfd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:10.133365 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86096481-1bec-4716-9d2c-91c750ddfd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:10.134984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86096481-1bec-4716-9d2c-91c750ddfd28 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:10.146494 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1415/2825] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:44:10.150862 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c8f44-c839-4344-8b89-50806dc734b7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:10.161706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c8f44-c839-4344-8b89-50806dc734b7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:10.166313 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809256b8-8021-402a-94a9-28d86d6766a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:10.166951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809256b8-8021-402a-94a9-28d86d6766a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:10.167227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809256b8-8021-402a-94a9-28d86d6766a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:10.167494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809256b8-8021-402a-94a9-28d86d6766a7 admin admin] PATH_INFO: `/v3/projects/638022784729480298c2e4642fcf9dc5/users/bbba2b5515a841b1a4c210b21ce54796/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:10.170162 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809256b8-8021-402a-94a9-28d86d6766a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638022784729480298c2e4642fcf9dc5, user_id=bbba2b5515a841b1a4c210b21ce54796, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:10.172745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809256b8-8021-402a-94a9-28d86d6766a7 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:10.183259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1411/2826] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:10 2022] PUT /identity/v3/projects/638022784729480298c2e4642fcf9dc5/users/bbba2b5515a841b1a4c210b21ce54796/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:10.194307 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36f0b-49e4-49cd-8a52-3ba30fab7d12 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:10.194598 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36f0b-49e4-49cd-8a52-3ba30fab7d12 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:10.194876 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c36f0b-49e4-49cd-8a52-3ba30fab7d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:10.223824 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-32c36f0b-49e4-49cd-8a52-3ba30fab7d12 None None] MFA Rules not processed for user `bbba2b5515a841b1a4c210b21ce54796`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:10.225029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-32c36f0b-49e4-49cd-8a52-3ba30fab7d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:10.238630 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:10.302038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1416/2827] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:10.314767 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809256b8-8021-402a-94a9-28d86d6766a7 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:10.316569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-809256b8-8021-402a-94a9-28d86d6766a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:10.405476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809256b8-8021-402a-94a9-28d86d6766a7 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:10.409538 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a779d-e645-44a0-ba8f-f8fb4fbc122f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:10.410216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a779d-e645-44a0-ba8f-f8fb4fbc122f service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:10.410504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a779d-e645-44a0-ba8f-f8fb4fbc122f service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:10.410780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a779d-e645-44a0-ba8f-f8fb4fbc122f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:10.421358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a779d-e645-44a0-ba8f-f8fb4fbc122f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:10.422845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a779d-e645-44a0-ba8f-f8fb4fbc122f service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:10.432998 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1412/2828] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:10.681689 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36f0b-49e4-49cd-8a52-3ba30fab7d12 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:10.692210 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c36f0b-49e4-49cd-8a52-3ba30fab7d12 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:10.695928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b72716-c357-4ce1-950d-8cd74e1f49e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:10.696539 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b72716-c357-4ce1-950d-8cd74e1f49e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:10.696814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b72716-c357-4ce1-950d-8cd74e1f49e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:10.697083 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b72716-c357-4ce1-950d-8cd74e1f49e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:10.765567 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b72716-c357-4ce1-950d-8cd74e1f49e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:10.767029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b72716-c357-4ce1-950d-8cd74e1f49e4 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:10.777265 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1417/2829] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:15.872804 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a779d-e645-44a0-ba8f-f8fb4fbc122f service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:15.874364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-a74a779d-e645-44a0-ba8f-f8fb4fbc122f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:15.951561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a779d-e645-44a0-ba8f-f8fb4fbc122f service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:15.956884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:15.957524 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:15.957808 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:15.958117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] PATH_INFO: `/v3/users/e2ffe406847040e794c333def9db608e` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:15.959263 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ffe406847040e794c333def9db608e)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:15.961284 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:16.055971 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:16.149341 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ffe406847040e794c333def9db608e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:16.157053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ffe406847040e794c333def9db608e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:16.157722 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ffe406847040e794c333def9db608e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:16.231223 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ffe406847040e794c333def9db608e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:16.232317 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ffe406847040e794c333def9db608e'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:16.252782 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1413/2830] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:15 2022] DELETE /identity/v3/users/e2ffe406847040e794c333def9db608e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:16.257938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f073ca-3dfb-472c-9225-147e0e221b7f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:16.258463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f073ca-3dfb-472c-9225-147e0e221b7f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:16.258463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f073ca-3dfb-472c-9225-147e0e221b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:16.279633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-26f073ca-3dfb-472c-9225-147e0e221b7f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:16.284938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-26f073ca-3dfb-472c-9225-147e0e221b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:16.356892 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1418/2831] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:16.367457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:16.368950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:16.431156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e9879-ceb8-43b5-b32a-0922d52aeb16 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:16.435598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b7b1e-f355-4648-9412-328b01508573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:16.436212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b7b1e-f355-4648-9412-328b01508573 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:16.436497 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b7b1e-f355-4648-9412-328b01508573 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:16.436798 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b7b1e-f355-4648-9412-328b01508573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:16.446203 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b7b1e-f355-4648-9412-328b01508573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:16.447660 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b7b1e-f355-4648-9412-328b01508573 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:16.458350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1414/2832] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:17.042702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f073ca-3dfb-472c-9225-147e0e221b7f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:17.044985 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-26f073ca-3dfb-472c-9225-147e0e221b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:17.068881 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f073ca-3dfb-472c-9225-147e0e221b7f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:17.074213 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:17.075397 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:17.075947 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:17.076360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] PATH_INFO: `/v3/projects/0c22e95784d24041ab03bb977d408817` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:17.077576 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c22e95784d24041ab03bb977d408817)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:17.079544 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:17.256442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:17.259369 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c22e95784d24041ab03bb977d408817', 'request_id': 'req-25e5a5a0-bec6-4a43-af49-38e720baa9b0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:17.266829 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c22e95784d24041ab03bb977d408817', 'request_id': 'req-25e5a5a0-bec6-4a43-af49-38e720baa9b0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:17.337728 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c22e95784d24041ab03bb977d408817', 'request_id': 'req-25e5a5a0-bec6-4a43-af49-38e720baa9b0'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:17.347611 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] The token cache is being invalidate because project 0c22e95784d24041ab03bb977d408817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:17.347922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:17.348772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:17.350383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1419/2833] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:17 2022] DELETE /identity/v3/projects/0c22e95784d24041ab03bb977d408817 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:44:17.355483 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd11c-e70d-4bdc-8f1c-3638f1e1a05f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:17.356967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd11c-e70d-4bdc-8f1c-3638f1e1a05f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:17.357252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bd11c-e70d-4bdc-8f1c-3638f1e1a05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:17.378694 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-126bd11c-e70d-4bdc-8f1c-3638f1e1a05f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:17.379581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-126bd11c-e70d-4bdc-8f1c-3638f1e1a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:17.451985 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1415/2834] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:17.460172 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:17.461698 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:17.480284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5a5a0-bec6-4a43-af49-38e720baa9b0 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:17.486744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638a4e9-2329-4324-be5e-c43b1e611354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:17.486744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638a4e9-2329-4324-be5e-c43b1e611354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:17.486744 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638a4e9-2329-4324-be5e-c43b1e611354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:17.487239 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638a4e9-2329-4324-be5e-c43b1e611354 admin admin] PATH_INFO: `/v3/users/95c8fc0842514d2ab96593d357ba3189` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:17.488594 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638a4e9-2329-4324-be5e-c43b1e611354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c8fc0842514d2ab96593d357ba3189)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:17.490603 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638a4e9-2329-4324-be5e-c43b1e611354 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:17.520714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d34ac-c649-4504-836d-069f8fd4b1e7 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:17.520929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d34ac-c649-4504-836d-069f8fd4b1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:17.521168 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d34ac-c649-4504-836d-069f8fd4b1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:17.541135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-033d34ac-c649-4504-836d-069f8fd4b1e7 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:17.542374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-033d34ac-c649-4504-836d-069f8fd4b1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:17.552350 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1416/2835] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:17.555978 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d34ac-c649-4504-836d-069f8fd4b1e7 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:17.564131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d34ac-c649-4504-836d-069f8fd4b1e7 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:17.568835 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5c9e-745a-41e2-b921-167ee3ee4e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:17.569495 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5c9e-745a-41e2-b921-167ee3ee4e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:17.569774 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5c9e-745a-41e2-b921-167ee3ee4e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:17.570077 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea5c9e-745a-41e2-b921-167ee3ee4e55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:17.570738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea5c9e-745a-41e2-b921-167ee3ee4e55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:44:17.571032 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea5c9e-745a-41e2-b921-167ee3ee4e55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:17.572692 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea5c9e-745a-41e2-b921-167ee3ee4e55 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:17.589248 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1417/2836] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:44:17.590832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5c9e-745a-41e2-b921-167ee3ee4e55 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:17.601950 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea5c9e-745a-41e2-b921-167ee3ee4e55 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:17.613671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec64143-b4c4-4684-a006-ccc57cc9d6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:17.613671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64143-b4c4-4684-a006-ccc57cc9d6fd admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:17.613671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64143-b4c4-4684-a006-ccc57cc9d6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:17.613671 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec64143-b4c4-4684-a006-ccc57cc9d6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:17.614189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec64143-b4c4-4684-a006-ccc57cc9d6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:17.615007 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec64143-b4c4-4684-a006-ccc57cc9d6fd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:17.674038 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1638a4e9-2329-4324-be5e-c43b1e611354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c8fc0842514d2ab96593d357ba3189'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:17.681282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1638a4e9-2329-4324-be5e-c43b1e611354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c8fc0842514d2ab96593d357ba3189'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:17.682007 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1638a4e9-2329-4324-be5e-c43b1e611354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c8fc0842514d2ab96593d357ba3189'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:17.718715 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1418/2837] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:44:17 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:44:17.723093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec64143-b4c4-4684-a006-ccc57cc9d6fd admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:17.732146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:17.785857 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec64143-b4c4-4684-a006-ccc57cc9d6fd admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:17.790632 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124526c1-0217-4140-ba5c-f17cd65fca52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:17.799595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124526c1-0217-4140-ba5c-f17cd65fca52 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:17.799595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124526c1-0217-4140-ba5c-f17cd65fca52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:17.799595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124526c1-0217-4140-ba5c-f17cd65fca52 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:17.799595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124526c1-0217-4140-ba5c-f17cd65fca52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:17.799595 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124526c1-0217-4140-ba5c-f17cd65fca52 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:17.820559 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1638a4e9-2329-4324-be5e-c43b1e611354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c8fc0842514d2ab96593d357ba3189'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:17.835206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1638a4e9-2329-4324-be5e-c43b1e611354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c8fc0842514d2ab96593d357ba3189'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:17.841391 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1420/2838] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:17 2022] DELETE /identity/v3/users/95c8fc0842514d2ab96593d357ba3189 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:17.845772 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec69a-d004-4bcd-916c-1981d8203de6 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:17.846090 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec69a-d004-4bcd-916c-1981d8203de6 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:17.846368 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ec69a-d004-4bcd-916c-1981d8203de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:17.865035 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-c59ec69a-d004-4bcd-916c-1981d8203de6 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:17.866270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c59ec69a-d004-4bcd-916c-1981d8203de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:17.914569 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1419/2839] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:44:17 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:44:17.915738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124526c1-0217-4140-ba5c-f17cd65fca52 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:17.917558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-124526c1-0217-4140-ba5c-f17cd65fca52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:17.927434 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1421/2840] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:17.930140 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124526c1-0217-4140-ba5c-f17cd65fca52 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:17.937110 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a9afb-f58a-4942-b01e-22dfdf5db525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:17.937734 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a9afb-f58a-4942-b01e-22dfdf5db525 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:17.937855 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ec69a-d004-4bcd-916c-1981d8203de6 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:17.938076 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a9afb-f58a-4942-b01e-22dfdf5db525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:17.938309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a9afb-f58a-4942-b01e-22dfdf5db525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:17.938957 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a9afb-f58a-4942-b01e-22dfdf5db525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:17.939300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-c59ec69a-d004-4bcd-916c-1981d8203de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:17.940560 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a9afb-f58a-4942-b01e-22dfdf5db525 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:17.953243 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1420/2841] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:17.957288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a9afb-f58a-4942-b01e-22dfdf5db525 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:17.967657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a9afb-f58a-4942-b01e-22dfdf5db525 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:17.972554 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb6a1b-ebb6-4ded-90c4-b175b0903efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:17.973163 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb6a1b-ebb6-4ded-90c4-b175b0903efa admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:17.973445 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb6a1b-ebb6-4ded-90c4-b175b0903efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:17.973719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb6a1b-ebb6-4ded-90c4-b175b0903efa admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:17.974398 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb6a1b-ebb6-4ded-90c4-b175b0903efa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:17.976009 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb6a1b-ebb6-4ded-90c4-b175b0903efa admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:17.988608 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1421/2842] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:17.992963 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb6a1b-ebb6-4ded-90c4-b175b0903efa admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:17.995827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:18.001665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ec69a-d004-4bcd-916c-1981d8203de6 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:18.003017 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb6a1b-ebb6-4ded-90c4-b175b0903efa admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:18.006378 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae567e7-cefa-4cda-bc6a-254b3a4a46cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:18.009480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae567e7-cefa-4cda-bc6a-254b3a4a46cb service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:18.009480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae567e7-cefa-4cda-bc6a-254b3a4a46cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:18.009480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae567e7-cefa-4cda-bc6a-254b3a4a46cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:18.010884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940c6f9-91f8-4405-aca0-7132524c998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:18.011558 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940c6f9-91f8-4405-aca0-7132524c998f admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:18.011837 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940c6f9-91f8-4405-aca0-7132524c998f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:18.012640 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940c6f9-91f8-4405-aca0-7132524c998f admin admin] PATH_INFO: `/v3/projects/ca600fe5e0fa4e43918b39596f552668/users/d290967dd55b42619c75ab1e7e0c717f/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:18.018780 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae567e7-cefa-4cda-bc6a-254b3a4a46cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:18.020263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae567e7-cefa-4cda-bc6a-254b3a4a46cb service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:18.032192 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1422/2843] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:44:18.035085 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940c6f9-91f8-4405-aca0-7132524c998f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca600fe5e0fa4e43918b39596f552668, user_id=d290967dd55b42619c75ab1e7e0c717f, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:18.038000 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940c6f9-91f8-4405-aca0-7132524c998f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:18.179657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1422/2844] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:17 2022] PUT /identity/v3/projects/ca600fe5e0fa4e43918b39596f552668/users/d290967dd55b42619c75ab1e7e0c717f/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:44:18.190405 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93dc6-22ce-4498-b206-304cb4ea53a0 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:18.190688 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93dc6-22ce-4498-b206-304cb4ea53a0 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:18.190982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb93dc6-22ce-4498-b206-304cb4ea53a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:18.222360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-5eb93dc6-22ce-4498-b206-304cb4ea53a0 None None] MFA Rules not processed for user `d290967dd55b42619c75ab1e7e0c717f`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:18.224325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5eb93dc6-22ce-4498-b206-304cb4ea53a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:18.294896 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1423/2845] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:18.305691 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940c6f9-91f8-4405-aca0-7132524c998f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:18.308826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-0940c6f9-91f8-4405-aca0-7132524c998f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:18.403951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940c6f9-91f8-4405-aca0-7132524c998f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:18.409069 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb5d10-c667-4854-aa57-2762939fd268 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:18.409964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb5d10-c667-4854-aa57-2762939fd268 service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:18.410520 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb5d10-c667-4854-aa57-2762939fd268 service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:18.410961 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb5d10-c667-4854-aa57-2762939fd268 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:18.436382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb5d10-c667-4854-aa57-2762939fd268 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:18.436382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb5d10-c667-4854-aa57-2762939fd268 service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:18.436382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1423/2846] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:18.550979 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93dc6-22ce-4498-b206-304cb4ea53a0 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:18.553622 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5eb93dc6-22ce-4498-b206-304cb4ea53a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:18.629140 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb93dc6-22ce-4498-b206-304cb4ea53a0 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:18.634097 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:18.634751 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:18.635118 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:18.635388 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] PATH_INFO: `/v3/projects/2b480577d4794e5faa6dae2bca72e00d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:18.636503 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b480577d4794e5faa6dae2bca72e00d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:18.639491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:18.769284 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b480577d4794e5faa6dae2bca72e00d', 'request_id': 'req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:18.776046 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b480577d4794e5faa6dae2bca72e00d', 'request_id': 'req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:18.882803 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b480577d4794e5faa6dae2bca72e00d', 'request_id': 'req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:18.894633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] The token cache is being invalidate because project 2b480577d4794e5faa6dae2bca72e00d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:18.894916 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:18.895536 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:18.897049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1424/2847] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:18 2022] DELETE /identity/v3/projects/2b480577d4794e5faa6dae2bca72e00d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:18.901093 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb5d10-c667-4854-aa57-2762939fd268 service cinder] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:18.913382 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb5d10-c667-4854-aa57-2762939fd268 service cinder] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:18.963154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:18.972908 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7555c2e-0a5b-4ca4-8e8a-7acd00d8b416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:18.973539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7555c2e-0a5b-4ca4-8e8a-7acd00d8b416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:18.973824 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7555c2e-0a5b-4ca4-8e8a-7acd00d8b416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:18.974128 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7555c2e-0a5b-4ca4-8e8a-7acd00d8b416 admin admin] PATH_INFO: `/v3/users/bbba2b5515a841b1a4c210b21ce54796` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:18.975258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7555c2e-0a5b-4ca4-8e8a-7acd00d8b416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbba2b5515a841b1a4c210b21ce54796)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:18.977199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7555c2e-0a5b-4ca4-8e8a-7acd00d8b416 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:19.205353 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b7555c2e-0a5b-4ca4-8e8a-7acd00d8b416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbba2b5515a841b1a4c210b21ce54796'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:19.212917 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b7555c2e-0a5b-4ca4-8e8a-7acd00d8b416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbba2b5515a841b1a4c210b21ce54796'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:19.213638 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b7555c2e-0a5b-4ca4-8e8a-7acd00d8b416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbba2b5515a841b1a4c210b21ce54796'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:19.305184 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b7555c2e-0a5b-4ca4-8e8a-7acd00d8b416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbba2b5515a841b1a4c210b21ce54796'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:19.305793 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b7555c2e-0a5b-4ca4-8e8a-7acd00d8b416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbba2b5515a841b1a4c210b21ce54796'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:19.324562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1424/2848] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:18 2022] DELETE /identity/v3/users/bbba2b5515a841b1a4c210b21ce54796 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:19.867366 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:19.868927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:19.883493 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa9ab5-c520-4964-b3fc-7b7f924f14a7 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:19.891104 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:19.947227 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:19.947867 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:19.948144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:19.948414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] PATH_INFO: `/v3/projects/638022784729480298c2e4642fcf9dc5` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:19.949723 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638022784729480298c2e4642fcf9dc5)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:19.952933 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:20.072224 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638022784729480298c2e4642fcf9dc5', 'request_id': 'req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:20.079837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638022784729480298c2e4642fcf9dc5', 'request_id': 'req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:20.179461 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638022784729480298c2e4642fcf9dc5', 'request_id': 'req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:20.191866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] The token cache is being invalidate because project 638022784729480298c2e4642fcf9dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:20.192155 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:20.192832 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-aa4c9673-f4a6-45ba-ab9e-31ba14bbbe81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:20.194369 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1425/2849] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:19 2022] DELETE /identity/v3/projects/638022784729480298c2e4642fcf9dc5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:20.199345 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33dc97-f36b-4aff-a5cf-580bb5f0b7d4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:20.200542 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33dc97-f36b-4aff-a5cf-580bb5f0b7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:20.201036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33dc97-f36b-4aff-a5cf-580bb5f0b7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:20.221338 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-4a33dc97-f36b-4aff-a5cf-580bb5f0b7d4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:20.222656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4a33dc97-f36b-4aff-a5cf-580bb5f0b7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:20.285868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1425/2850] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:20.295305 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3f12-f95a-4d5a-976f-1938d3409ca9 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:20.295729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3f12-f95a-4d5a-976f-1938d3409ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:20.296188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e3f12-f95a-4d5a-976f-1938d3409ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:20.318321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-319e3f12-f95a-4d5a-976f-1938d3409ca9 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:20.319549 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-319e3f12-f95a-4d5a-976f-1938d3409ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:20.329062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1426/2851] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:20.333212 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33dc97-f36b-4aff-a5cf-580bb5f0b7d4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:20.343664 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33dc97-f36b-4aff-a5cf-580bb5f0b7d4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:20.348922 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1d92a-af89-43c6-8fe8-17e81c7989ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:20.349080 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1d92a-af89-43c6-8fe8-17e81c7989ea admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:20.349309 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1d92a-af89-43c6-8fe8-17e81c7989ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:20.349581 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1d92a-af89-43c6-8fe8-17e81c7989ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:20.350282 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1d92a-af89-43c6-8fe8-17e81c7989ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:44:20.350583 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1d92a-af89-43c6-8fe8-17e81c7989ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:20.352175 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb1d92a-af89-43c6-8fe8-17e81c7989ea admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:20.365535 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1426/2852] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:44:20.370252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e3f12-f95a-4d5a-976f-1938d3409ca9 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:20.385748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e3f12-f95a-4d5a-976f-1938d3409ca9 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:20.394093 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58578c0a-4b5b-4e5f-90f5-40171bd0653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:20.394717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58578c0a-4b5b-4e5f-90f5-40171bd0653e admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:20.395002 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58578c0a-4b5b-4e5f-90f5-40171bd0653e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:20.395263 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58578c0a-4b5b-4e5f-90f5-40171bd0653e admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:20.395914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58578c0a-4b5b-4e5f-90f5-40171bd0653e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:20.398027 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58578c0a-4b5b-4e5f-90f5-40171bd0653e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:20.525014 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1427/2853] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:44:20 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:44:20.530951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1d92a-af89-43c6-8fe8-17e81c7989ea admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:20.541725 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1d92a-af89-43c6-8fe8-17e81c7989ea admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:20.603429 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b54326-91bf-40f4-8b33-9b616e2d0233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:20.603955 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b54326-91bf-40f4-8b33-9b616e2d0233 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:20.604235 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b54326-91bf-40f4-8b33-9b616e2d0233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:20.604508 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b54326-91bf-40f4-8b33-9b616e2d0233 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:20.605159 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b54326-91bf-40f4-8b33-9b616e2d0233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:20.607414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b54326-91bf-40f4-8b33-9b616e2d0233 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:20.615789 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:20.690261 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1427/2854] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:44:20 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:44:20.694721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58578c0a-4b5b-4e5f-90f5-40171bd0653e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:20.706382 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58578c0a-4b5b-4e5f-90f5-40171bd0653e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:20.711219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56556d8-51a1-4318-b59e-68b64edd8d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:20.711854 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56556d8-51a1-4318-b59e-68b64edd8d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:20.712128 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56556d8-51a1-4318-b59e-68b64edd8d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:20.714230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56556d8-51a1-4318-b59e-68b64edd8d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:20.714230 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56556d8-51a1-4318-b59e-68b64edd8d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:20.714841 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56556d8-51a1-4318-b59e-68b64edd8d04 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:20.725970 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1428/2855] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:20.730201 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b54326-91bf-40f4-8b33-9b616e2d0233 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:20.740809 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b54326-91bf-40f4-8b33-9b616e2d0233 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:20.745728 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeca0a-2c39-4282-9805-2ab1922c7500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:20.753354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeca0a-2c39-4282-9805-2ab1922c7500 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:20.753354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeca0a-2c39-4282-9805-2ab1922c7500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:20.753354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aeca0a-2c39-4282-9805-2ab1922c7500 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:20.753354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeca0a-2c39-4282-9805-2ab1922c7500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:20.753354 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aeca0a-2c39-4282-9805-2ab1922c7500 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:20.766364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1428/2856] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:20.767618 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56556d8-51a1-4318-b59e-68b64edd8d04 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:20.782048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56556d8-51a1-4318-b59e-68b64edd8d04 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:20.787029 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bd587-d639-444a-9d27-7fcfa87eea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:20.787777 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bd587-d639-444a-9d27-7fcfa87eea4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:20.788127 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bd587-d639-444a-9d27-7fcfa87eea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:20.788895 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bd587-d639-444a-9d27-7fcfa87eea4a admin admin] PATH_INFO: `/v3/projects/0429f7a02a2142e4a4d22dfdda36d105/users/2199a21964464dc9af8e52e58edec25d/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:20.794909 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeca0a-2c39-4282-9805-2ab1922c7500 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:20.796719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-09aeca0a-2c39-4282-9805-2ab1922c7500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:20.805064 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bd587-d639-444a-9d27-7fcfa87eea4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0429f7a02a2142e4a4d22dfdda36d105, user_id=2199a21964464dc9af8e52e58edec25d, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:20.807922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bd587-d639-444a-9d27-7fcfa87eea4a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:20.811149 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aeca0a-2c39-4282-9805-2ab1922c7500 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:20.815929 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e7dc3-d947-44a2-9b6f-66bc774c555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:20.816550 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e7dc3-d947-44a2-9b6f-66bc774c555e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:20.816868 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e7dc3-d947-44a2-9b6f-66bc774c555e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:20.817116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e7dc3-d947-44a2-9b6f-66bc774c555e admin admin] PATH_INFO: `/v3/users/7fcce86f9874449ea29793d5621e9d9b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:20.818436 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e7dc3-d947-44a2-9b6f-66bc774c555e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fcce86f9874449ea29793d5621e9d9b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:20.820288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e7dc3-d947-44a2-9b6f-66bc774c555e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:20.934589 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1429/2857] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:20 2022] PUT /identity/v3/projects/0429f7a02a2142e4a4d22dfdda36d105/users/2199a21964464dc9af8e52e58edec25d/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:20.945325 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72381e01-a3e2-4d6a-a73d-6c9accb6ac69 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:20.945608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72381e01-a3e2-4d6a-a73d-6c9accb6ac69 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:20.945898 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72381e01-a3e2-4d6a-a73d-6c9accb6ac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:20.974658 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-72381e01-a3e2-4d6a-a73d-6c9accb6ac69 None None] MFA Rules not processed for user `2199a21964464dc9af8e52e58edec25d`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:20.975871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-72381e01-a3e2-4d6a-a73d-6c9accb6ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:21.004101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:21.037157 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b35e7dc3-d947-44a2-9b6f-66bc774c555e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fcce86f9874449ea29793d5621e9d9b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:21.045290 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b35e7dc3-d947-44a2-9b6f-66bc774c555e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fcce86f9874449ea29793d5621e9d9b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:21.046065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b35e7dc3-d947-44a2-9b6f-66bc774c555e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fcce86f9874449ea29793d5621e9d9b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:21.048959 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1430/2858] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:21.053581 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72381e01-a3e2-4d6a-a73d-6c9accb6ac69 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:21.120903 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72381e01-a3e2-4d6a-a73d-6c9accb6ac69 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:21.127306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e21dd-3c45-4310-ab4b-1ae53c133978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:21.128086 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e21dd-3c45-4310-ab4b-1ae53c133978 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:21.128469 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e21dd-3c45-4310-ab4b-1ae53c133978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:21.128732 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e21dd-3c45-4310-ab4b-1ae53c133978 admin admin] PATH_INFO: `/v3/projects` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:21.129534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e21dd-3c45-4310-ab4b-1ae53c133978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:21.132215 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e21dd-3c45-4310-ab4b-1ae53c133978 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:21.139466 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b35e7dc3-d947-44a2-9b6f-66bc774c555e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fcce86f9874449ea29793d5621e9d9b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:21.140174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-b35e7dc3-d947-44a2-9b6f-66bc774c555e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fcce86f9874449ea29793d5621e9d9b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:21.159776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1429/2859] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:20 2022] DELETE /identity/v3/users/7fcce86f9874449ea29793d5621e9d9b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:44:21.164677 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757fd3-93d4-464b-846f-a84f2dad75ad None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:21.164960 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757fd3-93d4-464b-846f-a84f2dad75ad None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:21.165233 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf757fd3-93d4-464b-846f-a84f2dad75ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:21.188065 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-cf757fd3-93d4-464b-846f-a84f2dad75ad None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:21.189381 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cf757fd3-93d4-464b-846f-a84f2dad75ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:21.253918 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1431/2860] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:44:21 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:44:21.256864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e21dd-3c45-4310-ab4b-1ae53c133978 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:21.258711 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-335e21dd-3c45-4310-ab4b-1ae53c133978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:21.261605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1430/2861] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:21.273454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf757fd3-93d4-464b-846f-a84f2dad75ad None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:21.278428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-cf757fd3-93d4-464b-846f-a84f2dad75ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:21.336702 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e21dd-3c45-4310-ab4b-1ae53c133978 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:21.337857 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf757fd3-93d4-464b-846f-a84f2dad75ad None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:21.341624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:21.342206 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475c4f5-8263-4e51-93f9-7f468e71498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:21.342823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475c4f5-8263-4e51-93f9-7f468e71498e admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:21.343128 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475c4f5-8263-4e51-93f9-7f468e71498e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:21.343401 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475c4f5-8263-4e51-93f9-7f468e71498e admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:21.344033 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475c4f5-8263-4e51-93f9-7f468e71498e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:21.346040 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475c4f5-8263-4e51-93f9-7f468e71498e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:21.390512 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f77b7-a93b-4816-86cb-276ae20f723a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:21.391047 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f77b7-a93b-4816-86cb-276ae20f723a service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:21.391324 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f77b7-a93b-4816-86cb-276ae20f723a service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:21.391593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f77b7-a93b-4816-86cb-276ae20f723a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:21.400773 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f77b7-a93b-4816-86cb-276ae20f723a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:21.402215 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f77b7-a93b-4816-86cb-276ae20f723a service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:21.412360 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1431/2862] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:44:21.424518 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1432/2863] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:44:21 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:44:21.429504 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f77b7-a93b-4816-86cb-276ae20f723a service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:21.438505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f77b7-a93b-4816-86cb-276ae20f723a service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:21.443654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67721904-1873-4ead-9787-3c92df8a919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:21.444296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721904-1873-4ead-9787-3c92df8a919f admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:21.444541 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721904-1873-4ead-9787-3c92df8a919f admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:21.444817 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721904-1873-4ead-9787-3c92df8a919f admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:21.445459 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67721904-1873-4ead-9787-3c92df8a919f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:21.447145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67721904-1873-4ead-9787-3c92df8a919f admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:21.458178 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1432/2864] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:21.462252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475c4f5-8263-4e51-93f9-7f468e71498e admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:21.473856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475c4f5-8263-4e51-93f9-7f468e71498e admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:21.478460 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc700cc-483e-45d1-866e-d689526f5797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:21.480608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc700cc-483e-45d1-866e-d689526f5797 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:21.480608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc700cc-483e-45d1-866e-d689526f5797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:21.480608 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc700cc-483e-45d1-866e-d689526f5797 admin admin] PATH_INFO: `/v3/projects/574f2be6b4194cc09a857c4bd057dba9/users/b224ae92ac0b4bce9cdba5e2cb788119/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:21.498200 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc700cc-483e-45d1-866e-d689526f5797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574f2be6b4194cc09a857c4bd057dba9, user_id=b224ae92ac0b4bce9cdba5e2cb788119, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:21.500886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc700cc-483e-45d1-866e-d689526f5797 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:21.650679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1433/2865] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:21 2022] PUT /identity/v3/projects/574f2be6b4194cc09a857c4bd057dba9/users/b224ae92ac0b4bce9cdba5e2cb788119/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:21.656531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67721904-1873-4ead-9787-3c92df8a919f admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:21.669820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67721904-1873-4ead-9787-3c92df8a919f admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:21.746037 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73629fc-ba23-4dcc-9580-ea4ba112c26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:21.747771 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73629fc-ba23-4dcc-9580-ea4ba112c26c admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:21.748170 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73629fc-ba23-4dcc-9580-ea4ba112c26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:21.748564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73629fc-ba23-4dcc-9580-ea4ba112c26c admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:21.749631 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73629fc-ba23-4dcc-9580-ea4ba112c26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:21.752270 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73629fc-ba23-4dcc-9580-ea4ba112c26c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:21.770053 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1433/2866] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:21.774262 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc700cc-483e-45d1-866e-d689526f5797 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:21.788427 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc700cc-483e-45d1-866e-d689526f5797 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:21.796186 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d4a4b-2ab7-4973-9e3d-a70390008a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:21.796871 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4a4b-2ab7-4973-9e3d-a70390008a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:21.797154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4a4b-2ab7-4973-9e3d-a70390008a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:21.797806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d4a4b-2ab7-4973-9e3d-a70390008a64 admin admin] PATH_INFO: `/v3/projects/574f2be6b4194cc09a857c4bd057dba9/users/b224ae92ac0b4bce9cdba5e2cb788119/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:21.799739 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d4a4b-2ab7-4973-9e3d-a70390008a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=574f2be6b4194cc09a857c4bd057dba9, user_id=b224ae92ac0b4bce9cdba5e2cb788119, role_id=3e0fa6dce41f4f8dbebf5d5ae9ec99cf)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:21.802590 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d4a4b-2ab7-4973-9e3d-a70390008a64 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:21.814915 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1434/2867] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:21 2022] PUT /identity/v3/projects/574f2be6b4194cc09a857c4bd057dba9/users/b224ae92ac0b4bce9cdba5e2cb788119/roles/3e0fa6dce41f4f8dbebf5d5ae9ec99cf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:21.827911 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2187-5e92-4acc-91e7-0507c188794a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:21.828195 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2187-5e92-4acc-91e7-0507c188794a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:21.828439 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2187-5e92-4acc-91e7-0507c188794a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:21.863693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-93cd2187-5e92-4acc-91e7-0507c188794a None None] MFA Rules not processed for user `b224ae92ac0b4bce9cdba5e2cb788119`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:21.864923 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-93cd2187-5e92-4acc-91e7-0507c188794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:21.942117 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1434/2868] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:21.957577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d4a4b-2ab7-4973-9e3d-a70390008a64 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:21.959383 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-bf0d4a4b-2ab7-4973-9e3d-a70390008a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:21.966181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:21.989485 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd2187-5e92-4acc-91e7-0507c188794a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:21.992708 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-93cd2187-5e92-4acc-91e7-0507c188794a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:22.042983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=100 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:22.061402 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d4a4b-2ab7-4973-9e3d-a70390008a64 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:22.065292 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3db81-28b6-4bd7-9bde-b674f0cdd4b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:22.066066 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3db81-28b6-4bd7-9bde-b674f0cdd4b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:22.066360 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3db81-28b6-4bd7-9bde-b674f0cdd4b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:22.066691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3db81-28b6-4bd7-9bde-b674f0cdd4b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:22.076875 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3db81-28b6-4bd7-9bde-b674f0cdd4b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:22.078473 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3db81-28b6-4bd7-9bde-b674f0cdd4b2 service cinder] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:22.088808 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1435/2869] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:22.093464 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd2187-5e92-4acc-91e7-0507c188794a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:22.106385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:22.106385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:22.106385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:22.106385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] PATH_INFO: `/v3/projects/1eab7f8446b244078ae374f20ce73781` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:22.106738 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eab7f8446b244078ae374f20ce73781)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:22.108780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:22.273585 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eab7f8446b244078ae374f20ce73781', 'request_id': 'req-533834d6-fcef-48b9-b0fb-93308db644bd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:22.280823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eab7f8446b244078ae374f20ce73781', 'request_id': 'req-533834d6-fcef-48b9-b0fb-93308db644bd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:22.289371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eab7f8446b244078ae374f20ce73781', 'request_id': 'req-533834d6-fcef-48b9-b0fb-93308db644bd'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:22.374656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] The token cache is being invalidate because project 1eab7f8446b244078ae374f20ce73781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:22.374996 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:22.375839 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-533834d6-fcef-48b9-b0fb-93308db644bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:22.377568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1435/2870] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:21 2022] DELETE /identity/v3/projects/1eab7f8446b244078ae374f20ce73781 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:22.382726 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bf11a-c0c7-4362-b11a-67bd08dd71a3 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:22.383075 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bf11a-c0c7-4362-b11a-67bd08dd71a3 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:22.383413 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bf11a-c0c7-4362-b11a-67bd08dd71a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:22.415643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6e1bf11a-c0c7-4362-b11a-67bd08dd71a3 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:22.417749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6e1bf11a-c0c7-4362-b11a-67bd08dd71a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:22.492522 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1436/2871] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:22.502568 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0237f0-1cc0-4650-84f4-fb36ca665e52 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:22.502853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0237f0-1cc0-4650-84f4-fb36ca665e52 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:22.503126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0237f0-1cc0-4650-84f4-fb36ca665e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:22.525745 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-1c0237f0-1cc0-4650-84f4-fb36ca665e52 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:22.526994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-1c0237f0-1cc0-4650-84f4-fb36ca665e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:22.537467 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1436/2872] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:22.542169 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bf11a-c0c7-4362-b11a-67bd08dd71a3 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:22.552833 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bf11a-c0c7-4362-b11a-67bd08dd71a3 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:22.559691 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021d4f4-6ab0-4b3d-ba3f-bf2476f67d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:22.560778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021d4f4-6ab0-4b3d-ba3f-bf2476f67d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:22.561414 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021d4f4-6ab0-4b3d-ba3f-bf2476f67d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:22.561788 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021d4f4-6ab0-4b3d-ba3f-bf2476f67d97 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:22.562863 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021d4f4-6ab0-4b3d-ba3f-bf2476f67d97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:44:22.563848 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021d4f4-6ab0-4b3d-ba3f-bf2476f67d97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:22.565682 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021d4f4-6ab0-4b3d-ba3f-bf2476f67d97 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:22.578627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1437/2873] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:44:22.583242 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0237f0-1cc0-4650-84f4-fb36ca665e52 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:22.593826 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0237f0-1cc0-4650-84f4-fb36ca665e52 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:22.598852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793bc03-895b-4eb0-a4f5-2f73a35f75b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:22.599471 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793bc03-895b-4eb0-a4f5-2f73a35f75b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:22.599751 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793bc03-895b-4eb0-a4f5-2f73a35f75b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:22.600019 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793bc03-895b-4eb0-a4f5-2f73a35f75b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:22.600728 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793bc03-895b-4eb0-a4f5-2f73a35f75b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:22.602655 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793bc03-895b-4eb0-a4f5-2f73a35f75b1 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:22.651585 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021d4f4-6ab0-4b3d-ba3f-bf2476f67d97 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:22.653411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6021d4f4-6ab0-4b3d-ba3f-bf2476f67d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:22.666879 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021d4f4-6ab0-4b3d-ba3f-bf2476f67d97 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:22.672480 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526107b-5608-4e71-af46-06dac13e4d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:22.673156 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526107b-5608-4e71-af46-06dac13e4d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:22.673437 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526107b-5608-4e71-af46-06dac13e4d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:22.673710 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526107b-5608-4e71-af46-06dac13e4d9e admin admin] PATH_INFO: `/v3/users/2199a21964464dc9af8e52e58edec25d` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:22.674948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526107b-5608-4e71-af46-06dac13e4d9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2199a21964464dc9af8e52e58edec25d)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:22.676920 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0526107b-5608-4e71-af46-06dac13e4d9e admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:22.690658 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1437/2874] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:44:22 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:44:22.695043 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793bc03-895b-4eb0-a4f5-2f73a35f75b1 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:22.763641 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793bc03-895b-4eb0-a4f5-2f73a35f75b1 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:22.771828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd206f12-edc3-4470-87e2-b121e845aac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:22.772455 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd206f12-edc3-4470-87e2-b121e845aac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:22.772732 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd206f12-edc3-4470-87e2-b121e845aac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:22.773003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd206f12-edc3-4470-87e2-b121e845aac0 admin admin] PATH_INFO: `/v3/users` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:22.773642 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd206f12-edc3-4470-87e2-b121e845aac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:22.775611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd206f12-edc3-4470-87e2-b121e845aac0 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:22.882716 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1438/2875] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:44:22 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:44:22.886992 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd206f12-edc3-4470-87e2-b121e845aac0 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:22.897578 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd206f12-edc3-4470-87e2-b121e845aac0 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:22.903139 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5b0ba-10e2-4198-a7bb-64a9448db187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:22.903994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5b0ba-10e2-4198-a7bb-64a9448db187 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:22.904135 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5b0ba-10e2-4198-a7bb-64a9448db187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:22.904368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5b0ba-10e2-4198-a7bb-64a9448db187 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:22.905087 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5b0ba-10e2-4198-a7bb-64a9448db187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:22.906770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5b0ba-10e2-4198-a7bb-64a9448db187 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:22.912682 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:22.915936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0526107b-5608-4e71-af46-06dac13e4d9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2199a21964464dc9af8e52e58edec25d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:22.918852 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1439/2876] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 16:44:22.923647 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5b0ba-10e2-4198-a7bb-64a9448db187 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:22.924047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0526107b-5608-4e71-af46-06dac13e4d9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2199a21964464dc9af8e52e58edec25d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:22.926984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0526107b-5608-4e71-af46-06dac13e4d9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2199a21964464dc9af8e52e58edec25d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:22.934462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5b0ba-10e2-4198-a7bb-64a9448db187 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:22.939304 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b469c5b-6fad-4cdf-83f1-65e133926510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:22.939910 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469c5b-6fad-4cdf-83f1-65e133926510 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:22.940188 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469c5b-6fad-4cdf-83f1-65e133926510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:22.940457 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469c5b-6fad-4cdf-83f1-65e133926510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:22.941100 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b469c5b-6fad-4cdf-83f1-65e133926510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:22.942729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b469c5b-6fad-4cdf-83f1-65e133926510 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:22.954714 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1440/2877] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:22.959131 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b469c5b-6fad-4cdf-83f1-65e133926510 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:22.969213 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b469c5b-6fad-4cdf-83f1-65e133926510 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:22.973993 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7aa3a-65f5-466b-abe4-f11e99d4db97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:22.974653 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7aa3a-65f5-466b-abe4-f11e99d4db97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:22.974932 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7aa3a-65f5-466b-abe4-f11e99d4db97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:22.975204 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7aa3a-65f5-466b-abe4-f11e99d4db97 admin admin] PATH_INFO: `/v3/projects/666a1fde6c074c0e8f30a7aff68dd369/users/b98b6026ec1e49be91f14953eda56adb/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:22.990387 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7aa3a-65f5-466b-abe4-f11e99d4db97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=666a1fde6c074c0e8f30a7aff68dd369, user_id=b98b6026ec1e49be91f14953eda56adb, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:22.993027 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7aa3a-65f5-466b-abe4-f11e99d4db97 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:23.007693 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0526107b-5608-4e71-af46-06dac13e4d9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2199a21964464dc9af8e52e58edec25d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:23.021103 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-0526107b-5608-4e71-af46-06dac13e4d9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2199a21964464dc9af8e52e58edec25d'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:23.027364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1438/2878] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:22 2022] DELETE /identity/v3/users/2199a21964464dc9af8e52e58edec25d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:44:23.031765 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954c549-ae3e-44c9-8ea4-70e2857a5879 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:23.032047 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954c549-ae3e-44c9-8ea4-70e2857a5879 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:23.032316 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954c549-ae3e-44c9-8ea4-70e2857a5879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:23.039998 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:23.051301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-6954c549-ae3e-44c9-8ea4-70e2857a5879 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:23.052491 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6954c549-ae3e-44c9-8ea4-70e2857a5879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:23.077684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1441/2879] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:22 2022] PUT /identity/v3/projects/666a1fde6c074c0e8f30a7aff68dd369/users/b98b6026ec1e49be91f14953eda56adb/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:44:23.088561 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5024-6c03-4a00-9ae3-200d4017a50f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:23.088850 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5024-6c03-4a00-9ae3-200d4017a50f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:23.089121 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5024-6c03-4a00-9ae3-200d4017a50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:23.114806 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1439/2880] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:23.120532 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-3e5f5024-6c03-4a00-9ae3-200d4017a50f None None] MFA Rules not processed for user `b98b6026ec1e49be91f14953eda56adb`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:23.122296 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3e5f5024-6c03-4a00-9ae3-200d4017a50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:23.125730 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954c549-ae3e-44c9-8ea4-70e2857a5879 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:23.127249 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-6954c549-ae3e-44c9-8ea4-70e2857a5879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:23.189859 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954c549-ae3e-44c9-8ea4-70e2857a5879 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:23.193008 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1442/2881] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:23.205991 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f5024-6c03-4a00-9ae3-200d4017a50f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:23.214727 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-3e5f5024-6c03-4a00-9ae3-200d4017a50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:23.242665 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1595836-cd8f-467f-8d8f-5a3ac6e4cc81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:23.243286 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1595836-cd8f-467f-8d8f-5a3ac6e4cc81 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:23.243566 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1595836-cd8f-467f-8d8f-5a3ac6e4cc81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:23.243836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1595836-cd8f-467f-8d8f-5a3ac6e4cc81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:23.270180 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f5024-6c03-4a00-9ae3-200d4017a50f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:23.274527 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ad95-dbf6-4cdf-9f7e-535eeb36e894 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a16e6246fb4693b044bf939bce8244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:23.275299 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ad95-dbf6-4cdf-9f7e-535eeb36e894 service glance] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:23.275580 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ad95-dbf6-4cdf-9f7e-535eeb36e894 service glance] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:23.275853 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ad95-dbf6-4cdf-9f7e-535eeb36e894 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:23.285675 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9ad95-dbf6-4cdf-9f7e-535eeb36e894 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:23.287146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9ad95-dbf6-4cdf-9f7e-535eeb36e894 service glance] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:23.298174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1443/2882] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:44:23.314012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1595836-cd8f-467f-8d8f-5a3ac6e4cc81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:23.315575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1595836-cd8f-467f-8d8f-5a3ac6e4cc81 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:23.326975 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1440/2883] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:23.786748 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ad95-dbf6-4cdf-9f7e-535eeb36e894 service glance] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:23.788265 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-4fb9ad95-dbf6-4cdf-9f7e-535eeb36e894 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:23.806192 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ad95-dbf6-4cdf-9f7e-535eeb36e894 service glance] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:23.814440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:23.815258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:23.815605 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:23.815874 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] PATH_INFO: `/v3/projects/0429f7a02a2142e4a4d22dfdda36d105` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:23.818681 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0429f7a02a2142e4a4d22dfdda36d105)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:23.821654 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:23.958609 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0429f7a02a2142e4a4d22dfdda36d105', 'request_id': 'req-025a75af-2cbb-4d9e-b369-4b0ebb11014a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:23.961983 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:23.967408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0429f7a02a2142e4a4d22dfdda36d105', 'request_id': 'req-025a75af-2cbb-4d9e-b369-4b0ebb11014a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:23.975258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0429f7a02a2142e4a4d22dfdda36d105', 'request_id': 'req-025a75af-2cbb-4d9e-b369-4b0ebb11014a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:24.079762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] The token cache is being invalidate because project 0429f7a02a2142e4a4d22dfdda36d105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:24.079762 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:24.080379 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:24.082061 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1444/2884] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:23 2022] DELETE /identity/v3/projects/0429f7a02a2142e4a4d22dfdda36d105 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:24.087076 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1595836-cd8f-467f-8d8f-5a3ac6e4cc81 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:24.100089 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1595836-cd8f-467f-8d8f-5a3ac6e4cc81 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:24.113466 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:24.174329 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4294210-5e8c-4d2e-9d16-750157e3cb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:24.174870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4294210-5e8c-4d2e-9d16-750157e3cb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:24.175341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4294210-5e8c-4d2e-9d16-750157e3cb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:24.175827 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4294210-5e8c-4d2e-9d16-750157e3cb3d admin admin] PATH_INFO: `/v3/users/b224ae92ac0b4bce9cdba5e2cb788119` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:24.177968 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4294210-5e8c-4d2e-9d16-750157e3cb3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b224ae92ac0b4bce9cdba5e2cb788119)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:24.180543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4294210-5e8c-4d2e-9d16-750157e3cb3d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:24.443306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c4294210-5e8c-4d2e-9d16-750157e3cb3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b224ae92ac0b4bce9cdba5e2cb788119'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:24.451181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c4294210-5e8c-4d2e-9d16-750157e3cb3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b224ae92ac0b4bce9cdba5e2cb788119'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:24.452055 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c4294210-5e8c-4d2e-9d16-750157e3cb3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b224ae92ac0b4bce9cdba5e2cb788119'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:24.533745 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c4294210-5e8c-4d2e-9d16-750157e3cb3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b224ae92ac0b4bce9cdba5e2cb788119'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:24.548453 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-c4294210-5e8c-4d2e-9d16-750157e3cb3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b224ae92ac0b4bce9cdba5e2cb788119'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:24.554938 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1441/2885] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:24 2022] DELETE /identity/v3/users/b224ae92ac0b4bce9cdba5e2cb788119 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:25.165666 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:25.167884 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:25.191577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a75af-2cbb-4d9e-b369-4b0ebb11014a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:25.264463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:25.266646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:25.266646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:25.266646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] PATH_INFO: `/v3/projects/574f2be6b4194cc09a857c4bd057dba9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:25.267062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574f2be6b4194cc09a857c4bd057dba9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:25.268820 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:25.442739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574f2be6b4194cc09a857c4bd057dba9', 'request_id': 'req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:25.450059 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574f2be6b4194cc09a857c4bd057dba9', 'request_id': 'req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:25.455845 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574f2be6b4194cc09a857c4bd057dba9', 'request_id': 'req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:25.560364 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] The token cache is being invalidate because project 574f2be6b4194cc09a857c4bd057dba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:25.560755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:25.561437 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ac2d07cb-4aa7-4d75-bf54-fee0e3f629c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:25.563031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1445/2886] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:25 2022] DELETE /identity/v3/projects/574f2be6b4194cc09a857c4bd057dba9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:25.570012 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f6c6c-bf28-408d-93b4-0f951008f1f1 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:25.570495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f6c6c-bf28-408d-93b4-0f951008f1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:25.570768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f6c6c-bf28-408d-93b4-0f951008f1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:25.601216 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-101f6c6c-bf28-408d-93b4-0f951008f1f1 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:25.606275 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-101f6c6c-bf28-408d-93b4-0f951008f1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:25.682411 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1442/2887] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:25.691374 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bb67d-9b94-4561-bd10-dbb8f22cbe4f None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:25.691690 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bb67d-9b94-4561-bd10-dbb8f22cbe4f None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:25.691967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054bb67d-9b94-4561-bd10-dbb8f22cbe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:25.712404 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-054bb67d-9b94-4561-bd10-dbb8f22cbe4f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:25.716906 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-054bb67d-9b94-4561-bd10-dbb8f22cbe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:25.724067 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1446/2888] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:25.728481 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f6c6c-bf28-408d-93b4-0f951008f1f1 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:25.740533 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f6c6c-bf28-408d-93b4-0f951008f1f1 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:25.745320 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec16359-2b1b-44fb-9aa7-dfe40e5d71be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:25.745943 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16359-2b1b-44fb-9aa7-dfe40e5d71be admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:25.746219 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16359-2b1b-44fb-9aa7-dfe40e5d71be admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:25.747300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec16359-2b1b-44fb-9aa7-dfe40e5d71be admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:25.747762 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec16359-2b1b-44fb-9aa7-dfe40e5d71be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:44:25.748005 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec16359-2b1b-44fb-9aa7-dfe40e5d71be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:25.749588 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec16359-2b1b-44fb-9aa7-dfe40e5d71be admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:25.761579 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1443/2889] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 16:44:25.766821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bb67d-9b94-4561-bd10-dbb8f22cbe4f None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:25.776489 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054bb67d-9b94-4561-bd10-dbb8f22cbe4f None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:25.782126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8aac5-8faa-4edf-a87a-10f34961790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:25.782729 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8aac5-8faa-4edf-a87a-10f34961790c admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:25.783002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8aac5-8faa-4edf-a87a-10f34961790c admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:25.783266 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8aac5-8faa-4edf-a87a-10f34961790c admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:25.784080 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8aac5-8faa-4edf-a87a-10f34961790c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:25.786474 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8aac5-8faa-4edf-a87a-10f34961790c admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:25.886083 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1447/2890] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:44:25 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:44:25.888231 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec16359-2b1b-44fb-9aa7-dfe40e5d71be admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:25.899677 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec16359-2b1b-44fb-9aa7-dfe40e5d71be admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:25.912861 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:25.968404 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d05d-a6c3-44dc-98ca-32ac1a43f454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:25.968940 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d05d-a6c3-44dc-98ca-32ac1a43f454 admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:25.969342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d05d-a6c3-44dc-98ca-32ac1a43f454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:25.969555 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d05d-a6c3-44dc-98ca-32ac1a43f454 admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:25.970161 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308d05d-a6c3-44dc-98ca-32ac1a43f454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:25.974377 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308d05d-a6c3-44dc-98ca-32ac1a43f454 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:26.099132 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1444/2891] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:44:25 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:44:26.100610 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8aac5-8faa-4edf-a87a-10f34961790c admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:26.112275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8aac5-8faa-4edf-a87a-10f34961790c admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:26.116776 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a9db3-4711-4d24-abba-5b55c4d18f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:26.117368 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9db3-4711-4d24-abba-5b55c4d18f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:26.117644 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9db3-4711-4d24-abba-5b55c4d18f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:26.117939 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1a9db3-4711-4d24-abba-5b55c4d18f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:26.118684 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a9db3-4711-4d24-abba-5b55c4d18f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:26.120414 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1a9db3-4711-4d24-abba-5b55c4d18f36 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:26.132194 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1448/2892] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:26.144864 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d05d-a6c3-44dc-98ca-32ac1a43f454 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:26.158271 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d05d-a6c3-44dc-98ca-32ac1a43f454 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:26.163058 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1953f0-7d18-49fd-9e6d-c64aee21e713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:26.163659 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1953f0-7d18-49fd-9e6d-c64aee21e713 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:26.163948 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1953f0-7d18-49fd-9e6d-c64aee21e713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:26.164198 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1953f0-7d18-49fd-9e6d-c64aee21e713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:26.164856 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1953f0-7d18-49fd-9e6d-c64aee21e713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:26.166517 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1953f0-7d18-49fd-9e6d-c64aee21e713 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:26.179575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1445/2893] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:26.184871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a9db3-4711-4d24-abba-5b55c4d18f36 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:26.196075 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1a9db3-4711-4d24-abba-5b55c4d18f36 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:26.201476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfaf7c-4c1a-4c16-857b-dae7998ac555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:26.202181 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfaf7c-4c1a-4c16-857b-dae7998ac555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:26.202467 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfaf7c-4c1a-4c16-857b-dae7998ac555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:26.202739 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdfaf7c-4c1a-4c16-857b-dae7998ac555 admin admin] PATH_INFO: `/v3/projects/a8de3afa25644256bb9a7e68074f5139/users/a4fca67204fe4857b4a402011a01b80e/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:26.220701 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfaf7c-4c1a-4c16-857b-dae7998ac555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8de3afa25644256bb9a7e68074f5139, user_id=a4fca67204fe4857b4a402011a01b80e, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:26.223308 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdfaf7c-4c1a-4c16-857b-dae7998ac555 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:26.316927 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1449/2894] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:26 2022] PUT /identity/v3/projects/a8de3afa25644256bb9a7e68074f5139/users/a4fca67204fe4857b4a402011a01b80e/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:44:26.329678 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d3039-52a7-451b-95c8-69ee076bc08a None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:26.330001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d3039-52a7-451b-95c8-69ee076bc08a None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:26.330270 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d3039-52a7-451b-95c8-69ee076bc08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:26.361514 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-dd7d3039-52a7-451b-95c8-69ee076bc08a None None] MFA Rules not processed for user `a4fca67204fe4857b4a402011a01b80e`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:26.362791 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-dd7d3039-52a7-451b-95c8-69ee076bc08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:26.437345 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1446/2895] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:26.451856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfaf7c-4c1a-4c16-857b-dae7998ac555 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:26.452648 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-bfdfaf7c-4c1a-4c16-857b-dae7998ac555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:26.468002 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:26.519619 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdfaf7c-4c1a-4c16-857b-dae7998ac555 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:26.523943 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1636e1-12ee-4971-89d3-cad34005b552 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18a16e6246fb4693b044bf939bce8244', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:26.524576 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1636e1-12ee-4971-89d3-cad34005b552 service glance] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:26.524881 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1636e1-12ee-4971-89d3-cad34005b552 service glance] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:26.525147 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1636e1-12ee-4971-89d3-cad34005b552 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:26.535970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1636e1-12ee-4971-89d3-cad34005b552 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:26.538060 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1636e1-12ee-4971-89d3-cad34005b552 service glance] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:26.549385 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1450/2896] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:30.687289 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d3039-52a7-451b-95c8-69ee076bc08a None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:30.688719 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-dd7d3039-52a7-451b-95c8-69ee076bc08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:30.767221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d3039-52a7-451b-95c8-69ee076bc08a None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:30.771737 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:30.772374 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:30.772670 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:30.772936 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] PATH_INFO: `/v3/users/d290967dd55b42619c75ab1e7e0c717f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:30.774096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d290967dd55b42619c75ab1e7e0c717f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:30.776004 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:30.884814 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:30.987717 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd290967dd55b42619c75ab1e7e0c717f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:30.995295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd290967dd55b42619c75ab1e7e0c717f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:30.996069 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd290967dd55b42619c75ab1e7e0c717f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:31.110499 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd290967dd55b42619c75ab1e7e0c717f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:31.126001 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd290967dd55b42619c75ab1e7e0c717f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:31.134849 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1447/2897] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:30 2022] DELETE /identity/v3/users/d290967dd55b42619c75ab1e7e0c717f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:31.142672 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5b116-e2db-4d2a-ac2a-7a00c6da1ed4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:31.143252 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5b116-e2db-4d2a-ac2a-7a00c6da1ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:31.143365 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5b116-e2db-4d2a-ac2a-7a00c6da1ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:31.163137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-c2a5b116-e2db-4d2a-ac2a-7a00c6da1ed4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:31.164227 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c2a5b116-e2db-4d2a-ac2a-7a00c6da1ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:31.231271 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1451/2898] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:31.240048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:31.241964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:31.308627 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53957d-83b7-43d1-b207-fff4b83688a3 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:31.313834 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c74e0c-cbde-4c12-a7f2-7b324543bbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:31.314515 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74e0c-cbde-4c12-a7f2-7b324543bbcf service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:31.314757 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74e0c-cbde-4c12-a7f2-7b324543bbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:31.315034 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74e0c-cbde-4c12-a7f2-7b324543bbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:31.333364 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c74e0c-cbde-4c12-a7f2-7b324543bbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:31.335048 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c74e0c-cbde-4c12-a7f2-7b324543bbcf service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:31.346244 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1448/2899] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:32.051003 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5b116-e2db-4d2a-ac2a-7a00c6da1ed4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:32.052810 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-c2a5b116-e2db-4d2a-ac2a-7a00c6da1ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:32.066516 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5b116-e2db-4d2a-ac2a-7a00c6da1ed4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:32.071448 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:32.072126 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:32.072406 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:32.072686 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] PATH_INFO: `/v3/projects/ca600fe5e0fa4e43918b39596f552668` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:32.075408 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca600fe5e0fa4e43918b39596f552668)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:32.077359 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:32.250925 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca600fe5e0fa4e43918b39596f552668', 'request_id': 'req-f431e029-d0e4-4f67-ae85-cb3154ad98d3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:32.258476 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca600fe5e0fa4e43918b39596f552668', 'request_id': 'req-f431e029-d0e4-4f67-ae85-cb3154ad98d3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:32.266258 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca600fe5e0fa4e43918b39596f552668', 'request_id': 'req-f431e029-d0e4-4f67-ae85-cb3154ad98d3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:32.350843 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] The token cache is being invalidate because project ca600fe5e0fa4e43918b39596f552668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:32.351137 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:32.351803 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-f431e029-d0e4-4f67-ae85-cb3154ad98d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:32.353500 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1452/2900] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:32 2022] DELETE /identity/v3/projects/ca600fe5e0fa4e43918b39596f552668 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:41.341181 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=45,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:42.347423 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:49.495960 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c74e0c-cbde-4c12-a7f2-7b324543bbcf service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:49.497455 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-d9c74e0c-cbde-4c12-a7f2-7b324543bbcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:49.510982 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c74e0c-cbde-4c12-a7f2-7b324543bbcf service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:49.569587 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:49.570252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:49.570527 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:49.570797 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] PATH_INFO: `/v3/users/a4fca67204fe4857b4a402011a01b80e` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:49.571957 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fca67204fe4857b4a402011a01b80e)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:49.573862 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:49.840063 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fca67204fe4857b4a402011a01b80e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:49.847942 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fca67204fe4857b4a402011a01b80e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:49.848641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fca67204fe4857b4a402011a01b80e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:49.944557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fca67204fe4857b4a402011a01b80e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:49.958185 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fca67204fe4857b4a402011a01b80e'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:49.964634 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1449/2901] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:49 2022] DELETE /identity/v3/users/a4fca67204fe4857b4a402011a01b80e => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:49.969592 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637ae4-d496-42e7-9757-532c2f3f2c21 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:49.970156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637ae4-d496-42e7-9757-532c2f3f2c21 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:49.970156 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a637ae4-d496-42e7-9757-532c2f3f2c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:49.990498 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-9a637ae4-d496-42e7-9757-532c2f3f2c21 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:49.992994 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9a637ae4-d496-42e7-9757-532c2f3f2c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:50.061024 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1453/2902] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:50.073096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:50.074554 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:50.148112 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00370f58-b96a-4afa-a469-15a74407564d admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:50.151992 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52680595-20a2-4b2b-8097-c80e76f6e577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:50.152607 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52680595-20a2-4b2b-8097-c80e76f6e577 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:50.152886 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52680595-20a2-4b2b-8097-c80e76f6e577 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:50.153154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52680595-20a2-4b2b-8097-c80e76f6e577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:50.162866 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52680595-20a2-4b2b-8097-c80e76f6e577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:50.164321 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52680595-20a2-4b2b-8097-c80e76f6e577 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:50.175088 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1450/2903] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:50.699657 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a637ae4-d496-42e7-9757-532c2f3f2c21 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:50.701970 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-9a637ae4-d496-42e7-9757-532c2f3f2c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:50.731856 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a637ae4-d496-42e7-9757-532c2f3f2c21 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:50.750337 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:50.751148 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:50.751494 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:50.751834 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] PATH_INFO: `/v3/projects/a8de3afa25644256bb9a7e68074f5139` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:50.756236 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8de3afa25644256bb9a7e68074f5139)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:50.759120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:50.925964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8de3afa25644256bb9a7e68074f5139', 'request_id': 'req-ee730501-9bcb-4ae3-8058-7b59e74b88e3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:50.933238 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8de3afa25644256bb9a7e68074f5139', 'request_id': 'req-ee730501-9bcb-4ae3-8058-7b59e74b88e3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:50.940062 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8de3afa25644256bb9a7e68074f5139', 'request_id': 'req-ee730501-9bcb-4ae3-8058-7b59e74b88e3'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:51.020741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] The token cache is being invalidate because project a8de3afa25644256bb9a7e68074f5139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:51.021412 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:51.022154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-ee730501-9bcb-4ae3-8058-7b59e74b88e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:51.024127 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1454/2904] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:50 2022] DELETE /identity/v3/projects/a8de3afa25644256bb9a7e68074f5139 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:51.028741 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bc5d7-8813-41bd-91fa-edf9cc694c0f None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:51.029212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bc5d7-8813-41bd-91fa-edf9cc694c0f None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:51.029309 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3bc5d7-8813-41bd-91fa-edf9cc694c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:51.051643 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-3a3bc5d7-8813-41bd-91fa-edf9cc694c0f None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:51.052867 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3a3bc5d7-8813-41bd-91fa-edf9cc694c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:51.072060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:51.142102 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1451/2905] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:51.149678 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffb471-7a67-416c-a1ab-eb81330dce1a None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:51.150012 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffb471-7a67-416c-a1ab-eb81330dce1a None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:51.150291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffb471-7a67-416c-a1ab-eb81330dce1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:51.172887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-49ffb471-7a67-416c-a1ab-eb81330dce1a None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:51.174435 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-49ffb471-7a67-416c-a1ab-eb81330dce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:51.184207 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1455/2906] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:51.188679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bc5d7-8813-41bd-91fa-edf9cc694c0f None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:51.199756 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3bc5d7-8813-41bd-91fa-edf9cc694c0f None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:51.205394 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5260a5-bb5c-4186-ae8c-2f782b9ac082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:51.206203 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5260a5-bb5c-4186-ae8c-2f782b9ac082 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:51.206551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5260a5-bb5c-4186-ae8c-2f782b9ac082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:51.206891 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5260a5-bb5c-4186-ae8c-2f782b9ac082 admin admin] PATH_INFO: `/v3/domains` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:51.207619 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5260a5-bb5c-4186-ae8c-2f782b9ac082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81783) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 16:44:51.207922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5260a5-bb5c-4186-ae8c-2f782b9ac082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:51.209686 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5260a5-bb5c-4186-ae8c-2f782b9ac082 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:51.222847 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1452/2907] 10.222.0.15 () {58 vars in 1153 bytes} [Thu Sep 1 16:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 16:44:51.227216 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffb471-7a67-416c-a1ab-eb81330dce1a None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:51.237623 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffb471-7a67-416c-a1ab-eb81330dce1a None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:51.242454 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe6471-01ef-44fd-9700-5300e0c4326b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:51.243051 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe6471-01ef-44fd-9700-5300e0c4326b admin admin] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:51.243499 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe6471-01ef-44fd-9700-5300e0c4326b admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:51.243828 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe6471-01ef-44fd-9700-5300e0c4326b admin admin] PATH_INFO: `/v3/projects` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:51.244646 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe6471-01ef-44fd-9700-5300e0c4326b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:51.246719 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe6471-01ef-44fd-9700-5300e0c4326b admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:51.358288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1456/2908] 10.222.0.15 () {60 vars in 1153 bytes} [Thu Sep 1 16:44:51 2022] POST /identity/v3/projects => generated 397 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 16:44:51.362972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5260a5-bb5c-4186-ae8c-2f782b9ac082 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:51.375099 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5260a5-bb5c-4186-ae8c-2f782b9ac082 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:51.450295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3a671-7e03-41bc-a628-97cfa2a9d3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:51.451268 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3a671-7e03-41bc-a628-97cfa2a9d3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:51.451783 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3a671-7e03-41bc-a628-97cfa2a9d3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:51.453661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3a671-7e03-41bc-a628-97cfa2a9d3ab admin admin] PATH_INFO: `/v3/users` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:51.454736 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3a671-7e03-41bc-a628-97cfa2a9d3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:51.459628 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3a671-7e03-41bc-a628-97cfa2a9d3ab admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:51.597306 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1453/2909] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Sep 1 16:44:51 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 16:44:51.601611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe6471-01ef-44fd-9700-5300e0c4326b admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:51.612591 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe6471-01ef-44fd-9700-5300e0c4326b admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:51.617259 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f08350-4952-4494-86e1-27fb012cfe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:51.617866 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f08350-4952-4494-86e1-27fb012cfe8e admin admin] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:51.618172 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f08350-4952-4494-86e1-27fb012cfe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:51.618440 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f08350-4952-4494-86e1-27fb012cfe8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:51.619079 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f08350-4952-4494-86e1-27fb012cfe8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:51.620662 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f08350-4952-4494-86e1-27fb012cfe8e admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:51.631564 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1457/2910] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:51.635718 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3a671-7e03-41bc-a628-97cfa2a9d3ab admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:51.645972 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3a671-7e03-41bc-a628-97cfa2a9d3ab admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:51.651096 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995beb7-7b64-4e18-93c6-61959de1f916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:51.651709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995beb7-7b64-4e18-93c6-61959de1f916 admin admin] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:51.651984 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995beb7-7b64-4e18-93c6-61959de1f916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:51.652252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995beb7-7b64-4e18-93c6-61959de1f916 admin admin] PATH_INFO: `/v3/roles` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:51.652901 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995beb7-7b64-4e18-93c6-61959de1f916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:51.654516 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995beb7-7b64-4e18-93c6-61959de1f916 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:51.666922 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1454/2911] 10.222.0.15 () {58 vars in 1122 bytes} [Thu Sep 1 16:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 16:44:51.671770 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f08350-4952-4494-86e1-27fb012cfe8e admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:51.682210 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f08350-4952-4494-86e1-27fb012cfe8e admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:51.687042 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3ec87-69fc-4187-beb7-25d49a996b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:51.687887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3ec87-69fc-4187-beb7-25d49a996b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:51.688167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3ec87-69fc-4187-beb7-25d49a996b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:51.688441 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d3ec87-69fc-4187-beb7-25d49a996b12 admin admin] PATH_INFO: `/v3/projects/0330843dc28b410b859d68a9db7922ca/users/25a74dd46cd7429193de8468506c23f9/roles/eb63c7589f0c472b9e1abd79cbdd7528` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:51.704893 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3ec87-69fc-4187-beb7-25d49a996b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0330843dc28b410b859d68a9db7922ca, user_id=25a74dd46cd7429193de8468506c23f9, role_id=eb63c7589f0c472b9e1abd79cbdd7528)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:51.707505 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d3ec87-69fc-4187-beb7-25d49a996b12 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:51.794129 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1458/2912] 10.222.0.15 () {60 vars in 1483 bytes} [Thu Sep 1 16:44:51 2022] PUT /identity/v3/projects/0330843dc28b410b859d68a9db7922ca/users/25a74dd46cd7429193de8468506c23f9/roles/eb63c7589f0c472b9e1abd79cbdd7528 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:51.799858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033de8-7554-40e0-90f9-36560065fccf None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:51.801974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033de8-7554-40e0-90f9-36560065fccf None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:51.801974 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033de8-7554-40e0-90f9-36560065fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:51.837988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-b3033de8-7554-40e0-90f9-36560065fccf None None] MFA Rules not processed for user `25a74dd46cd7429193de8468506c23f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:51.839361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b3033de8-7554-40e0-90f9-36560065fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:51.931395 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1455/2913] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:51 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:51.944358 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3ec87-69fc-4187-beb7-25d49a996b12 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:51.946146 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-d4d3ec87-69fc-4187-beb7-25d49a996b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:51.975033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:52.023486 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d3ec87-69fc-4187-beb7-25d49a996b12 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:52.029780 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0f626-8961-4908-8b19-506f96cd7f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1947d85a08e944f3a1e7451ee7847b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:52.032340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f626-8961-4908-8b19-506f96cd7f3c service cinder] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:52.032340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f626-8961-4908-8b19-506f96cd7f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:52.032340 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f626-8961-4908-8b19-506f96cd7f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:52.043634 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0f626-8961-4908-8b19-506f96cd7f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:52.045579 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0f626-8961-4908-8b19-506f96cd7f3c service cinder] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:52.058123 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1459/2914] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:51 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:54.924228 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033de8-7554-40e0-90f9-36560065fccf None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:54.925653 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-b3033de8-7554-40e0-90f9-36560065fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:54.946826 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:54.994144 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033de8-7554-40e0-90f9-36560065fccf None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:55.004170 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:55.004885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:55.005098 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:55.005370 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] PATH_INFO: `/v3/users/b98b6026ec1e49be91f14953eda56adb` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:55.006836 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98b6026ec1e49be91f14953eda56adb)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:55.009090 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:55.163570 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98b6026ec1e49be91f14953eda56adb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:55.170823 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98b6026ec1e49be91f14953eda56adb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:55.172212 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98b6026ec1e49be91f14953eda56adb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:55.257768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98b6026ec1e49be91f14953eda56adb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:55.277167 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98b6026ec1e49be91f14953eda56adb'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:55.284633 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1456/2915] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:54 2022] DELETE /identity/v3/users/b98b6026ec1e49be91f14953eda56adb => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:55.289469 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687327ba-9079-4341-bd89-fbf57ed776a4 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:55.290036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687327ba-9079-4341-bd89-fbf57ed776a4 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:55.290036 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687327ba-9079-4341-bd89-fbf57ed776a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:55.312074 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-687327ba-9079-4341-bd89-fbf57ed776a4 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:55.313428 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-687327ba-9079-4341-bd89-fbf57ed776a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:55.383598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1460/2916] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 16:44:55.394073 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:55.395521 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:55.478282 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2d18b-eb64-4112-b901-1450c5acbc10 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:55.482641 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c921174-dcee-46cb-a5de-f6ddf3ce3099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:55.483333 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c921174-dcee-46cb-a5de-f6ddf3ce3099 service neutron] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:55.483790 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c921174-dcee-46cb-a5de-f6ddf3ce3099 service neutron] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:55.484870 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c921174-dcee-46cb-a5de-f6ddf3ce3099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:55.499153 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c921174-dcee-46cb-a5de-f6ddf3ce3099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:55.500910 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c921174-dcee-46cb-a5de-f6ddf3ce3099 service neutron] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:55.520956 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1457/2917] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:44:56.096807 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687327ba-9079-4341-bd89-fbf57ed776a4 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:56.099286 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-687327ba-9079-4341-bd89-fbf57ed776a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:56.112587 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687327ba-9079-4341-bd89-fbf57ed776a4 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:56.118081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:56.118951 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:56.119291 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:56.119629 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] PATH_INFO: `/v3/projects/666a1fde6c074c0e8f30a7aff68dd369` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:56.120956 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=666a1fde6c074c0e8f30a7aff68dd369)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:56.122964 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:56.248539 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '666a1fde6c074c0e8f30a7aff68dd369', 'request_id': 'req-e76529ac-0870-4618-a4b5-127e1fa05038'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:56.255755 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '666a1fde6c074c0e8f30a7aff68dd369', 'request_id': 'req-e76529ac-0870-4618-a4b5-127e1fa05038'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:56.261667 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '666a1fde6c074c0e8f30a7aff68dd369', 'request_id': 'req-e76529ac-0870-4618-a4b5-127e1fa05038'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:56.332602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] The token cache is being invalidate because project 666a1fde6c074c0e8f30a7aff68dd369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:44:56.333240 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:56.333590 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:56.335174 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1461/2918] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:56 2022] DELETE /identity/v3/projects/666a1fde6c074c0e8f30a7aff68dd369 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:56.602295 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c921174-dcee-46cb-a5de-f6ddf3ce3099 service neutron] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:56.603721 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-9c921174-dcee-46cb-a5de-f6ddf3ce3099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:56.654222 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:56.723577 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c921174-dcee-46cb-a5de-f6ddf3ce3099 service neutron] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:56.815963 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fe168-1d0d-4091-9e36-a112744d7fda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '060b6347b13b4f67bf47169f5668b205', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:56.816748 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fe168-1d0d-4091-9e36-a112744d7fda service nova] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:56.817101 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fe168-1d0d-4091-9e36-a112744d7fda service nova] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:56.817450 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fe168-1d0d-4091-9e36-a112744d7fda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:56.820459 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-137fe168-1d0d-4091-9e36-a112744d7fda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:56.894913 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fe168-1d0d-4091-9e36-a112744d7fda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:56.896764 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fe168-1d0d-4091-9e36-a112744d7fda service nova] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:56.908837 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1458/2919] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:58.666531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:58.668046 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:58.740832 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:58.763661 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76529ac-0870-4618-a4b5-127e1fa05038 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:58.774377 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:58.775871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:58.775871 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:58.776328 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] PATH_INFO: `/v3/users/25a74dd46cd7429193de8468506c23f9` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:58.786267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a74dd46cd7429193de8468506c23f9)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:58.788611 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:59.015748 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a74dd46cd7429193de8468506c23f9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:59.023048 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a74dd46cd7429193de8468506c23f9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:59.023741 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a74dd46cd7429193de8468506c23f9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:59.120087 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a74dd46cd7429193de8468506c23f9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:59.120709 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a74dd46cd7429193de8468506c23f9'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:44:59.146132 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1462/2920] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:44:58 2022] DELETE /identity/v3/users/25a74dd46cd7429193de8468506c23f9 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:44:59.151179 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14b57-bcff-4945-94fd-7b3eb3f69ff2 None None] REQUEST_METHOD: `POST` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:59.151900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14b57-bcff-4945-94fd-7b3eb3f69ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:59.151900 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d14b57-bcff-4945-94fd-7b3eb3f69ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:59.173595 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.auth.core [None req-26d14b57-bcff-4945-94fd-7b3eb3f69ff2 None None] MFA Rules not processed for user `9919555c8b9f4d16b646e3f64ace74c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81783) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:44:59.174885 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-26d14b57-bcff-4945-94fd-7b3eb3f69ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:59.229988 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=100 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:59.263768 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1459/2921] 10.222.0.15 () {58 vars in 958 bytes} [Thu Sep 1 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:44:59.276417 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:59.278122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:59.362143 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886c78-b787-4ee8-b835-2695938b0863 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:59.366173 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d738db28-765a-455e-a07c-5b7ea56bf682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:59.366760 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738db28-765a-455e-a07c-5b7ea56bf682 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:59.367066 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738db28-765a-455e-a07c-5b7ea56bf682 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:59.367339 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d738db28-765a-455e-a07c-5b7ea56bf682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:59.380522 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738db28-765a-455e-a07c-5b7ea56bf682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:59.382941 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d738db28-765a-455e-a07c-5b7ea56bf682 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:44:59.402510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1463/2922] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:44:59.936071 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d14b57-bcff-4945-94fd-7b3eb3f69ff2 None None] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:44:59.937804 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-26d14b57-bcff-4945-94fd-7b3eb3f69ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:44:59.953819 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d14b57-bcff-4945-94fd-7b3eb3f69ff2 None None] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:44:59.960463 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:44:59.961062 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:44:59.961335 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:44:59.961672 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] PATH_INFO: `/v3/projects/0330843dc28b410b859d68a9db7922ca` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:44:59.962778 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0330843dc28b410b859d68a9db7922ca)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:44:59.964679 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:00.098331 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0330843dc28b410b859d68a9db7922ca', 'request_id': 'req-8a64f569-5d36-4c19-8dd3-cbcc270d4007'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:00.105442 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0330843dc28b410b859d68a9db7922ca', 'request_id': 'req-8a64f569-5d36-4c19-8dd3-cbcc270d4007'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:00.184330 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0330843dc28b410b859d68a9db7922ca', 'request_id': 'req-8a64f569-5d36-4c19-8dd3-cbcc270d4007'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:00.196301 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] The token cache is being invalidate because project 0330843dc28b410b859d68a9db7922ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:45:00.196586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:00.197243 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:00.198874 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1460/2923] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:44:59 2022] DELETE /identity/v3/projects/0330843dc28b410b859d68a9db7922ca => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:45:00.599006 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e1f26-eca3-402d-a64f-016d4d50b643 None None] REQUEST_METHOD: `POST` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:00.606209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e1f26-eca3-402d-a64f-016d4d50b643 None None] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:00.606209 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e1f26-eca3-402d-a64f-016d4d50b643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:00.638031 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.auth.core [None req-595e1f26-eca3-402d-a64f-016d4d50b643 None None] MFA Rules not processed for user `b536cb90a9d54ad29f0eb69e7a410add`. Rule list: `[]` (Enabled: `True`). {{(pid=81784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 16:45:00.639280 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-595e1f26-eca3-402d-a64f-016d4d50b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:00.712460 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1464/2924] 10.222.0.15 () {58 vars in 967 bytes} [Thu Sep 1 16:45:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 16:45:00.871211 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:00.871341 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:00.885033 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e1f26-eca3-402d-a64f-016d4d50b643 None None] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:00.886656 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-595e1f26-eca3-402d-a64f-016d4d50b643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:00.894116 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:00.948674 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e1f26-eca3-402d-a64f-016d4d50b643 None None] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:00.953462 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e346b-51cb-42c4-9e1f-a36b6afbad58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02432d1312a34273813856362cada1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:00.954167 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e346b-51cb-42c4-9e1f-a36b6afbad58 service neutron] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:00.954470 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e346b-51cb-42c4-9e1f-a36b6afbad58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:00.954743 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e346b-51cb-42c4-9e1f-a36b6afbad58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:00.956166 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64f569-5d36-4c19-8dd3-cbcc270d4007 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:00.956521 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f02e346b-51cb-42c4-9e1f-a36b6afbad58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:00.961557 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931a89b-df22-4cfd-bab3-2706c65f6b4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '589e62c8d27044eea16e7c1f803e1393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:00.962207 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a89b-df22-4cfd-bab3-2706c65f6b4c service swift] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:00.962489 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a89b-df22-4cfd-bab3-2706c65f6b4c service swift] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:00.962914 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931a89b-df22-4cfd-bab3-2706c65f6b4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:00.973240 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931a89b-df22-4cfd-bab3-2706c65f6b4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:00.978013 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0931a89b-df22-4cfd-bab3-2706c65f6b4c service swift] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:00.983694 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1461/2925] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Sep 1 16:45:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:01.029795 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e346b-51cb-42c4-9e1f-a36b6afbad58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:01.032120 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02e346b-51cb-42c4-9e1f-a36b6afbad58 service neutron] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:01.043882 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1465/2926] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 16:45:06.204534 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931a89b-df22-4cfd-bab3-2706c65f6b4c service swift] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:06.206652 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-0931a89b-df22-4cfd-bab3-2706c65f6b4c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:06.291417 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:06.296606 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931a89b-df22-4cfd-bab3-2706c65f6b4c service swift] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:06.301722 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc362-8414-4410-8139-25c18b9c3850 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d15478ca864f49aae2301e2328fe23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:06.302385 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc362-8414-4410-8139-25c18b9c3850 service placement] REQUEST_METHOD: `GET` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:06.302661 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc362-8414-4410-8139-25c18b9c3850 service placement] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:06.302931 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dc362-8414-4410-8139-25c18b9c3850 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:06.304709 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-3c3dc362-8414-4410-8139-25c18b9c3850 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:06.317927 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dc362-8414-4410-8139-25c18b9c3850 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:06.319543 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3dc362-8414-4410-8139-25c18b9c3850 service placement] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:06.331024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1462/2927] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:45:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:45:10.412154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e346b-51cb-42c4-9e1f-a36b6afbad58 service neutron] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:10.412154 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f02e346b-51cb-42c4-9e1f-a36b6afbad58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:10.428128 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e346b-51cb-42c4-9e1f-a36b6afbad58 service neutron] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:10.434602 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:10.435267 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:10.435557 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:10.435888 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] PATH_INFO: `/v3/users/7f309d1af48544fcb9891113446a05cf` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:10.437693 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f309d1af48544fcb9891113446a05cf)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:10.439746 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:10.684070 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f309d1af48544fcb9891113446a05cf'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:10.692788 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f309d1af48544fcb9891113446a05cf'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:10.693510 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f309d1af48544fcb9891113446a05cf'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:10.777237 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f309d1af48544fcb9891113446a05cf'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:10.777818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f309d1af48544fcb9891113446a05cf'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:10.802208 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1466/2928] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:45:10 2022] DELETE /identity/v3/users/7f309d1af48544fcb9891113446a05cf => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:45:11.103117 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc362-8414-4410-8139-25c18b9c3850 service placement] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:11.120996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dc362-8414-4410-8139-25c18b9c3850 service placement] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:11.210907 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:11.212013 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:11.212495 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:11.212959 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] PATH_INFO: `/v3/projects/52ed24ff4ed34f948e58f78fba13dc24` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:11.214248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ed24ff4ed34f948e58f78fba13dc24)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:11.216188 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:11.368673 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ed24ff4ed34f948e58f78fba13dc24', 'request_id': 'req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.377928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ed24ff4ed34f948e58f78fba13dc24', 'request_id': 'req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.435259 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ed24ff4ed34f948e58f78fba13dc24', 'request_id': 'req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.447310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] The token cache is being invalidate because project 52ed24ff4ed34f948e58f78fba13dc24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:45:11.447620 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.448252 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.450154 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1463/2929] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:45:11 2022] DELETE /identity/v3/projects/52ed24ff4ed34f948e58f78fba13dc24 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:45:11.455577 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:11.457095 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:11.472145 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9840f6-0749-4d6d-a99e-427f1ab066ee admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:11.498916 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:11.534598 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:11.535152 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:11.535434 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:11.535706 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] PATH_INFO: `/v3/users/32dda62d101c4e9b84c624b1f0e5d86b` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:11.536848 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32dda62d101c4e9b84c624b1f0e5d86b)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:11.538796 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:11.592060 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:11.594964 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:11.610551 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e6be3-182e-45b2-8d9e-cc92f09f8891 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:11.615300 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:11.617107 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:11.617387 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:11.617654 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] PATH_INFO: `/v3/users/418adb6ed5284c398d86dffa19b3d16f` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:11.618928 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] RBAC: Authorizing `identity:delete_user(user_id=418adb6ed5284c398d86dffa19b3d16f)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:11.620816 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:11.766088 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32dda62d101c4e9b84c624b1f0e5d86b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.773823 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32dda62d101c4e9b84c624b1f0e5d86b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.774562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32dda62d101c4e9b84c624b1f0e5d86b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.893199 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32dda62d101c4e9b84c624b1f0e5d86b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.893967 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32dda62d101c4e9b84c624b1f0e5d86b'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.908545 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418adb6ed5284c398d86dffa19b3d16f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.913179 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1467/2930] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:45:11 2022] DELETE /identity/v3/users/32dda62d101c4e9b84c624b1f0e5d86b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:45:11.922675 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418adb6ed5284c398d86dffa19b3d16f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:11.923439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418adb6ed5284c398d86dffa19b3d16f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.001556 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418adb6ed5284c398d86dffa19b3d16f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.018729 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:12.021763 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418adb6ed5284c398d86dffa19b3d16f'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.029235 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1464/2931] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:45:11 2022] DELETE /identity/v3/users/418adb6ed5284c398d86dffa19b3d16f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:45:12.168805 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:12.172165 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:12.259531 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9ddef-620f-4ea0-962f-5aeee8f9bac8 admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:12.318771 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:12.320749 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:12.331886 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:12.345710 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:12.346419 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:12.346697 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:12.346966 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] PATH_INFO: `/v3/projects/c3ce56dc74d04e2589c4cf3d3c8320f8` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:12.351110 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3ce56dc74d04e2589c4cf3d3c8320f8)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:12.354211 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:12.414674 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2675ed0-2940-4861-ac3b-cae40ad0488a admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:12.419361 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:12.420016 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:12.420310 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:12.420580 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] PATH_INFO: `/v3/projects/5078c7eec0a145efad4a710b88a8f57c` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:12.422685 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5078c7eec0a145efad4a710b88a8f57c)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:12.424586 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:12.488230 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ce56dc74d04e2589c4cf3d3c8320f8', 'request_id': 'req-e4e99565-90be-4c47-8b8b-ac62029bc60a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.494502 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ce56dc74d04e2589c4cf3d3c8320f8', 'request_id': 'req-e4e99565-90be-4c47-8b8b-ac62029bc60a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.500189 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ce56dc74d04e2589c4cf3d3c8320f8', 'request_id': 'req-e4e99565-90be-4c47-8b8b-ac62029bc60a'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.566828 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5078c7eec0a145efad4a710b88a8f57c', 'request_id': 'req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.573049 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5078c7eec0a145efad4a710b88a8f57c', 'request_id': 'req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.583818 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] The token cache is being invalidate because project c3ce56dc74d04e2589c4cf3d3c8320f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:45:12.584186 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.586406 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.593228 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1468/2932] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:45:12 2022] DELETE /identity/v3/projects/c3ce56dc74d04e2589c4cf3d3c8320f8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:45:12.664356 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5078c7eec0a145efad4a710b88a8f57c', 'request_id': 'req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.678782 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] The token cache is being invalidate because project 5078c7eec0a145efad4a710b88a8f57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:45:12.678996 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.679644 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:12.681164 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1465/2933] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:45:12 2022] DELETE /identity/v3/projects/5078c7eec0a145efad4a710b88a8f57c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 16:45:12.685352 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:12.687405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:12.763371 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e99565-90be-4c47-8b8b-ac62029bc60a admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:12.831449 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:12.832318 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:12.832711 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:12.833081 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] PATH_INFO: `/v3/users/74b1bcdf6d764bb9824cbb2b538a1f5c` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:12.834463 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b1bcdf6d764bb9824cbb2b538a1f5c)` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:12.836887 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:12.996606 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:13.009275 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b1bcdf6d764bb9824cbb2b538a1f5c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:13.016829 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b1bcdf6d764bb9824cbb2b538a1f5c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:13.017513 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b1bcdf6d764bb9824cbb2b538a1f5c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:13.087122 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b1bcdf6d764bb9824cbb2b538a1f5c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:13.087749 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.notifications [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b1bcdf6d764bb9824cbb2b538a1f5c'} {{(pid=81784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:13.107821 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1469/2934] 10.222.0.15 () {58 vars in 1224 bytes} [Thu Sep 1 16:45:12 2022] DELETE /identity/v3/users/74b1bcdf6d764bb9824cbb2b538a1f5c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:45:13.385858 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] Authenticating user token {{(pid=81783) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:45:13.387342 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.fernet_utils [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81783) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:45:13.403439 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41de1a-dfe8-43fb-b3fc-f9671c8f65d2 admin admin] Validating token access rules against request {{(pid=81783) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:45:13.472484 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9919555c8b9f4d16b646e3f64ace74c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1932bfa4cf144bf9a1f6249a0b89aa8', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81783) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:45:13.473229 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:45:13.473575 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:45:13.473946 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] PATH_INFO: `/v3/projects/f6337db2eb6e4620955206218ac5b5c2` {{(pid=81783) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:45:13.475349 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6337db2eb6e4620955206218ac5b5c2)` {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:45:13.477403 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] RBAC: Authorization granted {{(pid=81783) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:45:13.614248 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:13.631818 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6337db2eb6e4620955206218ac5b5c2', 'request_id': 'req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:13.638569 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6337db2eb6e4620955206218ac5b5c2', 'request_id': 'req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:13.738024 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6337db2eb6e4620955206218ac5b5c2', 'request_id': 'req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c'} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:13.750221 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] The token cache is being invalidate because project f6337db2eb6e4620955206218ac5b5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81783) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 16:45:13.750686 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:13.751802 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG keystone.notifications [None req-afe1e86b-2103-4fdc-89a5-c1e1f7591b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81783) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 16:45:13.753337 dv-cinder-836027-9-smb devstack@keystone.service[81783]: [pid: 81783|app: 0|req: 1466/2935] 10.222.0.15 () {58 vars in 1233 bytes} [Thu Sep 1 16:45:13 2022] DELETE /identity/v3/projects/f6337db2eb6e4620955206218ac5b5c2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 16:45:23.172703 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=17,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:23.800973 dv-cinder-836027-9-smb devstack@keystone.service[81783]: DEBUG dbcounter [-] [81783] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=81783) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:49.797624 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] Authenticating user token {{(pid=81784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 16:48:49.799600 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:49.871562 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5af34d-fb7c-406a-82f4-6dc5effb6eea admin admin] Validating token access rules against request {{(pid=81784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 16:48:49.932405 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cd1d3-3903-4f20-a76a-d6710e858eac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61d15478ca864f49aae2301e2328fe23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc1930a713a48c693da6c8d6b2102a9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 16:48:49.933030 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd1d3-3903-4f20-a76a-d6710e858eac service placement] REQUEST_METHOD: `GET` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 16:48:49.933322 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd1d3-3903-4f20-a76a-d6710e858eac service placement] SCRIPT_NAME: `/identity` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 16:48:49.933593 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd1d3-3903-4f20-a76a-d6710e858eac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 16:48:49.935488 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.fernet_utils [None req-f75cd1d3-3903-4f20-a76a-d6710e858eac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 16:48:49.948202 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cd1d3-3903-4f20-a76a-d6710e858eac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 16:48:49.949763 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cd1d3-3903-4f20-a76a-d6710e858eac service placement] RBAC: Authorization granted {{(pid=81784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 16:48:49.960288 dv-cinder-836027-9-smb devstack@keystone.service[81784]: [pid: 81784|app: 0|req: 1470/2936] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Sep 1 16:48:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 16:48:59.955501 dv-cinder-836027-9-smb devstack@keystone.service[81784]: DEBUG dbcounter [-] [81784] Writing DB stats keystone:SELECT=58 {{(pid=81784) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}